Instructor: Volkan Atalay

Syllabus

Lecture Outline

• Week 1: Introduction, input representation, distance metrics and similarity measures  
• Read Ch1 pp.2-6 and Ch2 pp.7-25 of Jain and Dubes
• Read (for next week) ch1 of Introduction to Probability by Dimitri P. Bertsekas and John N. Tsitsiklis
• data1.data

• Week 2: No lecture
• Week 3: Brief review of probability and computational prototyping software tools
• Read for next week
• Ch2 pp.25-36 of Jain and Dubes
• A Tutorial on PCA by J. Shlens
• A Tutorial on PCA by L.I. Smith

• Week 4: Linear projections and principal component analysis
• Read for next week
• Ch2 pp.37-54 of Jain and Dubes
• A summary on non-linear manifold learning by A. Ihler

• Week 5: Non-linear projections and multi-dimensional scaling
• Read for next week
• Ch3 pp.55-117 of Jain and Dubes
• A. K. Jain, M.N. Murthy and P.J. Flynn, Data Clustering: A Review, ACM Computing Reviews, Nov 1999.
• T. Kanungo, D. M. Mount, N. Netanyahu, C. Piatko, R. Silverman, and A. Y. Wu, An efficient k-means clustering algorithm: Analysis and implementation, IEEE Trans. Pattern Analysis and Machine Intelligence, 24 (2002), 881-892.

• Week 6: Clustering, hierarchical clustering, k-means clustering and their variations
• Read for next week
• Max Welling's Classnotes in Machine Learning, Clustering.
• The Expectation Maximization Algorithm, by Frank Dellaert.

• Week 7: Evaluation and validity of Clusters, clustering by MoG and EM

• Week 8:Self organizing maps

• Week 9:Spectral Clustering

• Week 10:No lecture-National holiday

• Week 11:Mean-shift analysis

• Week 12:Kernel methods and clustering

• Week 13:Semi-supervised learning

• Weeks 14:Student presentations

Online Books

• Principles of Data Analysis, Prasenjit Saha.
• Introduction to Probability: Second Revised Edition - Charles M. Grinstead, Swarthmore College, and J. Laurie Snell, Dartmouth College - AMS, 1997, 510 pp.
• A. K. Jain and R. C. Dubes. Algorithms for Clustering Data, Prentice Hall, 1988.

General

• A Tutorial on Mathematical Modeling
  

Useful links