Machine Learning
Home
FAQ
Syllabus
Resources
Contact
Google Group
Lectures
1 Introduction
2 Basic Statistics
3 Instance based methods
4 Perceptron
5 Support Vectors
6 Kernels
7 Kernels
8 Stochastic Convergence
9 Tail Bounds
10 Risk Minimization
11 Learning Theory
12 Gaussian Processes
13 Exponential Families
14 PCA
15 Graphical Models
16 Dynamic Programming
17 Latent Variables I
18 Latent Variables II
19 EM and Clustering
20 ICA
21 Sampling
21 Trees
22 Neural Networks
23 Boosting
24 Reinforcement Learning
25 Scalability
Projects
Recitations
1 Statistics
2 Linear Algebra
3 Optimization
4 Model Selection
5 Convergence Bounds
6 Kernels
7 Risk. Gaussian Processes
8 Exponential Families
9 Information Theory
CMU
Alex Smola
Barnabas Poczos
Ina Fiterau
Junier Oliva
Leila Wehbe
Mu Li
Xuezhi Wang
MLD
CMU

Learning Theory

Introduction to Machine Learning - 10-701/15-781

Content

    • Application of McDiarmid's inequality

    • Infinite many hypothesis

    • Uniform convergence bounds

    • PAC bound for estimation error

    • Structural risk minimzation

  • Vapnik Chervonenkis dimension

    • Shattering

    • Growth Function

    • Sauer's lemma

    • Vapnik-Chervonenkis inequality

    • Vapnik-Chervonenkis theorem

Supplementary material

  • Slides in PDF.

  • L. Devroye, L. Gyorfi, G. Lugosi: A Probabilistic Theory of Pattern Recognition. Springer, New York, 1996.

  • L. Gyorfi (editor): Principles of Nonparametric Learning, Springer-Verlag Wien New York, 2002

  • L. Gyorfi, M. Kohler, A. Krzyzak, H. Walk: A Distribution-Free Theory of Nonparametric Regression, Springer-Verlag, New York, 2002

  • A. Tsybakov: Introduction to Nonparametric Estimation, Springer Series in Statistics, 2008

  • Robert D. Nowak: Lecture notes about Statistical Learning Theory

Videos

This is unedited video straight from a Lumix GF2 with a 20mm lens which should explain the sound (it doesn't have a dedicated audio input) … But it should help as a supplement with the slides (YouTube typically makes the 1080i version available within 1 week of the upload).