Machine Learning
Home
FAQ
Syllabus
Resources
Contact
Google Group
Lectures
1 Introduction
2 Basic Statistics
3 Instance based methods
4 Perceptron
5 Support Vectors
6 Kernels
7 Kernels
8 Stochastic Convergence
9 Tail Bounds
10 Risk Minimization
11 Learning Theory
12 Gaussian Processes
13 Exponential Families
14 PCA
15 Graphical Models
16 Dynamic Programming
17 Latent Variables I
18 Latent Variables II
19 EM and Clustering
20 ICA
21 Sampling
21 Trees
22 Neural Networks
23 Boosting
24 Reinforcement Learning
25 Scalability
Projects
Recitations
1 Statistics
2 Linear Algebra
3 Optimization
4 Model Selection
5 Convergence Bounds
6 Kernels
7 Risk. Gaussian Processes
8 Exponential Families
9 Information Theory
CMU
Alex Smola
Barnabas Poczos
Ina Fiterau
Junier Oliva
Leila Wehbe
Mu Li
Xuezhi Wang
MLD
CMU

Exponential Families

Introduction to Machine Learning - 10-701/15-781

Content

  • Definition

    • Properties (expectations, covariance)

    • Multinomial, Gauss, Binary, Poisson

    • Principal Component Analysis

  • Inference

    • Conjugate Priors

    • Norm-based priors

    • Maximum likelihood and Maximum-a-posteriori inference

    • Examples - Beta, Dirichlet, Gamma, Wishart

Supplementary material

Slides in PDF and Keynote are online. If you want to extract the equations from the slides you can do so by using LaTeXit, simply by dragging the equation images into it.

Videos