Linear Methods

Introduction to Machine Learning - 10-701/15-781

Slides in Keynote and PDF.

Content

  • Perceptron

    • Neurons and Learning

    • Perceptron learning rule

    • Convergence Analysis

  • Nonlinearity and Kernels

    • Preprocessing

    • Perceptron on features

    • Kernels and Kernel Perceptron

  • Support Vector machines

    • Large Margin Classification

    • Soft Margin Loss

    • Kernel Trick

    • Regression

    • Novelty Detection

  • Efficient Implementation

    • Optimization and active sets

    • Hash kernels for high-dimensional data

Supplementary material

Videos