Special Topics: Machine Learning
CS 4380-004 Fall 2016
University of Colorado Boulder


Instructor: Alvin Grissom II
Grader: Akash Devgun


Location: ECCR 150 (Engineering Center, 1st floor)
Time: Tuesdays and Thursdays, 9:30-10:45 a.m.
Office Hours: Tuesdays 11:00-12:00 outside of ECCS 111B



Week 1:

2016-8-23 (Tue)
Topic: Introductions, What is Machine Learning?
Assignments Due: Initial Survey

2016-8-25 (Th).
Topics: Fundamentals of probability, graphical representations; Bayesian inference.
Reading Due: Barber Chapters 1, 2, 8.1, 13.1

Week 1 Survey Due at 11:55pm on Friday.
Week 1 Homework Due at 11:55pm on Monday (8-29).

2016-8-30 (Tue) Topics: Information and Entropy, language models, VW example.
Reading Due: Barber Chapters 8.2, 8.6, 8.7, 10

2016-9-1 (Th) Topics: Classification Review, Naive Bayes and Logistic Regression
Reading Due: SLP Ch. 4 (Intro, 4.1, 4.2, 4.3, 4.4, 4.6)
Slides (Logistic Regression): A B

Friday: Week 2 Assignment Due (**Pushed back to Tuesday)

2016-9-6 (Tue)
Topics: More Logistic Regression
Reading Due: Barber Ch. 13, Reading Prob. DAGs(C.3), Wikipedia article on plate notation

Slides (Logistic Regression): A B

2016-9-8 Topics: Regularization, Reading ML Papers
Slides (Regularization): AB

2016-9-13 (Tue)
Support Vector Machines (First Pass)
Reading Due: Reading Logistic Regression and Stochastic Gradient Training
Slides (SVMs): A

2016-9-15 (Th)
PAC Learning and Rademacher Complexity (First Pass)

Slides (PAC Learning): A
Slides (Rademacher Complexity): A

2016-9-20 (Th)
VC-Dimension and SVMs (Second Pass)

Reading Due: Linear Models The Perceptron (Daume III)

2016-9-27 (Tue)
Multiclass Classification
Reading Due: Learnability
The Perceptron (Daume III)
2016-9-29 (Th)
Ensemble Methods
The Perceptron (Daume III)

2016-10-4 (Tue)
Neural Networks (Pt. 1)
Reading Due: Decision Trees The Perceptron (Daume III)
2016-10-6 (Tue)
Neural Networks (Pt. 2)
Reading Due: Decision Trees The Perceptron (Daume III)