Instructor:
Dan Gildea office hours Wed 23pm
TA: Young Chol Song office hours Mon 23pm
Location: Tu/Th 11:05am12:20pm, CSB 601
Homeworks
Required text: Christopher M. Bishop, Pattern Recognition and Machine Learning.
The following are useful references in addition
to the reading material assigned for each class:
 Stuart Russell and Peter Norvig, Artificial Intelligence, A Modern Approach.
 Trevor Hastie, Robert Tibshirani, Jerome Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction.
 Larry Wasserman, All of Statistics, 2004.
Readings not taken from Bishop are available in the box in the CS mailroom.
Syllabus
On  we will cover  which means that after class you will understand  if before class you have read 
1/13 
Probability Theory 
independence, bayes rule
 bishop 1.2 
1/18 
Information Theory 
entropy, kldistance, coding
 bishop 1.6 
1/20 
Probabilistic Inference 
priors on continuous variables
 bishop 2.2 
1/25 
Probabilistic Inference 
priors: bayesian reasoning, MAP
 bishop 3.4 
1/27 
Perceptron, Backpropagation 
the chain rule
 bishop 5.1, 5.2, 5.3 
2/1 
Support Vectors 
the kernel trick
 bishop 6.1, 6.2 
2/3 
Support Vectors 
the wolfe dual
 bishop 7.1 
2/8 
Probabilistic Inference 
polytree
 bishop 8.4 
2/10 
Expectation Maximization 
latent variable clustering
 bishop 9 
2/15 
Sampling 
Markov Chain Monte Carlo
 bishop 11.2 
2/17 
Sampling 
Gibbs Sampling
 bishop 11.3 
2/22 
Learning Theory 
probably approximately correct
 kearns&vazirani 1 
2/24 
Learning Theory 
VC dimension
 kearns&vazirani 2, 3 
3/1 
Eigenvectors 
least squares, PCA
 bishop 12.1 
3/3 
Independent Component Analysis 
source separation
 bishop 12.4.1 
3/15 
Review 
 
3/17 
Midterm 
 
3/22 
Midterm Solutions 


3/24 
Logistic Regression 
maximum entropy
 bishop 4.3 
3/29 
Optimization 
LBFGS
 Nocedal 8.1, 9.1 
3/31 
Hidden Markov Models 
forwardbackward
 bishop 13.2 
4/5 
Particle Filters 
slam
 Thrun et al. ch 4 
4/7 
Reinforcement Learning 
qlearning
 ballard 11 
4/12 
Reinforcement Learning 
partial observability
 Thrun et al. ch 15 
4/14 
Games 
nash equilibrium
 morris 115131 
4/19 
Games 
learning to cooperate
 
4/21 
Something Fun 
 
4/26 
Review 
come to class with questions!
 
Final Exam: Friday May 6, 8:3011:30am.
Grading
 Final exam: 35%
 Homeworks: 35%
 Midterm: 25%
 Class participation: 5%
gildea @ cs rochester edu
April 13, 2011
