Computer Science 248/448
Statistical Speech and Language Processing
Fall 2022
|
|
Instructor:
Dan Gildea (Office hours: Tu/Th 2:00-3:00pm, Wegmans 3019)
TA: Pinxin Liu (Andy) pliu23 @ u.rochester.edu (Office hours: M/W 2:00-3:00pm, Wegmans 2215)
Time: Tu/Th 11:05am-12:20pm, 101 Hylan
Homeworks
Recommended resources:
Syllabus
| On | we will cover | which means that after class you will understand | if before class you have read |
| 9/1 |
Perceptron for Tagging |
NLP = ML + DP
| Collins 2002 |
| 9/6 |
Penn Treebank |
right node raising
| |
| 9/8 |
CRFs |
f - E[f]
| McCallum 2001 |
| 9/13 |
Hidden Markov Models |
viterbi, forward
| JM App A |
| 9/15 |
Pytorch |
tensors
| tutorial |
| 9/20 |
Neural CRFs |
convexity
| Peng 2008 |
| 9/22 |
Context Free Grammars |
highest prob string, infinite trees
| JM 13 |
| 9/27 |
latent CRF |
| |
| 9/29 |
EM for HMM |
| JM App A |
| 10/4 |
Context Free Grammars |
viterbi, inside-outside
| |
| 10/6 |
Context Free Grammars |
viterbi, inside-outside
| |
| 10/13 |
Parsing |
minimum risk decoding, max-margin
| Finkel 08 |
| 10/18 |
Parsing |
crf parsing, neural parsing
| Durrett 2015 |
| 10/20 |
Weighted Deduction |
swiss german
| Goodman 1999 |
| 10/25 |
Review |
| |
| 10/27 |
Midterm |
|
|
| 11/1 |
Midterm Solutions |
| |
| 11/3 |
Search |
dijkstra, knuth, a*
| |
| 11/8 |
Semantics |
lambda calculus
| JM 20, Zettlemoyer 2005, Liang 2011 |
| 11/10 |
|
| |
| 11/15 |
Search |
Dijsktra, Knuth
| |
| 11/17 |
A* parsing, beam search |
linear-time earley
| Nederhof 2003 |
| 11/22 |
Transformers
| attention
| Vaswani 2017 |
| 11/29 |
Machine Translation
| BPE, BLEU
| Papineni 2002, Sennrich 2016 |
| 12/1 |
Neural Machine Translation |
REINFORCE
| Ranzato 2016 |
| 12/6 |
Encoder Pretraining |
bert and bart
| Bert |
| 12/8 |
Grammar induction |
Compound PCFGs
| Kim, Dyer, and Rush 2019 |
| 12/13 |
Review |
| |
Final exam: Tu 12/20 7:15-10:15pm in 101 Hylan.
Grading
- Homeworks: 40%
- Midterm: 25%
- Final: 35%
- No late homework
- Programming assignments must be in python, and must run on class account
gildea @ cs rochester edu
November 17, 2022
|