Computer Science 248/448

Statistical Speech and Language Processing

Fall 2021

Instructor: Dan Gildea (Office hours: Wed 2:00-3:00pm, Th 2:00-3:00pm, Wegman 3019)
TA: Adam Dees (Office hours: Mon 3:45-4:45pm, Tu 2:20-3:20pm, Wegmans 2307)
Time: Tu/Th 11:05am-12:20pm, 312 Gavett

Homeworks

Recommended resources:

Syllabus

Onwe will coverwhich means that after class you will understandif before class you have read
8/26 Perceptron for Tagging NLP = ML + DP Collins 2002
8/31 Penn Treebank right node raising
9/2 CRFs f - E[f] McCallum 2001
9/7 Hidden Markov Models viterbi, forward JM App A
9/9
9/14 Neural CRFs convexity Peng 2008
9/16 Context Free Grammars highest prob string, infinite trees JM 13
9/21 latent CRF
9/23 EM for HMM JM App A
9/28 Context Free Grammars viterbi, inside-outside
9/30 Context Free Grammars viterbi, inside-outside
10/5 Parsing minimum risk decoding, max-margin Finkel 08
10/7 Parsing crf parsing, neural parsing Durrett 2015
10/14 Weighted Deduction generalized outside computation Goodman 1999
10/19 Review
10/21 Midterm
10/26 Midterm Solutions
10/28 Pytorch tensors tutorial
11/2 Search dijkstra, knuth, a*
11/4 Beam search buckets
11/9 LCFRS fan-out
11/11 Machine Translation Model 1 Brown 1993
11/16 Neural Machine Translation attention Sutskever 2014, Bahdanau 2014
11/18 Neural Machine Translation BPE, BLEU Vaswani 2017, Papineni 2002, Sennrich 2016
11/23 Semantics word2vec Mikolov 2013, Pennington 2014
11/30Encoder Pretraining bert and elmo Elmo, Bert
12/2 Semantics lambda calculus JM 20, Zettlemoyer 2005, Liang 2011
12/7 Something fun
Final exam: Th 12/16 4-7pm in 101 Hylan.

Grading

  • Homeworks: 40%
  • Midterm: 25%
  • Final: 35%
  • No late homework
  • Programming assignments must be in python, and must run on class account

gildea @ cs rochester edu
September 14, 2021