Jan 22 |
Introduction |
PDF |
NLP (circa 2001) |
Jan 27 |
" |
PDF |
|
|
Text classification |
|
M&S 7.4,16.2-16.3, Collins: Naive Bayes (Sec 1-4), Collins: Log Linear (Sec 2), MaxEnt, Baselines, CNN Classification Naive Bayes prior derivation |
Jan 29 |
" |
PDF |
|
Feb 3 |
" |
PDF |
|
Feb 5 |
" |
PDF |
|
Feb 10 |
" |
|
|
|
Neural networks |
PDF |
Primer, Back-prop, Deep Averaging Networks, Gradient Checks (briefly), Gradient Checks (in details) |
Feb 12 |
" |
PDF |
|
|
Computation graphs |
|
NN Tips, Intro to Computation Graphs |
Feb 17 |
" |
PDF |
|
|
Meta NLP |
|
|
Feb 19 |
Lexical semantics and embeddings |
|
w2v explained, word2vec, word2vec phrases, Hill2016, Turney2010 |
Feb 24 |
No class – February break |
|
|
Feb 26 |
" |
|
|
Mar 2 |
Language modeling |
PDF |
J&M 4, M&S 6, Collins: LM, Smoothing, Char RNN |
Mar 4 |
" |
PDF |
|
Mar 9 |
" |
PDF |
|
|
Sequence modeling |
|
J&M 5.1-5.3, 6, M&S 3.1, 9, 10.1-10.3, Collins: HMM, Collins: MEMMs (Sec 3), Collins: CRF (sec 4), Collins: Forward-backward, SOTA Taggers, TnT Tagger, Stanford Tagger |
Mar 11 |
" |
PDF |
|
Mar 16 |
" |
PDF |
|
Mar 18 |
" |
PDF |
|
|
Recurrent neural networks |
|
G14, BPTT, RNN Tutorial, Effectiveness, Luong2015 |
Mar 23 |
" |
PDF |
|
Mar 25 |
" |
PDF |
|
Mar 30 |
No class – enjoy spring break! |
|
|
Apr 1 |
No class – enjoy spring break! |
|
|
Apr 6 |
Recurrent neural networks |
PDF |
|
|
Transformers |
|
Annotated Transformer, Illustrated Transformer |
Apr 8 |
" |
PDF |
|
|
Contextualized representations |
|
BERT, The Illustrated BERT, ELMo, and co., Chen2019 |
Apr 13 |
" |
PDF |
|
|
Convolutional neural networks |
|
G13, Kim2014, Jacovi2018 |
Apr 15 |
Dependency parsing |
PDF |
J&M 12.7, Nivre2003, Chen2014 |
Apr 20 |
" |
PDF |
|
Apr 22 |
" |
PDF |
|
Apr 27 |
Constituency parsing |
|
J&M 12.1-12.6, 13.1-13.4, 14.1-14.4, M&S 11, 12.1, Collins: PCFGs, Eisner: Inside-outside, Collins: Inside-outside |
Apr 29 |
" |
PDF |
|
May 4 |
Guest lecture by Joel Tetreault (Dataminr) |
|
|