CS5740 SP18

Time: TuThu, 10:55am-12:10pm
Room: Bloomberg 161
Class listing: CS5740

Instructor: Yoav Artzi
Office hours: TBD
Location: Bloomberg 371

Teaching assistant: Alane Suhr
Office hours: TBD
Location: TBD

CMS | Piazza

Schedule

Bold readings are the highest priority.

Date Topic Recommended Readings Others
Jan 25 Introduction NLP (circa 2001)  
Jan 30      
Feb 1     Assignment 1 out (tentative)
Feb 6      
Feb 8      
Feb 13      
Feb 15      
Feb 20 No class – Feburary break    
Feb 22     Assignment 1 due, Assignment 2 out (tentative)
Feb 27      
Mar 1      
Mar 6      
Mar 8      
Mar 13     Assignment 2 due, Assignment 3 out (tentative)
Mar 15      
Mar 20      
Mar 22      
Mar 27      
Mar 29     Assignment 3 due, Assignment 4 out (tentative)
Apr 3 No class – spring break    
Apr 5 No class – spring break    
Apr 10      
Apr 12      
Apr 17      
Apr 19     Assignment 4 due, Assignment 5 out (tentative)
Apr 24      
Apr 26      
May 1      
May 3      
May 8     Assignment 5 due, final exam out (due: TBD) (tentative)

Upcoming Topics

As we reach a topic, it will be moved to the schedule table above.

Topic Recommended Readings
Text classification M&S 7.4,16.2-16.3, Collins: Naive Bayes (Sec 1-4), Collins: Log Linear (Sec 2), MaxEnt, Baselines, CNN Classification Naive Bayes prior derivation
Neural networks Primer, Back-prop, Deep Averaging Networks, Gradient Checks (briefly), Gradient Checks (in details)
Computation graphs Intro to Computation Graphs
Lexical semantics and embeddings w2v explained, word2vec, word2vec phrases, Hill2016, Turney2010
Language modeling J&M 4, M&S 6, Collins: LM, Smoothing, Char RNN
Machine translation Neural MT Tutorial, BLEU Score
IBM translation models J&M 25.5, M&S 13.1-13.2, Collins: IBM Models, IBM Models, Collins: EM (Sec 5-6), HMM alignments, IBM Model 2 EM Notebook
Phrase-based machine translation J&M 25.4, 25.8, M&S 13.3, Collins: PBT, Statistical PBT, Pharaoh decoder
Sequence modeling J&M 5.1-5.3, 6, M&S 3.1, 9, 10.1-10.3, Collins: HMM, Collins: MEMMs (Sec 3), Collins: CRF (sec 4), Collins: Forward-backward, SOTA Taggers, TnT Tagger, Stanford Tagger
Recurrent neural networks BPTT, RNN Tutorial, Effectiveness
Dependency parsing J&M 12.7, Nivre2003, Chen2014
Constituency parsing J&M 12.1-12.6, 13.1-13.4, 14.1-14.4, M&S 11, 12.1, Collins: PCFGs, Eisner: Inside-outside, Collins: Inside-outside

If time allows, we will discuss compositional semantics, summarization, and question answering.