CS5740 SP19

Time: TuThu, 10:55am-12:10pm
Room: Bloomberg 161
Class listing: CS5740

Instructor: Yoav Artzi
Office hours: Tuesday, 4:15pm-5:15pm
Location: Bloomberg 371

Teaching assistants: Xinya Du and Valts Blukis
Graders: Emily Tseng, Kelly Wang, and Iris Zhang
TA Office hours: Friday, 11:00am-12:00pm
Location: Bloomberg 360

CMS | Piazza

Schedule

Assignments and Exam

  Release Date Due Date
Assignment 1 February 11 March 1
Assignment 2 March 1 March 17
Assignment 3 March 17 March 31
Assignment 4 March 31 April 22
Assignment 5 April 22 (tentative) May 7 (tentative)
Final exam May 10 (tentative) May 14 (tentative)

Lectures

Bold readings are the highest priority.

Date Topic Board Recommended Readings
Jan 22 Introduction   NLP (circa 2001)
Jan 24 " PDF  
  Text classification   M&S 7.4,16.2-16.3, Collins: Naive Bayes (Sec 1-4), Collins: Log Linear (Sec 2), MaxEnt, Baselines, CNN Classification Naive Bayes prior derivation
Jan 29 No class    
Jan 31 Text classification PDF  
Feb 5 " PDF  
Feb 7 Neural networks PDF Primer, Back-prop, Deep Averaging Networks, Gradient Checks (briefly), Gradient Checks (in details)
Feb 12 Computation graphs PDF Intro to Computation Graphs
Feb 14 Meta NLP PDF  
  Lexical semantics and embeddings   w2v explained, word2vec, word2vec phrases, Hill2016, Turney2010
Feb 19 PyTorch/DyNet tutorial   Notebooks
Feb 21 Lexical semantics and embeddings PDF  
Feb 26 No class - February break    
Feb 28 " PDF  
Mar 5 Language modeling PDF J&M 4, M&S 6, Collins: LM, Smoothing, Char RNN
Mar 7 " PDF  
Mar 12 " PDF  
  Sequence modeling   J&M 5.1-5.3, 6, M&S 3.1, 9, 10.1-10.3, Collins: HMM, Collins: MEMMs (Sec 3), Collins: CRF (sec 4), Collins: Forward-backward, SOTA Taggers, TnT Tagger, Stanford Tagger
Mar 14 " PDF  
Mar 19 " PDF  
Mar 21 " PDF  
  Recurrent neural networks   BPTT, RNN Tutorial, Effectiveness, Luong2015
Mar 26 " PDF  
Mar 28 " PDF  
Apr 2 No class - Spring break    
Apr 4 No class - Spring break    
Apr 9 No class - Campus event    
Apr 11 Dependency parsing PDF J&M 12.7, Nivre2003, Chen2014
Apr 16 " PDF  
Apr 18 "    
  Constituency parsing   J&M 12.1-12.6, 13.1-13.4, 14.1-14.4, M&S 11, 12.1, Collins: PCFGs, Eisner: Inside-outside, Collins: Inside-outside
Apr 23      
Apr 25      
May 30      
May 2      
May 7      

Upcoming Topics

As we reach a topic, it will be moved to the schedule table above.

Topic Recommended Readings
Machine translation Neural MT Tutorial, BLEU Score
IBM translation models J&M 25.5, M&S 13.1-13.2, Collins: IBM Models, IBM Models, Collins: EM (Sec 5-6), HMM alignments, IBM Model 2 EM Notebook
Phrase-based machine translation J&M 25.4, 25.8, M&S 13.3, Collins: PBT, Statistical PBT, Pharaoh decoder

If time allows, we will discuss compositional semantics, summarization, and question answering.