CS5740 SP18

Time: TuThu, 10:55am-12:10pm
Room: Bloomberg 161
Class listing: CS5740

Instructor: Yoav Artzi
Office hours: Tuesday, 4:30pm-5:30pm
Location: Bloomberg 371

Teaching assistant: Alane Suhr
Office hours: Friday, 11am-12pm
Location: Bloomberg 256

CMS | Piazza

Schedule

Assignments and Exam

  Release Date Due Date
Assignment 1 Feb 1 Mar 1
Assignment 2 Mar 1 Mar 17
Assignment 3 Mar 17 Apr 11
Assignment 4 Apr 12 Apr 29
Assignment 5 Apr 25 May 11
Take-home Exam May 12 May 16
Assignment X Mar 20 May 11

Lectures

Bold readings are the highest priority.

Date Topic Board Recommended Readings
Jan 25 Introduction   NLP (circa 2001)
Jan 30 PDF  
  Text classification   M&S 7.4,16.2-16.3, Collins: Naive Bayes (Sec 1-4), Collins: Log Linear (Sec 2), MaxEnt, Baselines, CNN Classification Naive Bayes prior derivation
Feb 1 PDF  
Feb 6 PDF  
Feb 8 PDF  
Feb 13    
  Neural networks PDF Primer, Back-prop, Deep Averaging Networks, Gradient Checks (briefly), Gradient Checks (in details)
Feb 15 PDF  
  Computation graphs   Intro to Computation Graphs
Feb 20 No class – Feburary break    
Feb 22 Lexical semantics and embeddings PDF w2v explained, word2vec, word2vec phrases, Hill2016, Turney2010
Feb 27 DyNet and error analysis   DyNet tutorials
Mar 1 Lexical semantics (contd.) PDF  
Mar 6 PDF  
  Language modeling   J&M 4, M&S 6, Collins: LM, Smoothing, Char RNN
Mar 8 PDF  
Mar 13 PDF  
Mar 15    
  Sequence modeling   J&M 5.1-5.3, 6, M&S 3.1, 9, 10.1-10.3, Collins: HMM, Collins: MEMMs (Sec 3), Collins: CRF (sec 4), Collins: Forward-backward, SOTA Taggers, TnT Tagger, Stanford Tagger
Mar 20 PDF  
Mar 22 PDF  
Mar 27 PDF  
Mar 29 PDF  
  Recurrent neural networks   BPTT, RNN Tutorial, Effectiveness, Luong2015
Apr 3 No class – spring break    
Apr 5 No class – spring break    
Apr 10 Recurrent neural networks PDF  
Apr 12 PDF  
Apr 17 Dependency parsing PDF J&M 12.7, Nivre2003, Chen2014
Apr 19    
Apr 24 Constituency parsing   J&M 12.1-12.6, 13.1-13.4, 14.1-14.4, M&S 11, 12.1, Collins: PCFGs, Eisner: Inside-outside, Collins: Inside-outside
Apr 26      
May 1      
May 3      
May 8      

Upcoming Topics

As we reach a topic, it will be moved to the schedule table above.

Topic Recommended Readings
Machine translation Neural MT Tutorial, BLEU Score
IBM translation models J&M 25.5, M&S 13.1-13.2, Collins: IBM Models, IBM Models, Collins: EM (Sec 5-6), HMM alignments, IBM Model 2 EM Notebook
Phrase-based machine translation J&M 25.4, 25.8, M&S 13.3, Collins: PBT, Statistical PBT, Pharaoh decoder

If time allows, we will discuss compositional semantics, summarization, and question answering.