Lecture Notes and Assigned Readings

Date Lecture Topic and Handouts

Readings

Assignments

       
Thur 8/25 Introduction (.pdf) Jurafsky and Martin, Chapter 1.  
Tue 8/30 History and
Introduction to lexical semantics (.pdf)
L. Lee. "I'm sorry Dave, I'm afraid I can't do that'': Linguistics, Statistics, and Natural Language Processing circa 2001

J&M: 16.1.

 
Thur 9/1 Lexical semantics (.pdf) J&M: 16.2; 16.4  
Tue 9/6 Word sense disambiguation (.pdf)
  • Wordnet
  • dictionary-based WSD approaches
J&M: 17.1-17.2.
For a description of the relevant background material on probability theory, see Manning and Schuetze 2.1.1-2.1.3. 
Paper critique due. 
Thur 9/8 Word sense disambiguation (.pdf)
  • a supervised ML method
  • a weakly supervised method
   
Tue 9/13 SENSEVAL and
Intro to the Noisy Channel model (.pdf)
   
Thur 9/15 The Noisy Channel Model (.pdf) J&M, Chapter 5.1-5.8 Paper critique due. 
Tue 9/20 Intro to generative language models (.pdf) J&M, Chapter 6.1-6.2  
Thur 9/22 N-gram models (.pdf)  
Tue 9/27 Part-of-speech tagging intro;
TBL (.pdf)
J&M, Chapter 8.1-8.4, 8.6  
Thur 9/29 HMM's for POS tagging (.pdf)
Viterbi example (.pdf)
J&M, Chapter 8.5-8.8.  The Viterbi algorithm is explained in Chapter 7.  Alternatively, see this HMM tutorial.
Tue 10/4 Smoothing + backoff (.pdf) J&M, Chapter 6.3-6.6 WSD system and report due.
Thur 10/6 No class  
Tue 10/11

***Fall Break***

   
Thur 10/13 Intro to Parsing (.pdf)   Paper critique due.
Tue 10/18 Chart Parsing (.pdf)
Example (.pdf)
J&M, Chapters 9, 10.  
Thur 10/20 Finished chart parsing and the Earley algorithm;
 
Partial parsing (.pdf
[partial parsing is not on the midterm]
   
Tue 10/25 study day   P-O-S tagging system and report due.
Thur 10/27

in-class MIDTERM

   
Tue 11/1 Probabilistic Parsing (.pdf) J&M, Chapter 12.  
Thur 11/3 Introduction to Question Answering (.pdf) The TREC Question Answering Track, Ellen Voorhees. Natural Language Engineering 1:1. 2001.  
Tue 11/8 Open-Domain Question Answering (.pdf) http://en.wikipedia.org/wiki/Question_answering  
Thur 11/10 Advanced Question Answering (.pdf)    
Tue 11/15 Guest Lecturer: Professor Thorsten Joachims (.pdf) J&M 17.3, 17.4  
Thur 11/17 Guest Lecturer: Professor Lillian Lee    
Tue 11/22 Shallow semantic analysis (.pdf)    
Thur 11/24

***Thanksgiving Break***

   
Tue 11/29 The Problem of Inference (.pdf)    
Thur 12/1 Reference resolution (.pdf) J&M, Chapter 18.  
Fri 12/2     QA system and report due. (No late penalties until after 12/5.)
Thur 12/15

***Final Exam***
7-9:30p.m.
245 Olin Hall