Lecture Notes and Assigned Readings
| Date | Lecture Topic and Handouts | Readings | Assignments |
| Mon 1/20 | Introduction (pdf) | Jurafsky and Martin, Chapter 1. | |
| ***Fri 1/24*** | History (pdf) | L. Lee. "I'm sorry Dave, I'm afraid I can't do that'': Linguistics, Statistics, and Natural Language Processing circa 2001 | |
| Mon 1/27 | Morphology (pdf) | Paper critique due.
Both papers are from: Communications of the Association for Computing Machinery, volume 37, number 6, 1994. | |
| Weds 1/29 | Morphology (pdf) | Jurafsky and Martin (J&M), Chapter 3. Background reading on FSA's can be found in J&M, Chapter 2. |
|
| Mon 2/3 | Porter stemmer; Critique discussion (pdf) | Paper critique due.
Mostly-Unsupervised Statistical Segmentation of Japanese: Applications
to Kanji. | |
| ***Fri 2/7*** | Spelling correction and the noisy channel model (pdf) | J&M, Chapter 5.1-5.5. | |
| Mon 2/10 | Bayesian approach to spelling correction; Min edit distance for spelling correction (pdf) | J&M, Chapter 5.6. | |
| Weds 2/12 | Bayesian approach to pronunciation variation (pdf) | J&M, Chapter 5.7-5.8 | |
| Mon 2/17 | Introduction to language models (pdf) | Paper critique
due.
A Prototype Reading Coach that Listens. Mostow et al. AAAI 94. | |
| Weds 2/19 | Statistics of natural language; N-gram models (pdf) | J&M, Chapter 6-6.2 | |
| Mon 2/24 | Smoothing (pdf) | J&M, Chapter 6.3 | |
| Weds 2/26 | Backoff and deleted interpolation (pdf) | J&M, Chapter 6.4-6.8 | |
| Mon 3/3 | Lexical semantics introduction (pdf) | J&M, Chapter 16.0-16.1 | Paper critique due.
An Empircal Study of Smoothing Techniques for Language Modeling. Chen and Goodman. ACL 1996. |
| Weds 3/5 | Metaphor, synonymy, hyponymy, WordNet (pdf) | J&M, Chapter 16.2-16.4 |
Integrating Multiple Knowledge Sources to Disambiguate Word Sense: An Exemplar-Based Approach. Ng and Lee. ACL 1996. |
| Mon 3/10 | Word sense disambiguation using supervised ML methods (pdf) | J&M, Chapter 17.0-17.2 | |
| Weds 3/12 | Word sense disambiguation using weakly and un- supervised methods (pdf) | Project proposals due. | |
| Mon 3/17 | NO CLASS: spring break | ||
| Weds 3/19 | NO CLASS: spring break | ||
| Mon 3/24 | NO CLASS: spring break | ||
| Weds 3/26 |
EM Guest lecture: Vincent Ng (pdf) |
||
| Mon 3/31 | Part-of-speech tagging (pdf) | ||
| Weds 4/2 | Parsing (pdf) | ||
| Mon 4/7 | Parsing (pdf) | ||
| Weds 4/9 | Inference and text cohesion (pdf) | Project literature survey due. | |
| Mon 4/14 | Reference resolution (pdf) | ||
| Weds 4/16 | NL Generation (pdf) Guest lecture: Regina Barzilay |
||
| Mon 4/21 | |||
| Weds 4/23 | Project presentations. | ||
| Mon 4/28 | Project presentations. | ||
| Weds 4/30 | Project presentations. | ||
| Weds 5/14 | Project report due. |