Syllabus and Course Schedule

This syllabus is tentative. The topics and deadlines may change.

DateTagTopicSlides + Readings + Other Miscellaneous Information
Week 1 January 26LectureIntroduction, Language Modeling / N-grams[slides][hw0]

JM chapter3 (focus on 3.1, 3.4, 3.6.1)

Week 2February 2LectureFeature Engineering, Text Classification[slides] [hw0 solutions]

JM ch4.1 - 4.6

February 4AssignmentHW1 released
Week 3February 9LectureWord Embeddings[slides]
JM5.1-5.8
Week 4February 16[NO CLASS - February Break]
February 21AssignmentHW1 due (11.59 p.m.)
Week 5February 23LectureFFNNs, Backprop.[slides]
JM 6
February 24AssignmentHW2 released
Week 6March 2Lecture FFNNs cont., Midterm Review Session[slides]
March 5Exam[Midterm]Location: HLS110, HLSB14, KMBB11
Time: 7.30
Week 7March 9LectureRNNs + attention[slides]
[Handwritten Class Notes]
JM 13 (upto and including 13.4)
Week 8March 16LectureTransformers
March 20AssignmentHW2 due (11.59 p.m.)
Week 9March 23LectureELMo, BERT
March 23AssignmentHW3 released
Week 10March 30[NO CLASS - Spring Break]
Week 11April 6LectureModernLLMs: GPT2, GPT3
Week 12April 13LectureModernLLMs: TBD
April 15AssignmentHW3 due (11.59 p.m.)
April 16AssignmentHW4 released
Week 13April 20LectureModernLLMs: Instruction-Tuning, RL
Week 14April 27LectureLLM++: Factuality, Retrieval Augmented LLMs (RAG)
Week 15May 4LectureLLM++: Efficiency, Safety, Final Review Session
May 8AssignmentHW4 due (11.59 p.m.)
[TBA]Exam[Final]