Syllabus and Course Schedule

This syllabus is tentative. The topics and deadlines may change.


DateTagTopicSlides + Readings + Other Miscellaneous Information
Week 1 January 26LectureIntroduction, Language Modeling / N-grams[slides][hw0]
Week 2February 2LectureFeature Engineering, Text Classification
February 2AssignmentHW1 released
Week 3February 9LectureWord Embeddings, Intro FFNNs
Week 4February 16[NO CLASS - February Break]
February 20AssignmentHW1 due (11.59 p.m.)
Week 5February 23LectureFFNNs, Backprop.
February 23AssignmentHW2 released
Week 6March 2LectureRNNs, Midterm Review Session
March 5Exam[Midterm]Location: HLS110, HLSB14, KMBB11
Time: 7.30
Week 7March 9LectureRNN attention, Intro Transformers
Week 8March 16LectureTransformers
March 20AssignmentHW2 due (11.59 p.m.)
Week 9March 23LectureELMo, BERT
March 23AssignmentHW3 released
Week 10March 30[NO CLASS - Spring Break]
Week 11April 6LectureModernLLMs: GPT2, GPT3
Week 12April 13LectureModernLLMs: TBD
April 15AssignmentHW3 due (11.59 p.m.)
April 16AssignmentHW4 released
Week 13April 20LectureModernLLMs: Instruction-Tuning, RL
Week 14April 27LectureLLM++: Factuality, Retrieval Augmented LLMs (RAG)
Week 15May 4LectureLLM++: Efficiency, Safety, Final Review Session
May 8AssignmentHW4 due (11.59 p.m.)
[TBA]Exam[Final]