Mathematical Foundations of Machine Learning
CS 4783/5783

News :
  1. Welcome to first day of class!
  2. Join ED for Discussions: here

Location and Time :
Location : Bill and Melinda Gates Gall, G01

Time : Mon-Wed: 8:40AM - 9:55AM (EST)

Office Hours :
Karthik Sridharan: Tue 11:00AM-12:00PM, EST
Location: 424 Gates Hall

Gregory Yauney: Wed 1:00PM-2:00PM, EST
Location: 406 Rhodes Hall

Atul Ganju: Thu 1:00PM-2:00PM, EST
Location: G33 Gates Hall

DEI Statement :
You belong here! Everyone is welcome to this class. You should expect and demand to be treated by the course staff and your classmates with respect. If any incident occurs that challenges this commitment, please let the instructors know so we can address the issue. This course subscribes to the Computer Science Department’s Values of Inclusion

Description :
Machine Learning (ML) is a ubiquitous technology. This course, which is a follow up to an introductory course on ML will cover topics that aim to provide a theoretical foundation for designing and analyzing ML algorithms. This course has three basic blocks. First block will provide basic mathematical and statistical toolset required for formalizing ML problems effectively and analyzing them. This block will include topics like generalization, sample complexity of learning algorithm and understanding the inherent challenges in various ML frameworks and models. The second block will provide the foundations in algorithms design and optimization techniques required for building and analyzing various ML algorithms. This block will cover topics like gradient descent, stochastic gradient descent, algorithm design for online learning and computational challenges in ML. ML algorithms are deployed in real world and make decisions that affect real world users. The third block, will cover topics on how to formally reason about and how to design ML methods that address social and user related concerns that ML algorithms need to deal with. This block will cover topics such as fairness, privacy, the right to be forgotten and other such issues and how to build ML algorithms that address or assuage these concerns.

Pre-requisite : Prerequisite: CS 4780, CS 4820 or equivalent.

Outcomes :
Students will be able to reason about Machine Learning(ML) problems and algorithms in a principled fashion, to identify what makes learning hard and how to design algorithms that would provably work well. Students will be able to analyze new machine learning algorithms they might encounter or even design their own methods that can address specific requirements that they might encounter in their applications. Through completion of the term project students will demonstrate what it entails to formally analyze and reason out an end-to-end topic in the theory of ML and give them a taste of a real research project. Students will be aware of the social implications ML method choices can have in the real world and demonstrate to them tools that can help them identify and tackle such real world social challenges that any ML based system needs to deal with.

Grading :
4 assignments, one term project and course prelims. 3% For class participation.
For CS 5783 students, there will be an additional two reading assignments where you read two assigned research papers and quiz on them will follow.

Assignments :
    There will be a total of 4 assignments covering 40% of your grade.
Prelim :
    This course has one prelim worth 30% of your grade.
Term project :
    There will be a term project due by the end of the course. The project is worth 27% of your grade.

Email: sridharan at cs dot cornell dot edu