Ashutosh Saxena

Assistant Professor,
Microsoft Faculty Fellow, and Sloan Fellow.
Department of Computer Science,
Cornell University.

Education: PhD, Stanford University with Prof. Andrew Y. Ng.

4159 Upson Hall, Ithaca, NY 14853.
Tel: (607)255-7017, Fax: (607)255-4428
asaxena at cs.cornell dot edu

Research Interests

Artificial Intelligence:  Machine Learning,  Robotics,  Computer Vision / Perception.

Personal Robotics
Data-driven learning of new perception/ manipulation skills.
Make3D
3D depths from a single still image.
3D Perception/vision
Scene/activity understanding from RGBD data.
Hallucinating Humans
Unsupervised learning of spatio-temporal affordances.


How can robots operate autonomously in unstructured environments? I design new machine learning algorithms to help robots perceive the dynamic environments so that they can perform tasks such as manipulating objects in the environment, perform assistive tasks, and more. Perceiving the environment includes addressing 3D perception, activity detection, reasoning through humans, and in general mapping the high-dimensional perceptual space to robotic actions in time.

One key challenge is how to formulate traditional robotics problems of perception and planning into data-driven learning problems.

Research Group

PhD students: Yun Jiang, Hema Koppula, Ian Lenz, Jaeyong Sung, Ashesh Jain.

I co-advised Congcong Li, who is now a research scientist at Google.

Other students I have worked with are: Mevlana Gemici, Wen H Lui, Rudhir Gupta, Changxi Zheng (now assistant professor at Columbia University), Paul Heran Yang, Adarsh Kowdle, Zhaoyin Jia, and Marcus Lim.

     
Recent News
Koppula's paper on anticipation won the best student paper award at the Robotics Science and Systems (RSS) conference. It was also covered in NBCNews, LA Times, Wired magazine, FOX News, etc., and made fun of in the Daily Show (Comedy Central) by Lewis Black.

Rudhir Gupta was awarded best Masters project in 2013 at Cornell for this work on RGB-D human activity detection.

Koppula's, Jiang's and Lenz's papers accepted in RSS'13, with Koppula's paper as a full oral.

Lenz's deep learning now helping Baxter grasp new objects.

Yun Jiang's paper on 3D object detection using hallucinated humans presented as an oral at CVPR'13.

Zhaoyin Jia's paper on physics-based reasoning for RGB-D image segmentation presented as an oral at CVPR'13.

Saxena received NSF Career Award for research in robotic perception.

Hema Koppula's paper on detecting human activities from RGB-D videos accepted in IJRR, and a followup paper in ICML'13.

Yun Jiang's paper on discovering different types of factors in data accepted in IJCAI'13.

Saxena named one of the seven Microsoft Faculty Fellows for 2012.

Hema Koppula's project on scene understanding published in IJRR'12. With code and data.

Congcong Li passed her PhD defense for her work on Feedback enabled learning models and its applications.

Marcus Lim was awarded academic excellence award for almost perfect A+ GPA and for his work on arranging objects.

Yun Jiang's work on picking up and arranging objects (published in IJRR'12) was featured in several news articles, including MSNBC and ACM Technews.

CUAir, an undergraduate team I advised, won second place at the AUVSI competition among 35 teams. They were placed first in the mission (flight) performance category.

Prof. Saxena won Google faculty research award, IARPA Finder, and others.

Prof. Saxena is named a co-chair of the IEEE Technical committee on robot learning.

Prof. Saxena is serving as Area Chair at AAAI 2012, NIPS 2012, ICML 2013 and RSS 2013.

See cool Robot projects and the videos from CS4758!. Described in Cornell Chronicle article. (See video. see photos)

Ashutosh Saxena is a Sloan Research Fellow. (New York Times.)

See all news.