- About
- Events
- Calendar
- Graduation Information
- Cornell Learning Machines Seminar
- Student Colloquium
- BOOM
- Spring 2025 Colloquium
- Conway-Walker Lecture Series
- Salton 2024 Lecture Series
- Seminars / Lectures
- Big Red Hacks
- Cornell University / Cornell Tech - High School Programming Workshop and Contest 2025
- Game Design Initiative
- CSMore: The Rising Sophomore Summer Program in Computer Science
- Explore CS Research
- ACSU Research Night
- Cornell Junior Theorists' Workshop 2024
- People
- Courses
- Research
- Undergraduate
- M Eng
- MS
- PhD
- Admissions
- Current Students
- Computer Science Graduate Office Hours
- Advising Guide for Research Students
- Business Card Policy
- Cornell Tech
- Curricular Practical Training
- A & B Exam Scheduling Guidelines
- Fellowship Opportunities
- Field of Computer Science Ph.D. Student Handbook
- Graduate TA Handbook
- Field A Exam Summary Form
- Graduate School Forms
- Instructor / TA Application
- Ph.D. Requirements
- Ph.D. Student Financial Support
- Special Committee Selection
- Travel Funding Opportunities
- Travel Reimbursement Guide
- The Outside Minor Requirement
- Robotics Ph. D. prgram
- Diversity and Inclusion
- Graduation Information
- CS Graduate Minor
- Outreach Opportunities
- Parental Accommodation Policy
- Special Masters
- Student Spotlights
- Contact PhD Office
Shazam for Birds: Building an Offline, Real Time Machine Listening Tool for Bird Vocalizations (via Zoom)
Abstract: In this presentation I will discuss how we built Merlin Sound ID, a machine listening tool for the Merlin Bird ID app (https://merlin.allaboutbirds.org/). I will dive into how we collected audio recordings, how we annotated those recordings, and how we trained the model. This project followed a similar trajectory to most image recognition projects, with a few key differences. I will highlight these differences and discuss their impact. I will conclude with an update on our current research to improve Sound ID and our plans for expansions to other regions of the world.
Bio: Grant Van Horn is a machine learning researcher at the Cornell Lab of Ornithology. His research interests include fine-grained categorization in images, audio, and video, as well as expertise estimation and crowdsourcing. Grant has integrated machine learning models into several popular citizen science apps including Merlin Bird ID, iNaturalist, and Seek. Prior to joining Cornell, Grant was a senior scientist at Amazon Web Services. Grant received his PhD in computer vision from Caltech in 2018, advised by Pietro Perona.