- About
- Events
- Calendar
- Graduation Information
- Cornell Tech Colloquium
- Student Colloquium
- BOOM
- Spring 2024 Colloquium
- Conway-Walker Lecture Series
- Salton 2023 Lecture Series
- Seminars / Lectures
- Big Red Hacks
- Cornell University - High School Programming Contests 2024
- Game Design Initiative
- CSMore: The Rising Sophomore Summer Program in Computer Science
- Explore CS Research
- ACSU Research Night
- Cornell Junior Theorists' Workshop 2024
- People
- Courses
- Research
- Undergraduate
- M Eng
- MS
- PhD
- Admissions
- Current Students
- Computer Science Graduate Office Hours
- Business Card Policy
- Cornell Tech
- Curricular Practical Training
- Exam Scheduling Guidelines
- Fellowship Opportunities
- Field of Computer Science Ph.D. Student Handbook
- Graduate TA Handbook
- Field A Exam Summary Form
- Graduate School Forms
- Instructor / TA Application
- Ph.D. Requirements
- Ph.D. Student Financial Support
- Special Committee Selection
- Travel Funding Opportunities
- Travel Reimbursement Guide
- The Outside Minor Requirement
- Diversity and Inclusion
- Graduation Information
- CS Graduate Minor
- Outreach Opportunities
- Parental Accommodation Policy
- Special Masters
- Student Spotlights
- Contact PhD Office
Speaker
Friday, February 19, 2021 - 11:25 to 12:40
Streaming via Zoom
Host:
Yoav Artzi
Categories:
Individual and Social Processes in Image Description Generation (via Zoom)
Abstract: Most language use is driven by specific communicative goals in interactive setups, where often visual perception goes hand in hand with language processing. I will discuss some recent projects by my research group related to modelling language generation in socially and visually grounded contexts, arguing that such models can help us to better understand the cognitive processes underpinning these abilities in humans. I will first focus on individual cognitive processes and present a model of image description generation that exploits information from human gaze patterns recorded during language production. I will then move on to two-person dialogue setups and describe our recent work on generating referring descriptions that are grounded in the conversational and visual context. I’ll end the talk by discussing key open questions and challenges in relations to these topics.
Bio: Raquel Fernández is an Associate Professor at the Institute for Logic, Language & Computation (ILLC), University of Amsterdam, where she leads the Dialogue Modelling Group. Her work and interests revolve around language use, encompassing topics that range from computational semantics and pragmatics to the dynamics of dialogue interaction, visually-grounded language processing, and child language acquisition, among others.
After studying Cognitive Science and Language in Barcelona, she received her PhD in Computational Linguistics from King's College London. She has held research positions at the Linguistics Department of the University of Potsdam and at the Center for the Study of Language and Information (CSLI), Stanford University. Over her career, she has been awarded several personal fellowships by the Dutch Research Council (NWO) and she is a recent [2019] recipient of an ERC Consolidator Grant. Other distinctions include having been a member of the Editorial Board of the Computational Linguistics journal and the Dialogue & Discourse journal, co-president of the SemDial Workshhop Series for ten years, and member of the scientific advisory board of SIGdial in several occasions.