Lecture and assignment information will be posted often on this website. Check back soon.

Date Lecture Agenda Assignments

Wed, Jan 21, 2015


Intro: Dimensions of Information Systems

Conversational Behavior and Social information

Slides on linguistic style coordination (most of course content is chalk-on-blackboard only)

Related material:


NPR story: Before The Internet, Librarians Would 'Answer Everything' — And Still Do

Trailer for the movie "Her"


Cristian Danescu-Niculescu-Mizil, Lillian Lee, Bo Pang and Jon Kleinberg. Echoes of power: Language effects and power differences in social interaction.
Proceedings of WWW 2012.

Cristian Danescu-Niculescu-Mizil, Michael Gamon and Susan Dumais. Mark my words! Linguistic style accommodation in social media. Proceedings of WWW, 2011.

Kate G. Niederhoffer and James W. Pennebaker. Linguistic Style Matching in Social Interaction. Journal of Language and Social Psychology 2002 21: 337.

Assignment 1 out [Description, ZIP]

Due Feb 3, 5pm

Mon, Jan 26, 2015


Lecture topics:

Text similarity measures: Minimum Edit Distance, Jaccard Similarity

Basic text processing concepts: Sentence Splitting, Word Tokenization, Types, Tokens

Edit Distance worksheet (includes sketch of the Wagner Fisher algorithm we used in class)

In-class demo: Proto Information Retrieval System: IPython notebook and html

Related material:


J&M Chapters 3.9 and 3.11

Wed, Jan 28, 2015


Lecture topics:

Classic (ad hoc) information retrieval

Vector space model

Document preprocessing: stemming, deduplication, shingling

Vector space model cheatsheet (useful to keep track of notation)

Related material:


J&M Chapters 3.8 and 23.1.1; MRS Chapter 19.6