Successes --- We have solicited papers showing the success of empirical methods in and across application settings. Examples include improvements in information retrieval performance due to employing language modeling techniques; effective use of statistical word segmentation algorithms in machine translation systems; and increased speech recognition accuracy through the incorporation of statistical parsing.
Challenges --- It is clear that empirical and corpus-based methods have enjoyed many successes over the past years; but in looking to future accomplishments, the community needs to be aware of the limitations of various techniques and paradigms. We have welcomed papers that carefully expose and study such limitations. Examples include the identification and exploration of: classes of domains or problems in which popular techniques perform poorly; significant gaps between human and machine performance on tasks where statistical approaches have made great progress; and important practical situations where common assumptions fail to hold. We emphasize that we sought submissions that thoughtfully document fundamental limitations, rather than simply report on unsuccessful experiments. It is desired that such papers contain thorough examination, via careful experimentation, of the critical factors contributing to the "negative" result.