Transactions of the Association for Computational Linguistics · 2019 · 231 citations · 35 references
ComputingComputer ScienceEnglish As A Second LanguageComputational LinguisticsNatural Language ProcessingReading ComprehensionDialogue SystemsLanguage ModelingNatural Language UnderstandingQuestion AnsweringReadingText ComprehensionCommonsense Reasoning In DialogueConversational Question AnsweringDialogue-based Question AnsweringGeneral KnowledgeMulti-party DialogueMultiple-choice QuestionsSentence-level ComprehensionWorld Knowledge
We present DREAM, the first dialogue-based multiple-choice reading comprehension data set. Collected from English as a Foreign Language examinations designed by human experts to evaluate the comprehension level of Chinese learners of English, our data set contains 10,197 multiple-choice questions for 6,444 dialogues. In contrast to existing reading comprehension data sets, DREAM is the first to focus on in-depth multi-turn multi-party dialogue understanding. DREAM is likely to present significant challenges for existing reading comprehension systems: 84% of answers are non-extractive, 85% of questions require reasoning beyond a single sentence, and 34% of questions also involve commonsense knowledge. We apply several popular neural reading comprehension models that primarily exploit surface information within the text and find them to, at best, just barely outperform a rule-based approach. We next investigate the effects of incorporating dialogue structure and different kinds of general world knowledge into both rule-based and (neural and non-neural) machine learning-based reading comprehension models. Experimental results on the DREAM data set show the effectiveness of dialogue structure and general world knowledge. DREAM is available at https://dataset.org/dream/ .
35
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
NLTK: The Natural Language Toolkit
Edward Loper, Steven Bird · ArXiv.org · 2002 · 1.9K citations · Full text
Teaching Machines to Read and Comprehend
Karl Moritz Hermann, Tomáš Kočiský, Edward Grefenstette et al. · arXiv (Cornell University) · 2015 · 1.5K citations · Full text