2011 · 56 citations · 6 references
ComputingComputer ScienceNatural Language ProcessingReading ComprehensionTest DevelopmentNatural Language UnderstandingQuestion AnsweringText ComprehensionAnswering Text-dependent QuestionsMachine Reading ComprehensionModality EffectModality-specific ProcessingPropositional ReasoningQuestion Answering SystemsQuestion Answering Systems EvaluationReference Data Sets
Abstract. This paper describes the Question Answering for Machine Reading (QA4MRE) task at the 2012 Cross Language Evaluation Forum. In the main task, systems answered multiple-choice questions on documents concerned with four different topics. There were also two pilot tasks, Processing Modality and Negation for Machine Reading, and Machine Reading on Biomedical Texts about Alzheimer's disease. This paper describes the preparation of the data sets, the definition of the background collections, the metric used for the evaluation of the systems ’ submissions, and the results. Eleven groups participated in the task submitting a total of 43 runs in seven languages. 1.
6
Building Watson: An Overview of the DeepQA Project
David Ferrucci, Eric W. Brown, Jennifer Chu‐Carroll et al. · AI Magazine · 2010 · 1.5K citations · Full text
The pascal recognising textual entailment challenge
Ido Dagan, Oren Glickman · 2005 · 600 citations
Oren Etzioni, Michele Banko, Michael Cafarella · National Conference on Artificial Intelligence · 2006 · 104 citations