2020 · 187 citations · 24 references
ComputingComputer ScienceComputational LinguisticsKnowledge RepresentationNatural Language ProcessingAnnotationKnowledge AnnotationKnowledge RetrievalLanguage ModelingNatural Language UnderstandingQuestion AnsweringDecompositionsKnowledge-based Question AnsweringMultihop Question AnsweringMultiple-choice Question AnsweringQuestion Answering CorporaRetrievalSentence FragmentsSentence-level Composition
Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition (QASC), that requires retrieving facts from a large corpus and composing them to answer a multiple-choice question. QASC is the first dataset to offer two desirable properties: (a) the facts to be composed are annotated in a large corpus, and (b) the decomposition into these facts is not evident from the question itself. The latter makes retrieval challenging as the system must introduce new concepts or relations in order to discover potential decompositions. Further, the reasoning model must then learn to identify valid compositions of these retrieved facts using common-sense reasoning. To help address these challenges, we provide annotation for supporting facts as well as their composition. Guided by these annotations, we present a two-step approach to mitigate the retrieval challenges. We use other multiple-choice datasets as additional training data to strengthen the reasoning model. Our proposed approach improves over current state-of-the-art language models by 11% (absolute). The reasoning and retrieval problems, however, remain unsolved as this model still lags by 20% behind human performance.
24
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Zhilin Yang, Peng Qi, Saizheng Zhang et al. · 2018 · 1.6K citations · Full text
Enhanced LSTM for Natural Language Inference
Qian Chen, Xiaodan Zhu, Zhen-Hua Ling et al. · 2017 · 1.2K citations · Full text
RACE: Large-scale ReAding Comprehension Dataset From Examinations
Guokun Lai, Qizhe Xie, Hanxiao Liu et al. · 2017 · 968 citations · Full text