arXiv (Cornell University) · 2017 · 111 citations · 19 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingReading ComprehensionLanguage ModelingNatural Language GenerationNatural Language UnderstandingQuestion AnsweringText ComprehensionText GenerationAnswer GenerationAutomated Text GenerationDivergenceLexical DivergenceNeural Question AnsweringQuestion Answering SystemsQuestion GenerationSequence-to-sequence Generation
The study develops an attention‑based sequence‑to‑sequence model for automatic question generation in reading comprehension, examining sentence‑ versus paragraph‑level encoding. The model is end‑to‑end trainable, relies on attention mechanisms, and avoids hand‑crafted rules or complex NLP pipelines. It outperforms the state‑of‑the‑art rule‑based system, producing questions that are more natural and harder to answer according to human evaluation.
We study automatic question generation for sentences from text passages in reading comprehension. We introduce an attention-based sequence learning model for the task and investigate the effect of encoding sentence- vs. paragraph-level information. In contrast to all previous work, our model does not rely on hand-crafted rules or a sophisticated NLP pipeline; it is instead trainable end-to-end via sequence-to-sequence learning. Automatic evaluation results show that our system significantly outperforms the state-of-the-art rule-based system. In human evaluations, questions generated by our system are also rated as being more natural (i.e.,, grammaticality, fluency) and as more difficult to answer (in terms of syntactic and lexical divergence from the original text and reasoning needed to answer).
19
Kishore Papineni, Salim Roukos, Todd J. Ward et al. · 2001 · 21.5K citations · Full text
ROUGE: A Package for Automatic Evaluation of Summaries
Chin-Yew Lin · 2004 · 8.3K citations
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev et al. · 2016 · 6.3K citations · Full text
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 3.5K citations · Full text
Computing, Computer Science, French +14