Learning to Ask: Neural Question Generation for Reading Comprehension

Xinya Du, Junru Shao, Claire Cardie

arXiv (Cornell University) · 2017 · 111 citations · 19 references

DOIFull text

Open access

Concepts

TL;DR

The study develops an attention‑based sequence‑to‑sequence model for automatic question generation in reading comprehension, examining sentence‑ versus paragraph‑level encoding. The model is end‑to‑end trainable, relies on attention mechanisms, and avoids hand‑crafted rules or complex NLP pipelines. It outperforms the state‑of‑the‑art rule‑based system, producing questions that are more natural and harder to answer according to human evaluation.

Abstract

We study automatic question generation for sentences from text passages in reading comprehension. We introduce an attention-based sequence learning model for the task and investigate the effect of encoding sentence- vs. paragraph-level information. In contrast to all previous work, our model does not rely on hand-crafted rules or a sophisticated NLP pipeline; it is instead trainable end-to-end via sequence-to-sequence learning. Automatic evaluation results show that our system significantly outperforms the state-of-the-art rule-based system. In human evaluations, questions generated by our system are also rated as being more natural (i.e.,, grammaticality, fluency) and as more difficult to answer (in terms of syntactic and lexical divergence from the original text and reasoning needed to answer).

References

19