Proceedings of the AAAI Conference on Artificial Intelligence · 2020 · 54 citations · 25 references
ComputingComputer ScienceArtificial IntelligenceComputational LinguisticsNatural Language ProcessingDeep LearningLanguage ModelingLanguage ModelsNatural Language GenerationNatural Language UnderstandingQuestion AnsweringAnswer GenerationGated FusionNeural Question AnsweringQuestion GenerationRoot CausesSemantic MatchingSequence-to-sequence GenerationSequence-to-sequence Recognition
Taking an answer and its context as input, sequence-to-sequence models have made considerable progress on question generation. However, we observe that these approaches often generate wrong question words or keywords and copy answer-irrelevant words from the input. We believe that lacking global question semantics and exploiting answer position-awareness not well are the key root causes. In this paper, we propose a neural question generation model with two general modules: sentence-level semantic matching and answer position inferring. Further, we enhance the initial state of the decoder by leveraging the answer-aware gated fusion mechanism. Experimental results demonstrate that our model outperforms the state-of-the-art (SOTA) models on SQuAD and MARCO datasets. Owing to its generality, our work also improves the existing models significantly.
25
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14