2018 · 522 citations · 24 references
ComputingComputer ScienceComputational LinguisticsKnowledge RepresentationNatural Language ProcessingConversational User InterfacesDialogue SystemsKnowledge GraphsNatural Language GenerationNatural Language UnderstandingText GenerationCommonsense Knowledge BasesCommonsense Knowledge GraphsDialogue Response GenerationLanguage UnderstandingOpen-domain DialogueOpen-domain Text GenerationSemantic InformationWord Generation
Commonsense knowledge is vital to many natural language processing tasks. In this paper, we present a novel open-domain conversation generation model to demonstrate how large-scale commonsense knowledge can facilitate language understanding and generation. Given a user post, the model retrieves relevant knowledge graphs from a knowledge base and then encodes the graphs with a static graph attention mechanism, which augments the semantic information of the post and thus supports better understanding of the post. Then, during word generation, the model attentively reads the retrieved knowledge graphs and the knowledge triples within each graph to facilitate better generation through a dynamic graph attention mechanism. This is the first attempt that uses large-scale commonsense knowledge in conversation generation. Furthermore, unlike existing models that use knowledge triples (entities) separately and independently, our model treats each knowledge graph as a whole, which encodes more structured, connected semantic information in the graphs. Experiments show that the proposed model can generate more appropriate and informative responses than state-of-the-art baselines.
24
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
Guillem Cucurull, Arantxa Casanova, Adriana Romero et al. · arXiv (Cornell University) · 2017 · 8.3K citations · Full text
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier, Jason Weston et al. · 2015 · 5.2K citations · Full text