2016 · 50 citations · 9 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingConversational InterfacesConversational User InterfacesDeep LearningDialogue SystemsLanguage ModelingNatural Language UnderstandingChatbotsConversational AgentsConversationsDialog SystemsDialogue ManagementKnowledge-grounded DialogueLong Short-term Memory NetworksMulti-turn Conversation Modeling
Modeling human conversations is the essence for building satisfying chat-bots with multi-turn dialog ability. Conversation modeling will notably benefit from domain knowledge since the relationships between sentences can be clarified due to semantic hints introduced by knowledge. In this paper, a deep neural network is proposed to incorporate background knowledge for conversation modeling. Through a specially designed Recall gate, domain knowledge can be transformed into the extra global memory of Long Short-Term Memory (LSTM), so as to enhance LSTM by cooperating with its local memory to capture the implicit semantic relevance between sentences within conversations. In addition, this paper introduces the loose structured domain knowledge base, which can be built with slight amount of manual work and easily adopted by the Recall gate. Our model is evaluated on the context-oriented response selecting task, and experimental results on both two datasets have shown that our approach is promising for modeling human conversations and building key components of automatic chatting systems.
9
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2015 · 1.5K citations · Full text
Data-Driven Response Generation in Social Media
Alan Ritter, Colin Cherry, William B. Dolan · NPARC · 2011 · 580 citations
The Dialog State Tracking Challenge
J. D. Williams, Antoine Raux, Deepak Ramachandran et al. · 2013 · 332 citations