2019 · 21 citations · 32 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingConversational InterfacesConversational User InterfacesDialogue AnalysisDialogue SystemsLanguage ModelingNatural Language UnderstandingBenchmark DatasetsDialog SystemsDialogue ManagementDialogue UnderstandingIntent DetectionLanguage UnderstandingNatural Language InterfacesSpoken Dialogue Systems
Intent determination is one of the main tasks of natural language understanding and dialogue systems, aiming to determine the intent of the user’s input. Incorporating contextual information for intent determination has shown much promise. Recently, memory networks have been used to encode context from the dialogue history at each turn. However, these methods lack general mechanism for encoding intent patterns. In this paper, we investigate the incorporation of intent patterns extracted from regular expression for the multi-turn intent determination task. We propose a novel neural network model with two memories. The first memory encodes context from dialogue history at each turn whereas the second memory contains the information obtained from the regular expression patterns. We evaluate the model on Frames and Key-Value Retrieval datasets, the experimental results demonstrate that encoding intent patterns with memory networks significantly improves the multi-turn intent determination.
32
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Jun‐Young Chung, Çağlar Gülçehre, Kyunghyun Cho et al. · arXiv (Cornell University) · 2014 · 10.8K citations · Full text