arXiv (Cornell University) · 2018 · 36 citations · 20 references
EngineeringSpoken Dialog SystemCorpus LinguisticsText MiningSpeech RecognitionNatural Language ProcessingData ScienceClassic Pipeline ModelsComputational LinguisticsConversation AnalysisLanguage StudiesMachine TranslationTask-oriented Dialogue SystemSequence ModellingClassic PipelineDialogue ManagementConversational Recommender SystemRetrieval Augmented GenerationDialogue State RepresentationLinguistics
Classic pipeline models for task-oriented dialogue system require explicit modeling the dialogue states and hand-crafted action spaces to query a domain-specific knowledge base. Conversely, sequence-to-sequence models learn to map dialogue history to the response in current turn without explicit knowledge base querying. In this work, we propose a novel framework that leverages the advantages of classic pipeline and sequence-to-sequence models. Our framework models a dialogue state as a fixed-size distributed representation and use this representation to query a knowledge base via an attention mechanism. Experiment on Stanford Multi-turn Multi-domain Task-oriented Dialogue Dataset shows that our framework significantly outperforms other sequence-to-sequence based baseline models on both automatic and human evaluation.
20
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.2K citations
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.3K citations · Full text
Effective Approaches to Attention-based Neural Machine Translation
Thang Luong, Hieu Pham, Christopher D. Manning · 2015 · 8.5K citations · Full text