Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · 2021 · 11 citations · 19 references
ComputingComputer ScienceComputational LinguisticsKnowledge RepresentationNatural Language ProcessingConversational InterfacesConversational User InterfacesDialogue SystemsNatural Language UnderstandingDialog SystemsDialogue ManagementDialogue Response GenerationEnd-to-end Dialogue SystemsKnowledge-grounded DialogueTask-oriented DialogueTask-oriented Dialogue Systems
Incorporating knowledge bases (KB) into endto-end task-oriented dialogue systems is challenging, since it requires to properly represent the entity of KB, which is associated with its KB context and dialogue context. The existing works represent the entity with only perceiving a part of its KB context, which can lead to the less effective representation due to the information loss, and adversely favor KB reasoning and response generation. To tackle this issue, we explore to fully contextualize the entity representation by dynamically perceiving all the relevant entities and dialogue history. To achieve this, we propose a COntextaware Memory Enhanced Transformer framework (COMET), which treats the KB as a sequence and leverages a novel Memory Mask to enforce the entity to only focus on its relevant entities and dialogue history, while avoiding the distraction from the irrelevant entities. Through extensive experiments, we show that our COMET framework can achieve superior performance over the state of the arts.
19
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Guillem Cucurull, Arantxa Casanova, Adriana Romero et al. · arXiv (Cornell University) · 2017 · 8.3K citations · Full text
Efficient and Robust Feature Selection via Joint ℓ2,1-Norms Minimization
Feiping Nie, Heng Huang, Xiao Cai et al. · 2010 · 1.6K citations