2021 · 21 citations · 33 references
ComputingComputer ScienceAlgorithmsMachine LearningStatistical LearningDeep LearningNeural NetworksPattern RecognitionSequence LearningKnowledge GeneralizationPatternsSequence GeneralizationSequence InterferenceSequence ModelingSequence PredictionSequence Representation LearningTraining
Hard interaction learning between source sequences and their next targets is challenging, which exists in a myriad of sequential prediction tasks. During the training process, most existing methods focus on explicitly hard interactions caused by wrong responses. However, a model might conduct correct responses by capturing a subset of learnable patterns, which results in implicitly hard interactions with some unlearned patterns. As such, its generalization performance is weakened. The problem gets more serious in sequential prediction due to the interference of substantial similar candidate targets.
33
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 14K citations · Full text
Neural Collaborative Filtering
Xiangnan He, Lizi Liao, Hanwang Zhang et al. · 2017 · 6.6K citations · Full text
Yoshua Bengio, Jérôme Louradour, Ronan Collobert et al. · 2009 · 5K citations · Full text