Knowledge-Based Systems · 2023 · 41 citations · 37 references
ComputingComputer ScienceFeature EngineeringHuman-robot InteractionMachine LearningAffective ComputingDeep LearningEmotion RecognitionEmotion UnderstandingEmotional ExpressionGraph-based LearningBenchmark Dataset EvaluationConvolutionEmotion Recognition From SpeechEmotion Recognition In InteractionGraph Convolutional NetworksGraph Neural Network FeaturesGraph ProcessingGraph Structure Learning
Accurate emotion recognition can drive the robot to understand human affection intentions precisely and deliver the emotional response when communicating with a person. Recently, graph structure has been applied to explicitly capture the self and inter-dependencies of speakers in the conversation. However, the performance of the method is limited by inadequate discriminative information extraction based on naive graph convolution. In this paper, we propose a novel Hierarchically Stacked Graph Convolution Framework (HSGCF), which leverages hierarchical structure to extract emotional discriminative features. The proposed HSGCF uses five graph convolution layers connected hierarchically to establish a more discriminative emotional feature extractor. More importantly, to mitigate the over-smooth problem caused by deeper networks, Transformer structures with residual connection are introduced into HSGCF. Experimental results on the IEMOCAP benchmark dataset indicate the proposed framework achieves a 4.12% improvement in accuracy and a 4.80% improvement in F1 score compared with the baseline method.
37
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
Convolutional Neural Networks for Sentence Classification
IEMOCAP: interactive emotional dyadic motion capture database
Carlos Busso, Murtaza Bulut, Chi-Chun Lee et al. · Language Resources and Evaluation · 2008 · 3.6K citations