2023 · 104 citations · 25 references
ComputingData ScienceFeature EngineeringMachine LearningTime Series AnalysisAffective ComputingDeep LearningEmotion ProcessingEmotion RecognitionEmotional ExpressionTemporal Feature EngineeringContext-aware Emotion RecognitionEmotion Recognition From SpeechEmotionsHand-crafted FeaturesMulti-scale FeaturesMultiple Time Scale AnalysisTemporal Affective ModelingTime Scales
Speech emotion recognition (SER) plays a vital role in improving the interactions between humans and machines by inferring human emotion and affective states from speech signals. Whereas recent works primarily focus on mining spatiotemporal information from hand-crafted features, we explore how to model the temporal patterns of speech emotions from dynamic temporal scales. Towards that goal, we introduce a novel temporal emotional modeling approach for SER, termed Temporal-aware bI-direction Multi-scale Network (TIM-Net), which learns multi-scale contextual affective representations from various time scales. Specifically, TIM-Net first employs temporal-aware blocks to learn temporal affective representation, then integrates complementary information from the past and the future to enrich contextual representations, and finally fuses multiple time scale features for better adaptation to the emotional variation. Extensive experimental results on six benchmark SER datasets demonstrate the superior performance of TIM-Net, gaining 2.34% and 2.61% improvements of the average UAR and WAR over the second-best on each corpus. The source code is available at https://github.com/Jiaxin-Ye/TIM-Net_SER.
25
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
IEMOCAP: interactive emotional dyadic motion capture database
Carlos Busso, Murtaza Bulut, Chi-Chun Lee et al. · Language Resources and Evaluation · 2008 · 3.6K citations
librosa: Audio and Music Signal Analysis in Python
Brian McFee, Colin Raffel, Dawen Liang et al. · Proceedings of the Python in Science Conferences · 2015 · 2.9K citations · Full text
A database of German emotional speech
Felix Burkhardt, Astrid Paeschke, Manfred Rolfes et al. · 2005 · 2.2K citations