2020 · 12 citations · 15 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingAffective ComputingAffective State DetectionEmotion RecognitionEmotional ExpressionSpeech RecognitionVocal ExpressionConvolutionEmotion DetectionEmotion Recognition From SpeechEmotionsLanguage UnderstandingRobust Emotion RecognitionValence ModelingVocal Emotion Recognition
Emotion plays an essential role in human-to-human communication, enabling us to convey feelings such as happiness, frustration, and sincerity. While modern speech technologies rely heavily on speech recognition and natural language understanding for speech content understanding, the investigation of vocal expression is increasingly gaining attention. Key considerations for building robust emotion models include characterizing and improving the extent to which a model, given its training data distribution, is able to generalize to unseen data conditions. This work investigated a long-shot-term memory (LSTM) network and a time convolution - LSTM (TC-LSTM) to detect primitive emotion attributes such as valence, arousal, and dominance, from speech. It was observed that training with multiple datasets and using robust features improved the concordance correlation coefficient (CCC) for valence, by 30% with respect to the baseline system. Additionally, this work investigated how emotion primitives can be used to detect categorical emotions such as happiness, disgust, contempt, anger, and surprise from neutral speech, and results indicated that arousal, followed by dominance was a better detector of such emotions.
15
IEMOCAP: interactive emotional dyadic motion capture database
Carlos Busso, Murtaza Bulut, Chi-Chun Lee et al. · Language Resources and Evaluation · 2008 · 3.6K citations
Analysis of emotion recognition using facial expressions, speech and multimodal information
Carlos Busso, Zhigang Deng, Murtaza Bulut et al. · 2004 · 832 citations