Sensors · 2022 · 16 citations · 22 references
ComputingComputer ScienceFeature EngineeringNatural Language ProcessingPublic OpinionAffective ComputingEmotion RecognitionFeature-level FusionMultimodal AnalysisOpinion MiningSentiment AnalysisBenchmark DatasetsEmotion Recognition From SpeechFeature FusionMulti-modal Data AnalysisMultimodal Emotion RecognitionMultimodal Feature FusionMultimodal Feature RepresentationMultimodal Fusion
With the wide application of social media, public opinion analysis in social networks has been unable to be met through text alone because the existing public opinion information includes data information of various modalities, such as voice, text, and facial expressions. Therefore multi-modal emotion analysis is the current focus of public opinion analysis. In addition, multi-modal emotion recognition of speech is an important factor restricting the multi-modal emotion analysis. In this paper, the emotion feature retrieval method for speech is firstly explored and the processing method of sample disequilibrium data is then analyzed. By comparing and studying the different feature fusion methods of text and speech, respectively, the multi-modal feature fusion method for sample disequilibrium data is proposed to realize multi-modal emotion recognition. Experiments are performed using two publicly available datasets (IEMOCAP and MELD), which shows that processing multi-modality data through this method can obtain good fine-grained emotion recognition results, laying a foundation for subsequent social public opinion analysis.
22
Context-Dependent Sentiment Analysis in User-Generated Videos
Soujanya Poria, Erik Cambria, Devamanyu Hazarika et al. · 2017 · 875 citations · Full text
A survey of multimodal sentiment analysis
Mohammad Soleymani, David García, Brendan Jou et al. · Image and Vision Computing · 2017 · 594 citations · Full text
Towards multimodal sentiment analysis
Louis‐Philippe Morency, Rada Mihalcea, Payal Doshi · 2011 · 455 citations