Multiple Models Fusion for Multi-label Classification in Speech Emotion Recognition Systems

Anwer Slimi, Nafaa Hafar, Mounir Zrigui, Henri Nicolas

Procedia Computer Science · 2022 · 13 citations · 8 references

DOIFull text

Open access

Concepts

Abstract

Emotions are the base to comprehend speech and respond to each other. However, interpreting emotions is not a simple process even for people, not to mention machines. Based on a ground truth investigation that we have done on the RML (Ryerson Multimedia Lab) dataset, we have found that the same emotional speech might be interpreted differently by a number of individuals despite it has only one label. In this study we provide a fresh perspective to the speech emotion recognition field where a system may identify the presence of one or more potential emotions per utterance. Giving the computer the potential of identifying numerous categories at the same time, will allow it to assess different scenarios when making a decision. In this paper, we introduce a robust Speech Emotion Recognition (SER) system for multi-label classification. The model was tested on the RML and it achieved 83.88% which outperforms state-of-the-art methods.

References

8