Concepedia

Multimodal Emotion Recognition

Multimodal Emotion Recognition is a computational paradigm that integrates multiple heterogeneous data modalities—such as facial expressions, vocal prosody, physiological signals, and textual content—to identify and classify emotional states, distinguishing itself from unimodal approaches by leveraging complementary and synergistic information across modalities for improved recognition accuracy and robustness.

2.4K

Publications

157.8K

Citations

6.6K

Authors

1.6K

Institutions

Publications per year

2017–2026

1.6K

Variants

Multimodal Affective Recognition

Parents

Publications

2.4K

DEAP: A Database for Emotion Analysis ;Using Physiological Signals

Sander Koelstra, Christian Mühl, Mohammad Soleymani et al. · IEEE Transactions on Affective Computing · 2011 · 4.8K citations · Full text

, , +17

Emotion recognition in human-computer interaction

Roddy Cowie, Ellen Douglas‐Cowie, Nicolas Tsapatsoulis et al. · IEEE Signal Processing Magazine · 2001 · 2.6K citations · Full text

, , +17

The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English

Steven R. Livingstone, Frank Russo · PLoS ONE · 2018 · 1.8K citations · Full text

, , +17

A Multimodal Database for Affect Recognition and Implicit Tagging

Mohammad Soleymani, Jeroen Lichtenauer, Thierry Pun et al. · IEEE Transactions on Affective Computing · 2011 · 1.6K citations

, , +17

EmotionMeter: A Multimodal Framework for Recognizing Human Emotions

Wei‐Long Zheng, Wei Liu, Bao‐Liang Lu et al. · IEEE Transactions on Cybernetics · 2018 · 1.2K citations

, , +14

1–5 of 2.4K

Authors

6.6K

  1. BW
    Björn W. Schuller

    Imperial College London, United Kingdom

    82 publications · 8.2K citations

    43

    h-index

  2. JT
    Jianhua Tao

    Chinese Academy of Sciences, China

    29 publications · 1.7K citations

    24

    h-index

  3. EC
    Erik Cambria

    Nanyang Technological University, Singapore

    31 publications · 4.6K citations

    24

    h-index

  4. BL
    Bao‐Liang Lu

    Shanghai Jiao Tong University, China

    25 publications · 3.4K citations

    21

    h-index

  5. MP
    Maja Pantić

    Imperial College London, United Kingdom

    23 publications · 5.8K citations

    20

    h-index

1–5 of 6.6K

Institutions

1.6K

  1. Imperial College London

    London, United Kingdom

    39 h-index

    115 publications

    16.9K citations

  2. Chinese Academy of Sciences

    Beijing, China

    38 h-index

    141 publications

    10.4K citations

  3. University of Augsburg

    Augsburg, Germany

    30 h-index

    145 publications

    8.4K citations

  4. Nanyang Technological University

    Singapore, Singapore

    30 h-index

    85 publications

    10K citations

  5. Tsinghua University

    Beijing, China

    29 h-index

    138 publications

    7.1K citations

  6. Shanghai Jiao Tong University

    Shanghai, China

    28 h-index

    95 publications

    12K citations

  7. University of Southern California

    Los Angeles, United States

    26 h-index

    117 publications

    14.6K citations

  8. Technical University of Munich

    Munich, Germany

    26 h-index

    78 publications

    9K citations

1–8 of 1.6K

Venues

  1. IEEE Transactions on Affective Computing

    TAC · 89 publications · 15.2K citations

    50

    h-index

  2. IEEE Access

    63 publications · 3.7K citations

    34

    h-index

  3. Sensors

    48 publications · 2.7K citations

    31

    h-index

  4. Information Fusion

    35 publications · 3.9K citations

    31

    h-index

  5. Neurocomputing

    41 publications · 3K citations

    30

    h-index

1–5