Concepedia

Multimodal Corpora

Multimodal Corpus is a systematically structured collection of naturalistic language data that integrates multiple semiotic modes—such as audio, video, gesture, and text—alongside verbal language to enable the analysis of how meaning is constructed through the interplay of diverse communicative resources.

2.1K

Publications

138.5K

Citations

7.9K

Authors

1.4K

Institutions

Publications per year

2017–2026

1.3K

Variants

Multimodal Corpus

Parents

Children

Publications

2.1K

The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English

Steven R. Livingstone, Frank Russo · PLoS ONE · 2018 · 1.8K citations · Full text

, , +17

The Routledge Handbook of Multimodal Analysis

Charles Forceville · Journal of Pragmatics · 2010 · 1.7K citations

, , +13

A Multimodal Database for Affect Recognition and Implicit Tagging

Mohammad Soleymani, Jeroen Lichtenauer, Thierry Pun et al. · IEEE Transactions on Affective Computing · 2011 · 1.6K citations

, , +17

Recent developments in openSMILE, the munich open-source multimedia feature extractor

Florian Eyben, Felix Weninger, Björn W. Schuller · 2013 · 1.2K citations · Full text

, , +16

Flamingo: a Visual Language Model for Few-Shot Learning

arXiv (Cornell University) · 2022 · 1.2K citations · Full text

, , +16

1–5 of 2.1K

Authors

7.9K

  1. BW
    Björn W. Schuller

    Imperial College London, United Kingdom

    43 publications · 5.4K citations

    24

    h-index

  2. LM
    Louis‐Philippe Morency

    Carnegie Mellon University, United States

    25 publications · 4.9K citations

    22

    h-index

  3. DG
    Daniel Gática-Pérez

    Idiap Research Institute, Switzerland

    16 publications · 751 citations

    14

    h-index

  4. LD
    Laurence Devillers

    Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur, France

    16 publications · 592 citations

    13

    h-index

  5. RM
    Rada Mihalcea

    University of Michigan, United States

    15 publications · 733 citations

    13

    h-index

1–5 of 7.9K

Institutions

1.4K

  1. Carnegie Mellon University

    Pittsburgh, United States

    35 h-index

    152 publications

    15K citations

  2. Centre National de la Recherche Scientifique

    Paris, France

    25 h-index

    142 publications

    5.1K citations

  3. Tsinghua University

    Beijing, China

    23 h-index

    95 publications

    7.9K citations

  4. Chinese Academy of Sciences

    Beijing, China

    22 h-index

    86 publications

    5.8K citations

  5. Imperial College London

    London, United Kingdom

    22 h-index

    55 publications

    7.2K citations

  6. Google (United States)

    Mountain View, United States

    21 h-index

    120 publications

    18.7K citations

  7. Massachusetts Institute of Technology

    Cambridge, United States

    21 h-index

    63 publications

    6.4K citations

  8. University of Southern California

    Los Angeles, United States

    20 h-index

    63 publications

    5K citations

1–8 of 1.4K

Venues

  1. arXiv (Cornell University)

    Repository · 181 publications · 12.6K citations

    46

    h-index

  2. IEEE Transactions on Affective Computing

    TAC · 34 publications · 6.7K citations

    28

    h-index

  3. IEEE Transactions on Multimedia

    22 publications · 1.9K citations

    20

    h-index

  4. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 25 publications · 1.2K citations

    20

    h-index

  5. IEEE Access

    24 publications · 1.7K citations

    18

    h-index

1–5