Multimodal Interaction

Multimodal Interaction is a type of human-computer interaction that integrates multiple modalities—such as speech, gesture, gaze, and touch—within a unified interface to enable more natural, flexible, and robust communication between humans and interactive systems.

19.1K

Publications

Citations

46.2K

Authors

Institutions

Publications per year

2017–2026

7.6K

Variants

Multimodal Human-computer Interaction

Parents

Human-computer InteractionHuman-robot InteractionInteraction DesignInteractive DesignInteractive Design Systems

Children

Adaptive Multimodal InterfacesAffective Multimodal InteractionAudio InteractionCo-speech GestureCollaborative Multimodal InteractionContext-aware InteractionCross-modal InteractionsGaze-driven InteractionHaptic FeedbackHuman Multimodal Interaction

Publications

19.1K

Moses

Philipp Koehn, Richard Zens, Chris Dyer et al. · 2007 · 4.9K citations · Full text

Social Sciences, Communication, Design +16

Multimodal Machine Learning: A Survey and Taxonomy

Tadas Baltrušaitis, Chaitanya Ahuja, Louis‐Philippe Morency · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2018 · 4.2K citations

Computing, Computer Science, Computer Vision +13

Tangible bits

Hiroshi Ishii, Brygg Ullmer · 1997 · 3.8K citations

Arts, Computer Science, Media Arts +17

IEMOCAP: interactive emotional dyadic motion capture database

Carlos Busso, Murtaza Bulut, Chi-Chun Lee et al. · Language Resources and Evaluation · 2008 · 3.6K citations

Computing, Psychology, Human Behavior +7

Multimodal Discourse: The Modes and Media of Contemporary Communication

Lester Faigley, Günther Kress, Theo van Leeuwen · College Composition and Communication · 2002 · 3.4K citations

Social Sciences, Communication, Communication Theory +12

1–5 of 19.1K

Authors

46.2K

LM
Louis‐Philippe Morency
Carnegie Mellon University, United States
82 publications · 14K citations
42
h-index
SO
Sharon Oviatt
Oregon Health & Science University, United States
70 publications · 6.8K citations
39
h-index
SB
Stephen Brewster
University of Glasgow, United Kingdom
82 publications · 5.1K citations
39
h-index
MB
Mark Billinghurst
University of Canterbury, New Zealand
70 publications · 3.8K citations
34
h-index
AB
Andreas Bulling
Max Planck Institute for Informatics, Germany
50 publications · 4.3K citations
33
h-index

1–5 of 46.2K

Institutions

1–8 of 5K

Venues

arXiv (Cornell University)
Repository · 489 publications · 25.5K citations
74
h-index
IEEE Transactions on Multimedia
178 publications · 10.8K citations
57
h-index
Information Fusion
92 publications · 8.3K citations
50
h-index
IEEE Access
168 publications · 9.3K citations
47
h-index
IEEE Transactions on Affective Computing
TAC · 88 publications · 7.6K citations
46
h-index

1–5