Concepedia

Multi-modal Interaction

Multi-Modal Interaction is a human-computer interaction paradigm that integrates multiple input and output modalities—such as visual, auditory, haptic, and gestural channels—to enable more flexible, intuitive, and immersive user engagement with digital systems.

619

Publications

29.5K

Citations

2.5K

Authors

705

Institutions

Publications per year

2017–2026

265

Parents

Publications

619

DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents

Namhoon Lee, Wongun Choi, Paul Vernaza et al. · 2017 · 1.1K citations

, , +17

Multimodal human–computer interaction: A survey

Alejandro Jaimes, Nicu Sebe · Computer Vision and Image Understanding · 2007 · 958 citations

, , +11

MMGCN

Yinwei Wei, Xiang Wang, Liqiang Nie et al. · 2019 · 649 citations

, , +15

CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation With Transformers

Jiaming Zhang, Huayao Liu, Kailun Yang et al. · IEEE Transactions on Intelligent Transportation Systems · 2023 · 598 citations

, , +17

Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs

2018 · 411 citations · Full text

, , +17

1–5 of 619

Authors

2.5K

  1. SO
    Sharon Oviatt

    Oregon Health & Science University, United States

    12 publications · 786 citations

    11

    h-index

  2. PR
    Philip R. Cohen

    University of California San Diego, United States

    7 publications · 767 citations

    7

    h-index

  3. ZZ
    Zhou Zhao

    Zhejiang University, China

    6 publications · 506 citations

    6

    h-index

  4. PZ
    Pan Zhou

    Huazhong University of Science and Technology, China

    5 publications · 237 citations

    5

    h-index

  5. LN
    Laurence Nigay

    Université Grenoble Alpes, France

    5 publications · 447 citations

    5

    h-index

1–5 of 2.5K

Institutions

705

  1. Carnegie Mellon University

    Pittsburgh, United States

    13 h-index

    34 publications

    1.5K citations

  2. Chinese Academy of Sciences

    Beijing, China

    11 h-index

    37 publications

    1.8K citations

  3. University of Chinese Academy of Sciences

    Beijing, China

    11 h-index

    30 publications

    1.6K citations

  4. Centre National de la Recherche Scientifique

    Paris, France

    10 h-index

    21 publications

    562 citations

  5. Georgia Institute of Technology

    Atlanta, United States

    9 h-index

    32 publications

    1.2K citations

  6. Zhejiang University

    Hangzhou, China

    9 h-index

    40 publications

    3.1K citations

  7. Microsoft (United States)

    Redmond, United States

    8 h-index

    16 publications

    696 citations

  8. Fudan University

    Shanghai, China

    8 h-index

    26 publications

    2.6K citations

1–8 of 705

Venues

  1. arXiv (Cornell University)

    Repository · 26 publications · 1.2K citations

    16

    h-index

  2. IEEE Transactions on Multimedia

    7 publications · 335 citations

    7

    h-index

  3. 6

    h-index

  4. Journal on Multimodal User Interfaces

    6 publications · 131 citations

    6

    h-index

  5. Sensors

    6 publications · 149 citations

    6

    h-index

1–5