Concepedia

Multimodal Input Processing

Multimodal Input Processing is a cognitive and computational framework that integrates and interprets linguistic and non-linguistic input from multiple sensory modalities—such as visual, auditory, and textual sources—during real-time comprehension tasks, particularly in sight translation, by coordinating modality-specific representations into a unified mental representation to facilitate meaning construction.

210

Publications

16.4K

Citations

725

Authors

306

Institutions

Publications per year

2017–2026

84

Parents

Publications

210

Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations

Wolfgang Maass, Thomas Natschläger, Henry Markram · Neural Computation · 2002 · 4K citations · Full text

, , +16

Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey

James W. Lewis, David C. Van Essen · The Journal of Comparative Neurology · 2000 · 845 citations

, , +17

Integrating Multimodal Information in Large Pretrained Transformers

Wasifur Rahman, Md. Kamrul Hasan, Sangwu Lee et al. · 2020 · 604 citations · Full text

, , +16

Embodiment in conversational interfaces

Justine Cassell, Timothy Bickmore, Mark Billinghurst et al. · 1999 · 561 citations

, , +17

Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions

Nick E. Barraclough, Dengke Xiao, Chris I. Baker et al. · Journal of Cognitive Neuroscience · 2005 · 333 citations

, , +17

1–5 of 210

Authors

725

  1. SO
    Sharon Oviatt

    Oregon Health & Science University, United States

    10 publications · 787 citations

    10

    h-index

  2. MB
    Mark Billinghurst

    University of Canterbury, New Zealand

    4 publications · 653 citations

    4

    h-index

  3. LT
    Louis ten Bosch

    Radboud University Nijmegen, Netherlands

    3 publications · 49 citations

    3

    h-index

  4. FF
    Fernando Ferri

    Institute for Research on Population and Social Policies, Italy

    3 publications · 45 citations

    3

    h-index

  5. SK
    Stefan Kopp

    Bielefeld University, Germany

    3 publications · 112 citations

    3

    h-index

1–5 of 725

Institutions

306

  1. University College London

    London, United Kingdom

    8 h-index

    15 publications

    815 citations

  2. Oregon Health & Science University

    Portland, United States

    8 h-index

    17 publications

    1.3K citations

  3. Bielefeld University

    Bielefeld, Germany

    7 h-index

    17 publications

    550 citations

  4. Radboud University Nijmegen

    Nijmegen, The Netherlands

    6 h-index

    7 publications

    194 citations

  5. Massachusetts Institute of Technology

    Cambridge, United States

    4 h-index

    4 publications

    516 citations

  6. Centre National de la Recherche Scientifique

    Paris, France

    4 h-index

    5 publications

    169 citations

  7. Max Planck Institute for Psycholinguistics

    Nijmegen, The Netherlands

    4 h-index

    6 publications

    211 citations

  8. Google (United States)

    Mountain View, United States

    4 h-index

    10 publications

    534 citations

1–8 of 306

Venues

  1. arXiv (Cornell University)

    Repository · 11 publications · 510 citations

    10

    h-index

  2. PLoS ONE

    4 publications · 159 citations

    4

    h-index

  3. PubMed

    Repository · 4 publications · 72 citations

    4

    h-index

  4. Neuropsychologia

    3 publications · 129 citations

    3

    h-index

  5. Journal of Memory and Language

    3 publications · 91 citations

    3

    h-index

1–5