Concepedia

Speech-driven Lip Motion

Speech-Driven Lip Motion is a computational modeling framework that generates realistic lip movements in synchrony with speech audio by leveraging the temporal and phonetic structure of the input speech signal to drive articulatory dynamics in a video-compatible sequence.

58

Publications

3.4K

Citations

204

Authors

97

Institutions

Publications per year

2017–2026

21

Variants

Speech-driven Lip Synchronization

Parents

Publications

58

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

Hang Zhou, Yü Liu, Ziwei Liu et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2019 · 429 citations · Full text

, , +11

Seeing speech: visual information from lip movements modifies activity in the human auditory cortex

Mikko Sams, Reijo Aulanko, Matti Hämäläinen et al. · Neuroscience Letters · 1991 · 370 citations

, , +16

Visemenet

Yang Zhou, Zhan Xu, Chris Landreth et al. · ACM Transactions on Graphics · 2018 · 227 citations · Full text

, , +16

MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement

Alexander Richard, Michael Zollhöfer, Yandong Wen et al. · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · 2021 · 203 citations

, , +15

Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips

Thomas Hueber, Elie-Laurent Benaroya, Gérard Chollet et al. · Speech Communication · 2009 · 187 citations · Full text

, , +13

1–5 of 58

Authors

204

  1. EE
    Engin Erzin

    Koç University, Türkiye

    4 publications · 170 citations

    4

    h-index

  2. EY
    Eli Yamamoto

    Nara Institute of Science and Technology, Japan

    3 publications · 157 citations

    3

    h-index

  3. KS
    Kiyohiro Shikano

    Nara Institute of Science and Technology, Japan

    3 publications · 157 citations

    3

    h-index

  4. PL
    Ping Luo

    University of Hong Kong, Hong Kong SAR China

    2 publications · 466 citations

    2

    h-index

  5. EK
    Evangelos Kalogerakis

    University of Massachusetts Amherst, United States

    2 publications · 248 citations

    2

    h-index

1–5 of 204

Institutions

97

  1. University of Toronto

    Toronto, Canada

    5 h-index

    8 publications

    754 citations

  2. Google (United States)

    Mountain View, United States

    4 h-index

    15 publications

    950 citations

  3. Koç University

    Istanbul, Türkiye

    4 h-index

    11 publications

    524 citations

  4. University of Iowa

    Iowa City, United States

    3 h-index

    4 publications

    84 citations

  5. Chinese University of Hong Kong

    Hong Kong, Hong Kong

    3 h-index

    11 publications

    2.4K citations

  6. Carnegie Mellon University

    Pittsburgh, United States

    2 h-index

    4 publications

    466 citations

  7. Trinity College Dublin

    Dublin, Ireland

    2 h-index

    4 publications

    92 citations

  8. Nara Institute of Science and Technology

    Ikoma, Japan

    2 h-index

    6 publications

    411 citations

1–8 of 97

Venues

  1. Journal of Speech Language and Hearing Research

    JSLHR · 5 publications · 266 citations

    5

    h-index

  2. Speech Communication

    3 publications · 305 citations

    3

    h-index

  3. arXiv (Cornell University)

    Repository · 3 publications · 99 citations

    3

    h-index

  4. AVSP

    2 publications · 57 citations

    2

    h-index

  5. UCL Discovery (University College London)

    Repository · 1 publications · 19 citations

    1

    h-index

1–5