Concepedia

Speech-to-video Alignment

Speech-to-Video Alignment is a computational framework that establishes temporal correspondence between spoken speech signals and the visual articulatory movements in video sequences, specifically by synchronizing phonetic content in audio with the attendant lip motions in facial video.

57

Publications

3.1K

Citations

225

Authors

80

Institutions

Publications per year

2017–2026

30

Parents

Publications

57

A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild

K R Prajwal, Rudrabha Mukhopadhyay, Vinay P. Namboodiri et al. · 2020 · 801 citations · Full text

, , +13

Video face replacement

Kevin Dale, Kalyan Sunkavalli, Micah K. Johnson et al. · 2011 · 175 citations · Full text

, , +16

VDub: Modifying Face Video of Actors for Plausible Visual Alignment to a Dubbed Audio Track

Pablo Garrido, Levi Valgaerts, Hamid Sarmadi et al. · Computer Graphics Forum · 2015 · 132 citations

, , +12

Towards Automatic Face-to-Face Translation

2019 · 128 citations · Full text

, , +14

Video face replacement

Kevin Dale, Kalyan Sunkavalli, Micah K. Johnson et al. · ACM Transactions on Graphics · 2011 · 123 citations

, , +16

1–5 of 57

Authors

225

  1. HP
    Hanspeter Pfister

    Harvard University Press, United States

    3 publications · 319 citations

    3

    h-index

  2. KS
    Kalyan Sunkavalli

    Adobe Systems (United States), United States

    3 publications · 319 citations

    3

    h-index

  3. MK
    Micah K. Johnson

    Massachusetts Institute of Technology, United States

    3 publications · 319 citations

    3

    h-index

  4. WM
    Wojciech Matusik

    Massachusetts Institute of Technology, United States

    3 publications · 319 citations

    3

    h-index

  5. DV
    Daniel Vlasic

    Massachusetts Institute of Technology, United States

    3 publications · 319 citations

    3

    h-index

1–5 of 225

Institutions

80

  1. Shanghai Jiao Tong University

    Shanghai, China

    4 h-index

    7 publications

    195 citations

  2. Walt Disney (United States)

    Burbank, United States

    4 h-index

    6 publications

    355 citations

  3. Aratos Technologies (Greece)

    Pátrai, Greece

    3 h-index

    3 publications

    319 citations

  4. Zhejiang University

    Hangzhou, China

    3 h-index

    10 publications

    376 citations

  5. Harvard University Press

    Cambridge, United States

    3 h-index

    9 publications

    957 citations

  6. Stevens Institute of Technology

    Hoboken, United States

    2 h-index

    2 publications

    108 citations

  7. Tsinghua University

    Beijing, China

    2 h-index

    7 publications

    119 citations

  8. University of Electronic Science and Technology of China

    Chengdu, China

    2 h-index

    2 publications

    136 citations

1–8 of 80

Venues

  1. IEEE Transactions on Multimedia

    2 publications · 50 citations

    2

    h-index

  2. 2

    h-index

  3. Pattern Recognition

    2 publications · 147 citations

    2

    h-index

  4. arXiv (Cornell University)

    Repository · 2 publications · 43 citations

    2

    h-index

  5. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 2 publications · 180 citations

    2

    h-index

1–5