Audio-driven Animation

Audio-Driven Animation is a computational framework that generates synchronized visual motion from auditory signals by translating temporal audio features into corresponding animative parameters, distinguishing itself from other animation techniques through its direct reliance on sound as the primary control modality.

Publications

4.7K

Citations

239

Authors

Institutions

Publications per year

2017–2026

Parents

Sound Integration

Publications

Audio-driven facial animation by joint end-to-end learning of pose and emotion

Tero Karras, Timo Aila, Samuli Laine et al. · ACM Transactions on Graphics · 2017 · 430 citations

Computing, Performing Arts, Computer Vision +15

Trainable videorealistic speech animation

Tony Ezzat, Gadi Geiger, Tomaso Poggio · 2002 · 306 citations · Full text

Computing, Computer Science, Computer Vision +13

SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

Wenxuan Zhang, Xiaodong Cun, Xuan Wang et al. · 2023 · 274 citations

Computing, Visualization, 3D Modeling +15

FaceFormer: Speech-Driven 3D Facial Animation with Transformers

Yingruo Fan, Zhaojiang Lin, Jun Saito et al. · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · 2022 · 225 citations

Computing, Communication, 3D Modeling +16

MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement

Alexander Richard, Michael Zollhöfer, Yandong Wen et al. · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · 2021 · 203 citations

Social Sciences, Communication, 3D Modeling +15

1–5 of 73

Authors

239

AM
A. Murat Tekalp
University of Rochester, United States
4 publications · 133 citations
4
h-index
EE
Engin Erzin
Koç University, Türkiye
4 publications · 133 citations
4
h-index
YY
Y. Yemez
Koç University, Türkiye
4 publications · 133 citations
4
h-index
JS
Jun Saito
Adobe Systems (United States), United States
3 publications · 256 citations
3
h-index
LV
L. V. Subramaniam
IBM Research - India, India
3 publications · 46 citations
3
h-index

1–5 of 239

Institutions

1–8 of 85

Venues

ACM Transactions on Graphics
TOG · 9 publications · 1.3K citations
9
h-index
IEEE Transactions on Multimedia
7 publications · 307 citations
7
h-index
Computer Animation and Virtual Worlds
3 publications · 48 citations
3
h-index
arXiv (Cornell University)
Repository · 3 publications · 66 citations
3
h-index
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Conference · 2 publications · 247 citations
2
h-index

1–5