Automatic reconstruction of personalized avatars from 3D face scans

Michael Zollhöfer, Michael Martinek, Günther Greiner, Marc Stamminger, Jochen Süßmuth

Computer Animation and Virtual Worlds · 2011 · 111 citations · 9 references

DOIFull text

Open access

Concepts

TL;DR

Low‑cost hardware makes home 3D face scanning feasible, enabling applications such as facial animation and manipulation. The study presents a simple algorithm to compute a high‑quality personalized avatar from a single color image and depth map captured by a Microsoft Kinect. The algorithm integrates robust non‑rigid registration with morphable face model fitting. The algorithm yields high‑quality facial geometry and texture reconstructions with one‑to‑one correspondences, demonstrates robustness, and requires no user interaction, enabling non‑experts to create personalized avatars. © 2011 John Wiley & Sons, Ltd.

Abstract

Abstract We present a simple algorithm for computing a high‐quality personalized avatar from a single color image and the corresponding depth map which have been captured by Microsoft's Kinect sensor. Due to the low market price of our hardware setup, 3D face scanning becomes feasible for home use. The proposed algorithm combines the advantages of robust non‐rigid registration and fitting of a morphable face model. We obtain a high‐quality reconstruction of the facial geometry and texture along with one‐to‐one correspondences with our generic face model. This representation allows for a wide range of further applications such as facial animation or manipulation. Our algorithm has proven to be very robust. Since it does not require any user interaction, even non‐expert users can easily create their own personalized avatars. Copyright © 2011 John Wiley & Sons, Ltd.

References

9