2020 · 301 citations · 59 references
ComputingComputer Science3D ModelingComputer VisionMachine Learning3D ReconstructionDeep LearningFace RecognitionFacial ExpressionGeometry ProcessingSurface Reconstruction3D Face RecognitionDisplacementFace RepresentationFace Representation LearningLarge-scale Face RecognitionMorphable Shape ModelsPore Geometry
The authors introduce FaceScape, a large‑scale 3D face dataset, and develop a deep‑learning algorithm that predicts riggable, highly detailed 3D face models from a single image, with the dataset and code released publicly. FaceScape contains 18,760 textured 3D faces from 938 subjects, each with 20 expressions, featuring pore‑level geometry and uniform topology, represented as a morphable model plus displacement maps, and the algorithm learns expression‑specific dynamics via a deep neural network to generate the predictions. Unlike prior methods, the predicted models are riggable and retain fine geometry across expressions.
In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and propose a novel algorithm that is able to predict elaborate riggable 3D face models from a single image input. FaceScape dataset provides 18,760 textured 3D faces, captured from 938 subjects and each with 20 specific expressions. The 3D models contain the pore-level facial geometry that is also processed to be topologically uniformed. These fine 3D facial models can be represented as a 3D morphable model for rough shapes and displacement maps for detailed geometry. Taking advantage of the large-scale and high-accuracy dataset, a novel algorithm is further proposed to learn the expression-specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different than the previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. The unprecedented dataset and code will be released to public for research purpose.
59
Least Squares Generative Adversarial Networks
Xudong Mao, Qing Li, Haoran Xie et al. · 2017 · 5.2K citations
A morphable model for the synthesis of 3D faces
Volker Blanz, Thomas Vetter · 1999 · 4.8K citations · Full text
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu et al. · 2018 · 4.4K citations
Overview of the Face Recognition Grand Challenge
P. Jonathon Phillips, Patrick J. Flynn, Thomas E. Scruggs et al. · 2005 · 2.5K citations
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Steven M. Seitz, Brian Curless, James Diebel et al. · 2006 · 2.4K citations