Image-based photorealistic 3-D face modeling

Abstract

In this paper, we describe an automatic system for 3-D photorealistic face modeling from frontal and profile images taken by an uncalibrated handheld digital camera. The system employs a generic model adaptation framework. That is, after the fiducial features are detected from both images, a generic head model is deformed to match with the detected features. Realistic texture is created by combining the augmented facial textures from input images and synthesized texture, and mapped onto the deformed generic head model. Our shape deformation and texture generation algorithms have several advantages: (1) they generate photorealistic models even when the orthogonal assumption of input image pairs is not satisfied; (2) the generated ear has very accurate smooth shape and improves the quality of the whole face model dramatically; (3) a few supportive techniques on texture processing are employed to improve the visual quality.