3D Morphable Model fitting from multiple views

Abstract

This paper presents a method to fit a 3D Morphable Model to a sequence of extracted facial features. The approach is a direct extension of a single view method. The novelty is presented as a new mathematical derivation of the same method but for multiple views where identity and pose are known. The new fitting method exploits point-to-model correspondences and can deal with occlusion since features are not required to correspond across views. The mathematics is explained in detail and the methods single tunable parameter is empirically determined using a database of scanned heads.