Human Facial Expression Recognition using a 3D Morphable Model

TLDR

The study proposes a novel approach to detect and classify human facial expressions using a morphable 3D model. The method captures textured 3D meshes with a face scanner, constructs a morphable expression model by establishing correspondence among emotive faces, and derives morphing parameters for emotion recognition. Results show that distinct facial expressions form separate clusters in the expression space.

Abstract

We propose a novel approach to the detection and classification of human facial expressions using a morphable 3D model. We acquire the various expressions of an individual using a face scanner that produces textured 3D meshes using stereoscopic reconstruction. A morphable expression model (MEM), that incorporates emotion-dependent face variations in terms of morphing parameters, is then computed by establishing correspondence among the emotive faces. These morphing parameters are used for emotion recognition and classification. We demonstrate that the different facial expressions correspond to distinct clusters in the expression space.