Image-based re-rendering of faces for continuous pose and illumination directions

Abstract

A scheme for photorealistic re-rendering of faces at arbitrary illumination and pose directions is presented. Our approach relies entirely on image-based rendering techniques. We utilize a scheme for re-illumination of objects based on lineal combination of low-dimensional image representations and incorporate image morphing into the image synthesis process. Important properties of our solution are simplicity and robustness. We provide experimental results to demonstrate the performance of the proposed re-rendering method on synthetic and real-world images.