2013 · 83 citations · 29 references
ComputingComputer ScienceComputer VisionNatural Language ProcessingNonverbal CommunicationFacial ExpressionMultimodal InteractionSpeech InteractionSpeech RecognitionSpeech SynthesisReconstruction Error AnalysisText-to-speech Synthesis
This paper presents a complete system for expressive visual text-to-speech (VTTS), which is capable of producing expressive output, in the form of a 'talking head', given an input text and a set of continuous expression weights. The face is modeled using an active appearance model (AAM), and several extensions are proposed which make it more applicable to the task of VTTS. The model allows for normalization with respect to both pose and blink state which significantly reduces artifacts in the resulting synthesized sequences. We demonstrate quantitative improvements in terms of reconstruction error over a million frames, as well as in large-scale user studies, comparing the output of different systems.
29
A morphable model for the synthesis of 3D faces
Volker Blanz, Thomas Vetter · 1999 · 4.8K citations · Full text
High resolution passive facial performance capture
Derek Bradley, Wolfgang Heidrich, Tiberiu Popa et al. · ACM Transactions on Graphics · 2010 · 235 citations