2018 · 149 citations · 44 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningFace RecognitionFacial ExpressionExpression InvarianceFacial AnimationFacial Expression AnimationFacial Expression SynthesisGenerative Adversarial NetworksTexture Synthesis
Facial expression synthesis has drawn much attention in the field of computer graphics and pattern recognition. It has been widely used in face animation and recognition. However, it is still challenging due to the high-level semantic presence of large and non-linear face geometry variations. This paper proposes a Geometry-Guided Generative Adversarial Network (G2-GAN) for continuously-adjusting and identity-preserving facial expression synthesis. We employ facial geometry (fiducial points) as a controllable condition to guide facial texture synthesis with specific expression. A pair of generative adversarial subnetworks is jointly trained towards opposite tasks: expression removal and expression synthesis. The paired networks form a mapping cycle between neutral expression and arbitrary expressions, with which the proposed approach can be conducted among unpaired data. The proposed paired networks also facilitate other applications such as face transfer, expression interpolation and expression-invariant face recognition. Experimental results on several facial expression databases show that our method can generate compelling perceptual results on different expression editing tasks.
44
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, Taesung Park, Phillip Isola et al. · 2017 · 21.9K citations · Full text
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Christian Ledig, Lucas Theis, Ferenc Huszár et al. · 2017 · 12.3K citations
Conditional Generative Adversarial Nets
Mehdi Mirza, Simon Osindero · arXiv (Cornell University) · 2014 · 8.9K citations · Full text
Omkar Parkhi, Andrea Vedaldi, Andrew Zisserman · 2015 · 5.1K citations · Full text