arXiv (Cornell University) · 2019 · 32 citations · 45 references
ComputingComputer ScienceArtificial IntelligenceComputer VisionMachine LearningDeep LearningFace RecognitionGenerative ModelingNeural NetworksPattern RecognitionRepresentation LearningDetectorsGenerative Adversarial Networks
Generative adversarial networks have enabled realistic face synthesis, raising security concerns, yet robust detectors for AI‑generated fake faces remain underdeveloped. The study introduces FakeSpotter, a method that monitors neuron activations to detect AI‑generated fake faces. FakeSpotter analyzes layer‑by‑layer neuron activation patterns to capture subtle features distinguishing real from synthetic faces. Experiments demonstrate that FakeSpotter effectively detects four GAN‑generated face types and resists four perturbation attacks, proving its robustness.
In recent years, generative adversarial networks (GANs) and its variants have achieved unprecedented success in image synthesis. They are widely adopted in synthesizing facial images which brings potential security concerns to humans as the fakes spread and fuel the misinformation. However, robust detectors of these AI-synthesized fake faces are still in their infancy and are not ready to fully tackle this emerging challenge. In this work, we propose a novel approach, named FakeSpotter, based on monitoring neuron behaviors to spot AI-synthesized fake faces. The studies on neuron coverage and interactions have successfully shown that they can be served as testing criteria for deep learning systems, especially under the settings of being exposed to adversarial attacks. Here, we conjecture that monitoring neuron behavior can also serve as an asset in detecting fake faces since layer-by-layer neuron activation patterns may capture more subtle features that are important for the fake detector. Experimental results on detecting four types of fake faces synthesized with the state-of-the-art GANs and evading four perturbation attacks show the effectiveness and robustness of our approach.
45
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, Taesung Park, Phillip Isola et al. · 2017 · 21.9K citations · Full text
Xception: Deep Learning with Depthwise Separable Convolutions
François Chollet · 2017 · 19K citations
Deep Learning Face Attributes in the Wild
Ziwei Liu, Ping Luo, Xiaogang Wang et al. · 2015 · 7.7K citations