FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces

Run Wang, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yihao Huang, Jian Wang, Yang Liu

arXiv (Cornell University) · 2019 · 32 citations · 45 references

DOIFull text

Open access

Concepts

TL;DR

Generative adversarial networks have enabled realistic face synthesis, raising security concerns, yet robust detectors for AI‑generated fake faces remain underdeveloped. The study introduces FakeSpotter, a method that monitors neuron activations to detect AI‑generated fake faces. FakeSpotter analyzes layer‑by‑layer neuron activation patterns to capture subtle features distinguishing real from synthetic faces. Experiments demonstrate that FakeSpotter effectively detects four GAN‑generated face types and resists four perturbation attacks, proving its robustness.

Abstract

In recent years, generative adversarial networks (GANs) and its variants have achieved unprecedented success in image synthesis. They are widely adopted in synthesizing facial images which brings potential security concerns to humans as the fakes spread and fuel the misinformation. However, robust detectors of these AI-synthesized fake faces are still in their infancy and are not ready to fully tackle this emerging challenge. In this work, we propose a novel approach, named FakeSpotter, based on monitoring neuron behaviors to spot AI-synthesized fake faces. The studies on neuron coverage and interactions have successfully shown that they can be served as testing criteria for deep learning systems, especially under the settings of being exposed to adversarial attacks. Here, we conjecture that monitoring neuron behavior can also serve as an asset in detecting fake faces since layer-by-layer neuron activation patterns may capture more subtle features that are important for the fake detector. Experimental results on detecting four types of fake faces synthesized with the state-of-the-art GANs and evading four perturbation attacks show the effectiveness and robustness of our approach.

References

45