IEEE Transactions on Biometrics Behavior and Identity Science · 2021 · 49 citations · 42 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningFace RecognitionFeature DetectionObject DetectionPattern RecognitionRepresentation LearningSelf-supervised LearningDropoutDropout ModelingFace Feature ExtractionFace ManipulationFace Manipulation DetectionJoint Representation LearningNeural Network ClassificationRegularization
Over the past several years, to solve the problem of malicious abuse of facial manipulation technology, face manipulation detection has obtained considerable attention. Although existing works achieved impressive performance on a hold-out test set, their methods suffered a significant performance drop on data from a different distribution than the training set used. In this paper, we conduct an in-depth analysis on existing typical models about poor generalization capability and propose a novel method for face manipulation detection, which can alleviate overfitting and improve the generalization ability by learning forgery region aware and ID-independent features. Specifically, a forgery region guided self-attention module (FR) is introduced to make the model focus on the forgery region and a landmark guided dropout module (LM) is designed to randomly remove features of structured informative regions for destroying identity features. These two regularization modules are then added to the basic classification network, e.g., Xception. With the help of the joint learning framework, both forgery region-aware and ID-independent features are learned for face manipulation detection with better generalization ability. Extensive experiments demonstrate that the proposed method can not only outperform competing state-of-the-art methods on the FaceForensics++ dataset but also achieve superior generalization performance on the Celeb-DF dataset.
42
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
SciPy 1.0: fundamental algorithms for scientific computing in Python
Nature Methods · 2020 · 37.9K citations · Full text
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das et al. · 2017 · 21.6K citations
Xception: Deep Learning with Depthwise Separable Convolutions
François Chollet · 2017 · 19K citations