2021 · 46 citations · 23 references
ComputingComputer ScienceCybersecurityComputer VisionMachine LearningMachine VisionDeep LearningFace RecognitionFrame-based RepresentationObject DetectionPattern RecognitionVideo AnalysisDeepfake DetectionFrame DetectionFramesRobust DetectionVideo-based Misinformation Detection
The spread of DeepFake videos causes a serious threat to information security, calling for effective detection methods to distinguish them. However, the performance of recent frame-based detection methods become limited due to their ignorance of the inter-frame inconsistency of fake videos. In this paper, we propose a novel Dynamic Inconsistency-aware Network to handle the inconsistent problem, which uses a Cross-Reference module (CRM) to capture both the global and local inter-frame inconsistencies. The CRM contains two parallel branches. The first branch takes faces from adjacent frames as input, and calculates a structure similarity map for a global inconsistency representation. The second branch only focuses on the inter-frame variation of independent critical regions, which captures the local inconsistency. To the best of our knowledge, this is the first work to totally use the inter-frame inconsistency information from the global and local perspectives. Compared with existing methods, our model provides a more accurate and robust detection on FaceForensics++, DFDC-preview and Celeb-DFv2 datasets.
23
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Xception: Deep Learning with Depthwise Separable Convolutions
François Chollet · 2017 · 19K citations
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Justus Thies, Michael Zollhöfer, Marc Stamminger et al. · 2016 · 1.8K citations
MesoNet: a Compact Facial Video Forgery Detection Network
Darius Afchar, Vincent Nozick, Junichi Yamagishi et al. · 2018 · 1.7K citations · Full text