Data-Driven Deepfake Forensics Model Based on Large-Scale Frequency and Noise Features

Abstract

With the rapid development of deep learning and communication technology, the application of streaming media services and social software have gone deep into life. However, in the face of many uncertain factors in data dissemination, protecting privacy and security is particularly important. In order to solve the above problems, this study proposes a deep face forgery forensics method with frequency domain and noise features. In this method, DCT (i.e. Discrete Cosine Transform) transform is proposed to perceive the forgery trace features of different frequency bands in the frequency domain. At the same time, the spatial rich model (SRM) is used for guidance to enhance the traces of forged noise. Then, large-scale network and single center loss function are introduced to improve the forensics ability of the model. Experimental results on several databases such as faceforensics++, celeb DF and DFDC show that this method can effectively improve the accuracy of forensics.