IEEE Transactions on Information Forensics and Security · 2024 · 36 citations · 31 references
ComputingComputer EngineeringComputer ScienceAuthenticationComputer SecurityCryptographyEmbedded SecurityFace RecognitionAdversarial LossAdversarial RobustnessDigital WatermarkingImage WatermarkingRobust WatermarkingWatermark EmbeddingWatermark RobustnessWatermarking
Malicious applications of deep face swapping technology pose security threats such as misinformation dissemination and identity fraud. Some research propose the utilization of robust watermarking methods to track the copyright of facial images, facilitating post-forgery identity attribution. However, these methods cannot fundamentally prevent or eliminate the adverse impacts of face swapping. To address this issue, we present Dual Defense, an innovative framework based on robust adversarial watermarking. It simultaneously tracks image copyrights and disrupts the face swapping model by one-time embedding the robust adversarial watermark. Specifically, we propose an Original-domain Feature Emulation Attack (OFEA) method, which makes the traceable watermark adversarial through specially designed original domain adversarial loss. Additionally, we conduct a wavelet domain image structural information compensation loss, combined with a channel attention mechanism, to jointly balance watermark invisibility, adversariality, and traceability. Furthermore, we design a more comprehensive and rational evaluation method to thoroughly assess the effectiveness of adversarial attacks against face swapping models. Extensive experiments demonstrate that Dual Defense exhibits exceptional cross-task generality and dataset generalization. It maintains impressive adversariality and traceability in both original and robust settings, surpassing current forgery defense methods that possess only one of these capabilities.
31
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
FaceNet: A unified embedding for face recognition and clustering
2015 · 11.2K citations · Full text
VGGFace2: A Dataset for Recognising Faces across Pose and Age
Qiong Cao, Li Shen, Weidi Xie et al. · 2018 · 2.9K citations