2021 · 14 citations · 16 references
ComputingComputer ScienceComputer VisionMachine LearningPrivacy EngineeringData PrivacyData ProtectionDeep LearningDifferential PrivacyGenerative ModelingNeural NetworksClassification AccuracyDifferentially Private Deep LearningDifferentially Private Machine LearningDifferentially Private Stochastic Gradient DescentGenerative Adversarial NetworksPrivacy-preserving LearningPrivacy-preserving Machine LearningStochastic Gradient Descent
To protect sensitive data in training a Generative Adversarial Network (GAN), the standard approach is to use differentially private (DP) stochastic gradient descent method in which controlled noise is added to the gradients. The quality of the output synthetic samples can be adversely affected and the training of the network may not even converge in the presence of these noises. We propose Differentially Private Model Inversion (DPMI) method where the private data is first mapped to the latent space via a public generator, followed by a lower-dimensional DP-GAN with better convergent properties. Experimental results on standard datasets CIFAR10 and SVHN as well as on a facial landmark dataset for Autism screening show that our approach outperforms the standard DP-GAN method based on Inception Score, Frechet Inception Distance, and classification accuracy under the same privacy guarantee.
16
Deep Learning with Differential Privacy
Martı́n Abadi, Andy Chu, Ian Goodfellow et al. · 2016 · 5.9K citations · Full text
Reading digits in natural images with unsupervised feature learning
Yuval Netzer · 2024 · 4.6K citations · Full text
Membership Inference Attacks Against Machine Learning Models
Reza Shokri, Marco Stronati, Congzheng Song et al. · 2017 · 4.2K citations