2019 · 199 citations · 36 references
ComputingComputer ScienceData ScienceDistributed SystemsMachine LearningPrivacy EngineeringData PrivacyData ProtectionDifferential PrivacyFederated LearningPrivacy ProtectionPrivacy-preserving AnalyticsDifferentially Private Machine LearningMedical Image ClassificationPrivacyPrivacy Budget AccountingPrivacy Budget AllocationPrivacy Budget ManagementPrivacy LossPrivacy-preserving Learning
The study aims to strengthen federated learning with formal privacy guarantees by applying Bayesian differential privacy to achieve sharper privacy loss bounds. The authors adapt Bayesian privacy accounting to the federated setting and propose multiple improvements for efficient privacy budgeting at client and instance levels. Experiments on image classification, including a medical task, show that the approach attains tighter privacy budgets (ε < 1 per client, ε < 0.1 per instance), improves model accuracy, and reduces communication rounds compared to state‑of‑the‑art differential privacy methods.
We consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy loss bounds. We adapt the Bayesian privacy accounting method to the federated setting and suggest multiple improvements for more efficient privacy budgeting at different levels. Our experiments show significant advantage over the state-of-the-art differential privacy bounds for federated learning on image classification tasks, including a medical application, bringing the privacy budget below ε = 1 at the client level, and below ε = 0.1 at the instance level. Lower amounts of noise also benefit the model accuracy and reduce the number of communication rounds.
36
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Deep Learning with Differential Privacy
Martı́n Abadi, Andy Chu, Ian Goodfellow et al. · 2016 · 5.9K citations · Full text
Communication-Efficient Learning of Deep Networks from Decentralized Data
H. Brendan McMahan, Eider Moore, Daniel Ramage et al. · arXiv (Cornell University) · 2016 · 5.2K citations · Full text