arXiv (Cornell University) · 2018 · 79 citations · 23 references
ComputingComputer ScienceComputer SecurityMachine LearningPrivacy EngineeringData ConfidentialityData PrivacyDeep LearningDifferential PrivacyPrivacy ProtectionSecure Multi-party ComputationDifferentially Private Deep LearningDifferentially Private Machine LearningPrivacy-preserving ComputationPrivacy-preserving LearningPrivacy-preserving Machine LearningPrivacy-preserving Model TrainingPrivate Machine LearningSecure Machine Learning
Machine learning benefits from large, diverse datasets, but using them often requires a centralized aggregator, which is problematic for sensitive domains such as healthcare and finance; recent advances in secure computation, including trusted hardware enclaves and differential privacy, enable mutually distrusting parties to train models without revealing data. The study introduces Myelin, a framework that integrates privacy‑preserving primitives, to establish a baseline performance for fully private machine learning. Myelin combines trusted hardware enclaves and differential privacy to enable efficient training on private data. Using Myelin, the authors demonstrate that fully private training can achieve baseline performance comparable to non‑private models.
Machine learning models benefit from large and diverse datasets. Using such datasets, however, often requires trusting a centralized data aggregator. For sensitive applications like healthcare and finance this is undesirable as it could compromise patient privacy or divulge trade secrets. Recent advances in secure and privacy-preserving computation, including trusted hardware enclaves and differential privacy, offer a way for mutually distrusting parties to efficiently train a machine learning model without revealing the training data. In this work, we introduce Myelin, a deep learning framework which combines these privacy-preservation primitives, and use it to establish a baseline level of performance for fully private machine learning.
23
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Andrew Howard, Menglong Zhu, Bo Chen et al. · arXiv (Cornell University) · 2017 · 9.9K citations · Full text
Deep Learning with Differential Privacy
Martı́n Abadi, Andy Chu, Ian Goodfellow et al. · 2016 · 5.9K citations · Full text
Large Scale Distributed Deep Networks
Jay B. Dean, Greg S. Corrado, Rajat Monga et al. · 2012 · 2.9K citations
Briland Hitaj, Giuseppe Ateniese, Fernando Pérez‐Cruz · 2017 · 1.3K citations · Full text