Efficient Deep Learning on Multi-Source Private Data

Nick Hynes, Raymond Cheng, Dawn Song

arXiv (Cornell University) · 2018 · 79 citations · 23 references

DOIFull text

Open access

Concepts

TL;DR

Machine learning benefits from large, diverse datasets, but using them often requires a centralized aggregator, which is problematic for sensitive domains such as healthcare and finance; recent advances in secure computation, including trusted hardware enclaves and differential privacy, enable mutually distrusting parties to train models without revealing data. The study introduces Myelin, a framework that integrates privacy‑preserving primitives, to establish a baseline performance for fully private machine learning. Myelin combines trusted hardware enclaves and differential privacy to enable efficient training on private data. Using Myelin, the authors demonstrate that fully private training can achieve baseline performance comparable to non‑private models.

Abstract

Machine learning models benefit from large and diverse datasets. Using such datasets, however, often requires trusting a centralized data aggregator. For sensitive applications like healthcare and finance this is undesirable as it could compromise patient privacy or divulge trade secrets. Recent advances in secure and privacy-preserving computation, including trusted hardware enclaves and differential privacy, offer a way for mutually distrusting parties to efficiently train a machine learning model without revealing the training data. In this work, we introduce Myelin, a deep learning framework which combines these privacy-preservation primitives, and use it to establish a baseline level of performance for fully private machine learning.

References

23