IEEE Transactions on Knowledge and Data Engineering · 2009 · 71 citations · 22 references
ComputingComputer ScienceAlgorithmsData MiningMachine LearningData PrivacyData ProtectionData SecurityPrivacy-preserving AnalyticsPrivacy-preserving ProtocolsScalable Machine LearningGradient DescentPrivacy PreservationPrivacy-preserving ComputationPrivacy-preserving LearningPrivacy-preserving Machine LearningPrivate OptimizationSecure Machine LearningSecure Protocol Design
Gradient descent is a widely used paradigm for solving many optimization problems. Gradient descent aims to minimize a target function in order to reach a local minimum. In machine learning or data mining, this function corresponds to a decision model that is to be discovered. In this paper, we propose a preliminary formulation of gradient descent with data privacy preservation. We present two approaches-stochastic approach and least square approach-under different assumptions. Four protocols are proposed for the two approaches incorporating various secure building blocks for both horizontally and vertically partitioned data. We conduct experiments to evaluate the scalability of the proposed secure building blocks and the accuracy and efficiency of the protocols for four different scenarios. The excremental results show that the proposed secure building blocks are reasonably scalable and the proposed protocols allow us to determine a better secure protocol for the applications for each scenario.
22
Introduction to the theory of neural computation
Neural Networks · 1994 · 6.5K citations
How to generate and exchange secrets
Andrew Chi-Chih Yao · 1986 · 3.7K citations
Learning to rank using gradient descent
Chris Burges, Tal Shaked, Erin Renshaw et al. · 2005 · 2.8K citations
Linear Algebra and Its Applications
E. I., Gilbert Strang · Mathematics of Computation · 1976 · 1.9K citations
<i>Introduction to the Theory of Neural Computation</i>
John Hertz, Anders Krogh, R. G. Palmer et al. · Physics Today · 1991 · 1.1K citations