2017 · 15 citations · 19 references
ComputingComputer EngineeringComputer ScienceAlgorithmsDistributed SystemsInformation TheoryDistributed AlgorithmsDistributed ComputingDistributed Data ProcessingPercolation TheoryData PlacementDistributed Computation ModelsDistributed Function Computation
In wireless distributed computing, networked nodes perform intermediate computations over data placed in their memory and exchange these intermediate values to calculate function values. In this paper we consider an asymmetric setting where each node has access to a random subset of the data, i.e., we cannot control the data placement. The paper makes a simple point: we can realize significant benefits if we are allowed to be “flexible”, and decide which node computes which function, in our system. We make this argument in the case where each function depends on only two of the data messages, as is the case in similarity searches. We establish a percolation in the behaviour of the system, where, depending on the amount of observed data, by being flexible, we may need no communication at all.
19
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Shuo Li, Raymond W. Yeung, Ning Cai · IEEE Transactions on Information Theory · 2003 · 3.5K citations
Mohammad Ali Maddah-Ali, Urs Niesen · IEEE Transactions on Information Theory · 2014 · 1.8K citations
Speeding Up Distributed Machine Learning Using Codes
Kangwook Lee, Maximilian Lam, Ramtin Pedarsani et al. · IEEE Transactions on Information Theory · 2017 · 866 citations · Full text
Managing data transfers in computer clusters with orchestra
Mosharaf Chowdhury, Matei Zaharia, Justin Ma et al. · 2011 · 559 citations