IEEE Journal on Selected Areas in Communications · 2014 · 33 citations · 22 references
ComputingComputer ScienceMathematicsDistributed SystemsFault-tolerant ComputingFault-tolerant SystemsCoding TheoryData RedundancyErasure CodingError Control CodingError DetectionError-correcting CodesCodes Over Finite FieldsFountain CodesMds CodesParity-check MatricesRandom GraphsRandom MatricesRegenerating CodesSparse Random Graphs
We introduce a new family of Fountain codes that are systematic and also have sparse parities. Given an input of k symbols, our codes produce an unbounded number of output symbols, generating each parity independently by linearly combining a logarithmic number of randomly selected input symbols. The construction guarantees that for any ε>0 accessing a random subset of (1+ε)k encoded symbols, asymptotically suffices to recover the k input symbols with high probability. Our codes have the additional benefit of logarithmic locality: a single lost symbol can be repaired by accessing a subset of O(log k) of the remaining encoded symbols. This is a desired property for distributed storage systems where symbols are spread over a network of storage nodes. Beyond recovery upon loss, local reconstruction provides an efficient alternative for reading symbols that cannot be accessed directly. In our code, a logarithmic number of disjoint local groups is associated with each systematic symbol, allowing multiple parallel reads. Our main mathematical contribution involves analyzing the rank of sparse random matrices with specific structure over finite fields. We rely on establishing that a new family of sparse random bipartite graphs have perfect matchings with high probability.
22
Amin Shokrollahi · IEEE Transactions on Information Theory · 2006 · 2.1K citations · Full text
Network Coding for Distributed Storage Systems
Alexandros G. Dimakis, P. Brighten Godfrey, Yunnan Wu et al. · IEEE Transactions on Information Theory · 2010 · 2K citations
Luiz André Barroso · Communications of the ACM · 2013 · 1.7K citations
A digital fountain approach to reliable distribution of bulk data
John W. Byers, Michael Luby, Michael Mitzenmacher et al. · 1998 · 1.2K citations