2011 · 78 citations · 10 references
Distributed File SystemCluster ComputingEngineeringEfficient FamilyStorage ManagementDress CodesHardware SecurityPlace Multiple ReplicasData ManagementComputer EngineeringData PrivacyDistributed SystemsComputer ScienceData ReplicationData SecurityCryptographyEdge ComputingCloud ComputingLinear Network CodingStorage SecurityDistributed Data StoreDistributed Transaction
We introduce an efficient family of exact regenerating codes for data storage in large-scale distributed systems. We refer to these new codes as Distributed Replication-based Exact Simple Storage (DRESS) codes. A key property of DRESS codes is their very efficient distributed and uncoded repair and growth processes that have minimum bandwidth, reads and computational overheads. This property is essential for large-scale systems with high reliability and availability requirements. DRESS codes will first encode the file using a Maximum Distance Separable (MDS) code, then place multiple replicas of the coded packets on different nodes in the system. We propose a simple and flexible randomized scheme for placing those replicas based on the balls-and-bins model. Our construction showcases the power of the probabilistic approach in constructing regenerating codes that can be efficiently repaired and grown.
10
Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung · ACM SIGOPS Operating Systems Review · 2003 · 5K citations
Giuseppe DeCandia, Deniz Hastorun, Madan Jampani et al. · 2007 · 3.4K citations
Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung · 2003 · 1.3K citations