2010 · 26 citations · 22 references
EngineeringError Control TechniqueSoftware AnalysisFormal VerificationHardware SecurityDistributed Source CodingError CorrectionVariable-length CodeAlgebraic Coding TheoryComputer EngineeringComputer ScienceError Correction CodeData SecurityCryptographyErasure CorrectionErasure ModelsFormal MethodsStorage SystemErasure Channel
The problem of designing codes to protect against server failures in a distributed storage system for frequently changing data is considered. When the original data changes, the coded packets stored on the servers must be updated accordingly. Since performing updates consumes costly bandwidth and energy, it is of interest to construct codes that have small update complexity, which we define as the maximum number of coded symbols that must be updated when any single information symbol is changed. Linear codes which are conventionally used or recently proposed for use in storage systems for correcting a linear number of erasures (such as Reed-Solomon and other MDS codes) have the update complexity which scales linearly with the code length. In this paper, we take advantage of randomization to construct update-efficient codes that have update complexity scaling sub-linearly with the code length. Two erasure models are examined: random erasures (i.e., the erasure channel) and adversarial erasures.
22
Michael Luby · 2003 · 2.7K citations
X-code: MDS array codes with optimal encoding
Lihao Xu, Jehoshua Bruck · IEEE Transactions on Information Theory · 1999 · 400 citations
Network Coding for Distributed Storage Systems
Alexandros G. Dimakis, P. Brighten Godfrey, Martin J. Wainwright et al. · 2007 · 388 citations · Full text
Distributed File System, Cluster Computing, Availability +19