2017 · 28 citations · 23 references
ComputingComputer ScienceComputer SystemsCluster ComputingFault-tolerant ComputingStorage SystemsCluster Storage SystemsData Storage SystemsLatency OptimizationReliable Storage SystemsStorage ManagementStorage ScalabilityLatency ReductionLatency Reduction TechniquesRead Latency OptimizationStorage Access Latency OptimizationStorage LatencyStorage Performance OptimizationTail LatencyTail Latency Reduction
Erasure coding has been used in storage systems to enhance data durability at a lower storage overhead. However, these systems suffer from long access latency tails due to a lack of flexible load balancing mechanisms and passively launched degraded reads when the original storage node of the requested data becomes a hotspot. We provide a new perspective to load balancing in coded storage systems by proactively and intelligently launching degraded reads and propose a variety of schemes to make optimal decisions either per request or across requests statistically. Experiments on a 98-machine cluster based on the request traces of 12 million objects collected from Windows Azure Storage (WAS) show that our schemes can reduce the median latency by 44.7% and the 95th-percentile tail latency by 77.8% in coded storage systems.
23
Brad Calder, Wang Ju, Aaron Ogus et al. · 2011 · 799 citations
Maheswaran Sathiamoorthy, Megasthenis Asteris, Dimitris Papailiopoulos et al. · Proceedings of the VLDB Endowment · 2013 · 689 citations