2011 · 364 citations · 26 references
ComputingComputer ScienceComputer SystemsFault-tolerant ComputingFault-tolerant SystemsStorage SystemsCluster Storage SystemsData DurabilityData RecoveryFault-tolerant Storage SystemsReliable Storage SystemsStorage ManagementCluster Storage ArchitectureCrash RecoveryHigh PerformanceLog-structured StorageNode FailuresStorage Cluster ArchitectureStorage Recovery
RAMCloud is a DRAM-based storage system that provides inexpensive durability and availability by recovering quickly after crashes, rather than storing replicas in DRAM. RAMCloud scatters backup data across hundreds or thousands of disks, and it harnesses hundreds of servers in parallel to reconstruct lost data. The system uses a log-structured approach for all its data, in DRAM as well as on disk: this provides high performance both during normal operation and during recovery. RAMCloud employs randomized techniques to manage the system in a scalable and decentralized fashion. In a 60-node cluster, RAMCloud recovers 35 GB of data from a failed server in 1.6 seconds. Our measurements suggest that the approach will scale to recover larger memory sizes (64 GB or more) in less time with larger clusters.
26
Ion Stoica, Robert Morris, David R. Karger et al. · 2001 · 9.7K citations
The Hadoop Distributed File System
Konstantin V. Shvachko, Hairong Kuang, Sanjay Radia et al. · 2010 · 4.8K citations
Giuseppe DeCandia, Deniz Hastorun, Madan Jampani et al. · 2007 · 3.5K citations
Fay W. Chang, Sanjay Ghemawat, Wilson C. Hsieh et al. · ACM Transactions on Computer Systems · 2008 · 3.4K citations