File and Storage Technologies · 2012 · 108 citations · 28 references
Distributed File SystemStorage PerformanceEngineeringVerificationComputer ArchitectureParallel StorageLightweight File SystemData ConsistencyBackpointer-based ConsistencyParallel ComputingParallel File SystemData ManagementOrder TheoryModern File SystemsFile SystemsComputer EngineeringComputer ScienceConsistency TechnologyAutomated ReasoningCloud ComputingFormal MethodsFile SystemSystem Software
Modern file systems use ordering points to maintain consistency in the face of system crashes. However, such ordering leads to lower performance, higher complexity, and a strong and perhaps naive dependence on lower layers to correctly enforce the ordering of writes. In this paper, we introduce the No-Order File System (NoFS), a simple, lightweight file system that employs a novel technique called backpointer-based consistency to provide crash consistency without ordering writes as they go to disk. We utilize a formal model to prove that NoFS provides data consistency in the event of system crashes; we show through experiments that NoFS is robust to such crashes, and delivers excellent performance across a range of workloads. Backpointer-based consistency thus allows NoFS to provide crash consistency without resorting to the heavyweight machinery of traditional approaches.
28
Above the Clouds: A Berkeley View of Cloud Computing
Michael Armbrust, Armando Fox, Rean Griffith et al. · UC Berkeley · 2009 · 5.7K citations
Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung · ACM SIGOPS Operating Systems Review · 2003 · 5K citations
The Hadoop Distributed File System
Konstantin V. Shvachko, Hairong Kuang, Sanjay Radia et al. · 2010 · 4.8K citations
End-To-End Arguments In System Design
1984 · 2.1K citations