;login:: the magazine of USENIX & SAGE · 2010 · 135 citations · 6 references
ComputingComputer ScienceComputer SystemsCluster ComputingDistributed SystemsStorage SystemsCluster Storage SystemsData Storage SystemsDistributed StorageDistributed Storage SystemsFile SystemsStorage ArchitectureCluster Storage ArchitectureDistributed File System ArchitectureDistributed Storage ArchitecturesFile System ScalabilityScalable Storage ArchitecturesScalable Storage SystemsStorage CapacityStorage Scaling
The Hadoop distributed file system (HDFS) is an open source system currently being used in situations where massive amounts of data need to be processed. Based on experience with the largest deployment of HDFS, I provide an analysis of how the amount of RAM of a single namespace server correlates with the storage capacity of Hadoop clusters, outline the advantages of the single-node namespace server architecture for linear performance scaling, and establish practical limits of growth for this architecture. This study may be applicable to issues with other distributed file systems.
6
Ceph: a scalable, high-performance distributed file system
Sage A. Weil, Scott Brandt, Ethan L. Miller et al. · eScholarship (California Digital Library) · 2006 · 1.4K citations · Full text
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank Schmuck, Roger Haskin · 2002 · 1.2K citations
Scalable performance of the Panasas parallel file system
Brent Welch, Marc Unangst, Zainul Abbasi et al. · 2008 · 326 citations