2018 · 53 citations · 23 references
ComputingComputer ScienceHigh-performance ComputingOperating SystemsParallel ComputingStorage SystemsData Storage SystemsFile System AnalysisFile SystemsParallel File SystemsParallel Performance AnalysisStorage ManagementData-intensive ComputingFile System ArchitectureFile System PerformanceFile System Performance EvaluationLong-term PerformanceParallel SystemStorageStorage Performance Modeling
I/O performance is a critical aspect of data-intensive scientific computing. We seek to advance the state of the practice in understanding and diagnosing I/O performance issues through investigation of a comprehensive I/O performance data set that captures a full year of production storage activity at two leadership-scale computing facilities. We demonstrate techniques to identify regions of interest, perform focused investigations of both long-term trends and transient anomalies, and uncover the contributing factors that lead to performance fluctuation. We find that a year in the life of a parallel file system is comprised of distinct regions of long-term performance variation in addition to short-term performance transients. We demonstrate how systematic identification of these performance regions, combined with comprehensive analysis, allows us to isolate the factors contributing to different performance maladies at different time scales. From this, we present specific lessons learned and important considerations for HPC storage practitioners.
23
Dapper, a Large-Scale Distributed Systems Tracing Infrastructure
Benjamin H. Sigelman, Luiz André Barroso, Mike Burrows et al. · 2010 · 471 citations
24/7 Characterization of petascale I/O workloads
Philip Carns, Robert Latham, Robert Ross et al. · 2009 · 212 citations