2012 International Conference for High Performance Computing, Networking, Storage and Analysis · 2012 · 40 citations · 29 references
ComputingComputer ScienceHigh-performance ComputingFault ToleranceFault-tolerant ComputingFault-tolerant SystemsData ParallelismData RecoveryData RedundancyFault Tolerance In Parallel SystemsFault-tolerant Storage SystemsParallel File SystemsCheckpoint RestartCheckpointingCheckpointing I/oCheckpointsConcatenationData SemanticsFile System ArchitectureParallel System
High performance computing (HPC) systems use checkpoint-restart to tolerate failures. Typically, applications store their states in checkpoints on a parallel file system (PFS). As applications scale up, checkpoint-restart incurs high overheads due to contention for PFS resources. The high overheads force large-scale applications to reduce checkpoint frequency, which means more compute time is lost in the event of failure. We alleviate this problem through a scalable checkpointrestart system, MCRENGINE. MCRENGINE aggregates checkpoints from multiple application processes with knowledge of the data semantics available through widely-used I/O libraries, e.g., HDF5 and netCDF, and compresses them. Our novel scheme improves compressibility of checkpoints up to 115% over simple concatenation and compression. Our evaluation with large-scale application checkpoints show that MCRENGINE reduces checkpointing overhead by up to 87% and restart overhead by up to 62% over a baseline with no aggregation or compression.
29