2017 · 22 citations · 37 references
ComputingComputer EngineeringHigh-performance ComputingDistributed SystemsOperating SystemsStorage SystemsBuffer ManagementStorage ManagementBurst HandlingBurst ManagementNon-volatile MemoryProvisioningResource ContentionResource Contention ManagementStorage I/o OptimizationStorage Performance Modeling
HPC (high-performance computing) applications usually show bursty I/O behaviors. In order to expedite the applications, permanent storage systems are usually provisioned to serve such I/O bursts. Approaching the era of exascale computing, non-volatile RAM is introduced as burst buffers, to absorb the bursty bulk data and relax the I/O provisioning requirement of the permanent storage systems. However, without judiciously draining the burst buffers, I/O bursts are passed down to the underlying storage systems, which causes severe I/O contention issues.In order to minimize the I/O provisioning requirement and resolve the issues caused by I/O bursts, we propose a proactive draining scheme to manage the draining process of distributed node-local burst buffers. In addition, we develop an I/O provisioning model to predict the minimized I/O provisioning requirement for permanent storage systems. Evaluation results show that applying the proactive draining scheme largely relaxes the I/O provisioning requirement while preserving the I/O performance of underlying storage systems.
37
Design tradeoffs for SSD performance
Nitin Agrawal, Vijayan Prabhakaran, Ted Wobber et al. · 2008 · 886 citations
Dushyanth Narayanan, Austin Donnelly, Antony Rowstron · ACM Transactions on Storage · 2008 · 759 citations
The DiskSim Simulation Environment Version 4.0 Reference Manual
John S. Bucy, Jiří Schindler, Steven W. Schlosser et al. · 2008 · 433 citations
On the role of burst buffers in leadership-class storage systems
Ning Liu, Jason M. Cope, Philip Carns et al. · 2012 · 327 citations