2018 · 17 citations · 27 references
ComputingComputer EngineeringComputer ScienceDistributed SystemsParallel AlgorithmsParallel ComputingDistributed ComputingLoad BalancingParallel ArchitecturesParallel Computing SystemsParallel Runtime SystemsShared-memory ParallelismAdaptive ImplementationAdaptive Load BalancingExecution Runtime SystemsLoad Balancing StrategiesLoad RedistributionOpenmpRuntime System ArchitectureSystem Utilization
The recent trend of increasing numbers of cores per chip has resulted in vast amounts of on-node parallelism. These high core counts result in hardware variability that introduces imbalance. Applications are also becoming more complex, re-sulting in dynamic load imbalance. Load imbalance of any kind can result in loss of performance and system utilization. We address the challenge of handling both transient and persistent load imbalances while maintaining locality with low overhead. In this paper, we propose an integrated runtime system that combines the Charm++ distributed programming model with concurrent tasks to mitigate load imbalances within and across shared memory address spaces. It utilizes a periodic assignment of work to cores based on load measurement, in combination with user created tasks to handle load imbalance. We integrate OpenMP with Charm++ to enable creation of potential tasks via OpenMP's parallel loop construct. This is also available to MPI applications through the Adaptive MPI implementation. We demonstrate the benefits of our work on three applications. We show improvements of Lassen by 29.6% on Cori and 46.5% on Theta. We also demonstrate the benefits on a Charm++ application, ChaNGa by 25.7% on Theta, as well as an MPI proxy application, Kripke, using Adaptive MPI.
27
Robert D. Blumofe, Christopher F. Joerg, Bradley C. Kuszmaul et al. · 1995 · 1K citations · Full text
THE AGORA HIGH-RESOLUTION GALAXY SIMULATIONS COMPARISON PROJECT
Ji-hoon Kim, Tom Abel, Oscar Agertz et al. · The Astrophysical Journal Supplement Series · 2013 · 281 citations · Full text
Natural Sciences, Astronomy, Physics +17