Supercomputing Frontiers and Innovations · 2015 · 29 citations · 53 references
ComputingComputer EngineeringComputer ScienceComputer ArchitectureFault ToleranceParallel ComputingAccelerator ArchitectureHardware AccelerationParallel ArchitecturesParallel Computer ArchitectureParallel Computing SystemsParallel Runtime SystemsData-intensive ComputingEnergy-efficient Parallel ComputingHigh-performance Computing SystemsInterconnect TopologiesMean Time Between FailuresProgramming ModelsRuntime System ArchitectureSupercomputer Architecture
Extreme scale parallel computing systems will have tens of thousands of optionally accelerator-equiped nodes with hundreds of cores each, as well as deep memory hierarchies and complex interconnect topologies. Such Exascale systems will provide hardware parallelism at multiple levels and will be energy constrained. Their extreme scale and the rapidly deteriorating reliablity of their hardware components means that Exascale systems will exhibit low mean-time-between-failure values. Furthermore, existing programming models already require heroic programming and optimisation efforts to achieve high efficiency on current supercomputers. Invariably, these efforts are platform-specific and non-portable. In this paper we will explore the shortcomings of existing programming models and runtime systems for large scale computing systems. We then propose and discuss important features of programming paradigms and runtime system to deal with large scale computing systems with a special focus on data-intensive applications and resilience.Finally, we also discuss code sustainability issues and propose several software metrics that are of paramount importance for code development for large scale computing systems.
53
MPI: A Message-Passing Interface Standard
Message P Forum · 1994 · 2.7K citations
Basic Linear Algebra Subprograms for Fortran Usage
C. L. Lawson, Richard Hanson, David R. Kincaid et al. · ACM Transactions on Mathematical Software · 1979 · 1.6K citations · Full text
Philippe Charles, Christian Grothoff, Vijay Saraswat et al. · 2005 · 1.3K citations