Journal of Parallel and Distributed Computing · 1997 · 30 citations · 22 references
ComputingComputer ScienceHigh-performance ComputingMessage PassingParallel ComputingProgramming LanguagesData ParallelismParallel ArchitecturesParallel ComputationParallel Performance AnalysisParallel Programming ModelsTask ParallelismCompiler SupportDistributed Data StructuresHigh-performance Computing SystemsMessage Passing InterfaceParallel Performance OptimizationParallel ProgrammingTask Parallel Programming ModelsTask-level Parallelism
Pure data-parallel languages such as High Performance Fortran version 1 (HPF) do not allow efficient expression of mixed task/data-parallel computations or the coupling of separately compiled data-parallel modules. In this paper, we show how these common parallel program structures can be represented, with only minor extensions to the HPF model, by using a coordination library based on the Message Passing Interface (MPI). This library allows data-parallel tasks to exchange distributed data structures using calls to simple communication functions. We present microbenchmark results that characterize the performance of this library and that quantify the impact of optimizations that allow reuse of communication schedules in common situations. In addition, results from two-dimensional FFT, convolution, and multiblock programs demonstrate that the HPF/MPI library can provide performance superior to that of pure HPF. We conclude that this synergistic combination of two parallel programming standards represents a useful approach to task parallelism in a data-parallel framework, increasing the range of problems addressable in HPF without requiring complex compiler technology.
22
Nicholas Carriero, David Gelernter · Communications of the ACM · 1989 · 1.4K citations · Full text
W. Daniel Hillis, Guy L. Steele · Communications of the ACM · 1986 · 891 citations · Full text
The High Performance Fortran Handbook
Charles Koelbel, David B. Loveman, Robert Schreiber et al. · Computers in Physics · 1994 · 577 citations