1999 · 35 citations · 22 references
ComputingComputer ScienceComputer SystemsDistributed SystemsOperating SystemsParallel ComputingDistributed ComputingDistributed Memory SystemsParallel Computing SystemsParallel Runtime SystemsShared-memory MultiprocessingShared-memory ParallelismAdaptive ScalingDistributed Runtime SystemsOpenmpRuntime Systems For Parallelism
We present a system that allows OpenMP programs to execute on a network of workstations with a variable number of nodes. The ability to adapt to a variable number of nodes allows a program to take advantage of additional nodes that become available after it starts execution, or to gracefully scale down when the number of available nodes is reduced. We demonstrate that the cost of adaptation is modest; the system allows a program to adapt at a moderate rate without much performance loss.Two ideas underlie the efficiency of our design. First, we recognize that OpenMP programs exhibit convenient adaptation points during their execution, points at which the cost of adaptation can be much reduced. Second, by allowing a process a certain grace period before it must leave a node, we insure that most adaptations can occur at these adaptation points, and thus at low cost. Migration of a process, a much more expensive method for providing adaptivity, is used only as a back-up solution, when the process cannot reach an adaptation point within the grace period.Our implementation consists of an OpenMP pre-processor that generates TreadMarks distributed shared memory (DSM) programs, and a version of TreadMarks modified to adapt to a variable number of nodes. Using a DSM as the underlying substrate facilitates the data (re-)distribution necessary after an adaptation.
22
K. Mani Chandy, Leslie Lamport · ACM Transactions on Computer Systems · 1985 · 2.4K citations · Full text
Condor-a hunter of idle workstations
Michael Litzkow, Miron Livny, Matt W. Mutka · 2003 · 2.3K citations · Full text
Memory coherence in shared virtual memory systems
Kai Li, Paul Hudak · ACM Transactions on Computer Systems · 1989 · 1.2K citations · Full text
TreadMarks: shared memory computing on networks of workstations
Cristiana Amza, Alan L. Cox, Sandhya Dwarkadas et al. · Computer · 1996 · 834 citations · Full text
A case for NOW (Networks of Workstations)
Thomas E. Anderson, David Culler, David A. Patterson · IEEE Micro · 1995 · 797 citations