Scalable Parallel Computing: A Grand Unified Theory and its Practical Development.

Abstract

The Bulk Synchronous Parallel (BSP) model provides a unified framework for the design and programming of general purpose parallel computing systems. In this paper we describe the BSP model and discuss some of the developments in architecture, algorithms and programming languages which are currently being pursued as part of this new, unified approach to scalable parallel computing.