How to program parallel processors: Software developers must divide problems into manageable chunks and ensure efficient communications between computing elements

Abstract

The special features of parallel programming are discussed. These consist mainly in dividing the problem into segments that will execute in parallel, and determine how the processor will communicate and synchronize with one another. The role of architecture is described, and the task of expressing problems in parallel form is addressed. The issue of efficiency is examined.