ComputingComputer EngineeringComputer ScienceComputer ArchitectureParallel AlgorithmsParallel ComputingAlgorithm AnalysisParallel Algorithm DesignParallel ArchitecturesParallel ComputationParallel Computer ArchitectureParallel Performance AnalysisExecution Time AnalysisLoad Imbalance Due To CommunicationParallel Algorithm AnalysisParallel ProcessingParallel ProgrammingParallel SystemParallelizationSynchronization Overhead Analysis
The main reason of parallelization a sequential program is to run the program faster. When running a parallel program on a real parallel system there is an overhead coming from processors load imbalance and from communication times needed for changing data between processors and for synchronization. This is the reason why the execution time of the program will be greater than the theoretical value.
2
Introduction to parallel computing
Choice Reviews Online · 2004 · 1.9K citations
Sourcebook of parallel computing
Choice Reviews Online · 2003 · 392 citations