2006 · 79 citations · 11 references
ComputingComputer EngineeringComputer ScienceAlgorithmsComputer ArchitectureScientific ComputingHardware AccelerationMatrix ComputationNumerical AnalysisNumerical Linear AlgebraComputational Linear AlgebraFloating-point ArithmeticIterative Methods For Linear SystemsIterative RefinementLinear Eigenvalue ProblemsMatrix Eigenvalue ProblemsPrecisionSparse Linear Algebra
Recent versions of microprocessors exhibit performance characteristics for 32 bit floating point arithmetic (single precision) that is substantially higher than 64 bit floating point arithmetic (double precision). Examples include the Intel's Pentium IV and M processors, AMD's Opteron architectures and the IBM's Cell Broad Engine processor. When working in single precision, floating point operations can be performed up to two times faster on the Pentium and up to ten times faster on the Cell over double precision. The performance enhancements in these architectures are derived by accessing extensions to the basic architecture, such as SSE2 in the case of the Pentium and the vector functions on the IBM Cell. The motivation for this paper is to exploit single precision operations whenever possible and resort to double precision at critical stages while attempting to provide the full double precision results. The results described here are fairly general and can be applied to various problems in linear algebra such as solving large sparse systems, using direct or iterative methods and some eigenvalue problems. There are limitations to the success of this process, such as when the conditioning of the problem exceeds the reciprocal of the accuracy of the single precision computations. In that case the double precision algorithm should be used.
11
The Algebraic Eigenvalue Problem
E. I., J. H. Wilkinson · Mathematics of Computation · 1966 · 5.2K citations
Applied numerical linear algebra
Choice Reviews Online · 1998 · 2.2K citations
Introduction to the Cell multiprocessor
J. Kahle, Michael Day, H. Peter Hofstee et al. · IBM Journal of Research and Development · 2005 · 941 citations
Iterative Refinement in Floating Point
C Moler · Journal of the ACM · 1967 · 175 citations · Full text
Error bounds from extra-precise iterative refinement
James Demmel, Yozo Hida, W. Kahan et al. · ACM Transactions on Mathematical Software · 2006 · 100 citations