SIAM Journal on Matrix Analysis and Applications · 2013 · 51 citations · 9 references
ComputingComputer ScienceAlgorithmsComputational GeometryTheory Of ComputationAlgorithm AnalysisApproximation AlgorithmsError EstimationMatrix ComputationNumerical AlgorithmsNumerical AnalysisError BoundingError BoundsFloating-point ArithmeticFloating-point Error AnalysisLower Bounds Of ErrorMatrix MultiplicationOverflow HandlingRound-off Error Analysis
Given two floating-point vectors $x,y$ of dimension $n$ and assuming rounding to nearest, we show that if no underflow or overflow occurs, any evaluation order for an inner product returns a floating-point number ${\widehat r}$ such that $|{\widehat r}- x^Ty| \leqslant nu|x|^T|y|$ with $u$ the unit roundoff. This result, which holds for any radix and with no restriction on $n$, can be seen as a generalization of a similar bound given in [S. M. Rump, BIT, 52 (2012), pp. 201--220] for recursive summation in radix $2$, namely, $|{\widehat r}- x^Te| \leqslant (n-1)u|x|^Te$ with $e=[1,1,\ldots,1]^T$. As a direct consequence, the error bound for the floating-point approximation $\widehat{C}$ of classical matrix multiplication with inner dimension $n$ simplifies to $|\widehat{C}-AB|\leqslant nu|A||B|$.
9
Gaussian elimination is not optimal
Volker Strassen · Numerische Mathematik · 1969 · 2.5K citations
Matrix multiplication via arithmetic progressions
Don Coppersmith, S. Winograd · Journal of Symbolic Computation · 1990 · 2.3K citations
Multiplying matrices faster than coppersmith-winograd
Virginia Vassilevska Williams · 2012 · 887 citations
Gaussian Elimination is not Optimal
Volker Trassen · 2005 · 460 citations