Mathematics of Computation · 2006 · 335 citations · 22 references
ComputingComputational EngineeringComputational MechanicsComputational PhysicsOptimizationConvergence AnalysisGlobal OptimizationIterative SolversNumerical AlgorithmsNumerical Methods For Differential EquationsSpectral MethodsGlobal Convergence AnalysisGlobalization StrategyNonlinear Convergence AnalysisNonlinear Equation SolversNonlinear Solver ConvergenceSpectral Convergence
A fully derivative-free spectral residual method for solving large-scale nonlinear systems of equations is presented. It uses in a systematic way the residual vector as a search direction, a spectral steplength that produces a nonmonotone process and a globalization strategy that allows for this nonmonotone behavior. The global convergence analysis of the combined scheme is presented. An extensive set of numerical experiments that indicate that the new combination is competitive and frequently better than well-known Newton-Krylov methods for large-scale problems is also presented.
22
Two-Point Step Size Gradient Methods
Jonathan Barzilai, Jonathan M. Borwein · IMA Journal of Numerical Analysis · 1988 · 2.9K citations