SIAM Journal on Optimization · 2011 · 140 citations · 16 references
ComputingComputer ScienceAlgorithmsOptimizationScientific ComputingGradient-based OptimizationLarge-scale OptimizationMatrix ComputationNumerical AlgorithmsNumerical AnalysisUnconstrained OptimizationConvergenceGlobal Convergence AnalysisGradient Descent
Conjugate gradient methods are widely used for solving large-scale unconstrained optimization problems because they do not need the storage of matrices. In this paper, we propose a general form of three-term conjugate gradient methods which always generate a sufficient descent direction. We give a sufficient condition for the global convergence of the proposed method. Moreover, we present a specific three-term conjugate gradient method based on the multistep quasi-Newton method. Finally, some numerical results of the proposed method are given.
16
Function minimization by conjugate gradients
R. Fletcher · The Computer Journal · 1964 · 4.9K citations · Full text