Journal of the ACM · 1967 · 204 citations · 9 references
Natural SciencesMathematicsDerivativesDifferential EquationsOptimizationConvergence AnalysisError EstimationGradient-based OptimizationNumerical AlgorithmsNumerical AnalysisNumerical Methods For Differential EquationsFinite Difference ApproximationGradient VectorMinimizationNumerical DifferentiationTruncationTruncation ErrorTruncation Error Analysis
A modification of Davidon's method for the unconstrained minimization of a function of several variables is proposed in which the gradient vector is approximated by differences. The step sizes for the differencing are calculated from information available in the course of the minimization and are chosen to approximately balance off the effects of truncation error and cancellation error. Numerical results and comparisons with other methods are given.
9
Function minimization by conjugate gradients
R. Fletcher · The Computer Journal · 1964 · 4.9K citations · Full text
A Rapidly Convergent Descent Method for Minimization
R. Fletcher, M. J. D. Powell · The Computer Journal · 1963 · 4.6K citations · Full text