SIAM Journal on Optimization · 2001 · 236 citations · 13 references
Natural SciencesComputer ScienceAlgorithmsCost-minimization AnalysisOptimizationConstrained OptimizationConvex OptimizationGlobal OptimizationGradient-based OptimizationOptimization TheoryUnconstrained OptimizationConvergenceGlobal Convergence AnalysisGlobal Search AlgorithmsLipschitz OptimizationNonconvex Optimization
This paper is concerned with the open problem of whether the BFGS method with inexact line search converges globally when applied to nonconvex unconstrained optimization problems. We propose a cautious BFGS update and prove that the method with either a Wolfe-type or an Armijo-type line search converges globally if the function to be minimized has Lipschitz continuous gradients.
13
Practical methods of optimization
Mathematics and Computers in Simulation · 1988 · 5.9K citations
Quasi-Newton Methods, Motivation and Theory
J. E. Dennis, Jorge J. Morè · SIAM Review · 1977 · 1.5K citations · Full text