SIAM Journal on Optimization · 1994 · 10 citations · 22 references
ComputingComputer ScienceAlgorithmsOptimizationScientific ComputingConvex OptimizationGradient-based OptimizationIterative SolversNonlinear ProgrammingNumerical AlgorithmsConstraintsConvergenceLocal Convergence AnalysisNonlinear Function ApproximationNonlinear Problem SolvingOptimality ConditionsPositive DefinitenessSecond-order Optimization
The problem considered is that of minimizing a nonlinear function subject to a set of equality constraints. Recent research has focused on methods that solve such problems by recurring an approximation to second derivative information projected onto the tangent space of the constraints. The motivation for these methods is that only the projected matrix enters into the optimality conditions for the nonlinear problem and that the reduced matrix can be recurred by means of updates that maintain hereditary positive definiteness. However, such methods can achieve at best local two-step Q-superlinear convergence. The algorithm presented here performs a two-piece update of a “one-sided projected Hessian matrix.” This method maintains one piece of the projected Hessian as a positive definite matrix and uses Broyden’s method for updating the other piece. It is shown that if at least one of the updates is performed at each iteration, the method is locally one-step Q-superlinearly convergent.
22
Quasi-Newton Methods, Motivation and Theory
J. E. Dennis, Jorge J. Morè · SIAM Review · 1977 · 1.5K citations · Full text