Optimization methods & software · 2005 · 39 citations · 22 references
ComputingComputer ScienceAlgorithmsDerivativesOptimizationDerivative-free OptimizationGradient-based OptimizationNonlinear ProgrammingNumerical AlgorithmsOptimization TheoryQuadratic ProgrammingDerivative-free Trust-region TheoryInterpolation-based OptimizationNonlinear OptimizationObjective Function FormulationQuadratic OptimizationTrust-region Quadratic Programming
We present an algorithm for solving nonlinear programming problems involving a partially separable objective function whose derivatives are assumed to be unavailable. At each iteration, we construct a quadratic interpolation model of the objective function around the current iterate and minimize this model to obtain a trial step. The whole process is embedded within a trust-region framework. We further propose to use ideas of Curtis, Powell and Reid to minimize the number of calls to the objective function in the part of the derivative-free algorithm that improves the geometry of the interpolation set. Numerical experiments tend to confirm the promising behaviour of the algorithm.
22
On the Convergence of Pattern Search Algorithms
Virginia Torczon · SIAM Journal on Optimization · 1997 · 1.3K citations
Analysis of Generalized Pattern Searches
Charles Audet, J. E. Dennis · SIAM Journal on Optimization · 2002 · 1K citations