IMA Journal of Numerical Analysis · 2008 · 64 citations · 14 references
Numerical AnalysisMathematical ProgrammingLarge-scale Global OptimizationEngineeringMachine LearningVariational AnalysisFunctional AnalysisUnconstrained OptimizationDerivative-free OptimizationSimplex GradientsCombinatorial OptimizationComputational GeometryApproximation TheoryPattern SearchContinuous OptimizationComputer EngineeringInverse ProblemsSimplex MethodComputer ScienceNondifferentiable OptimizationAdaptive OptimizationOptimization ProblemGeneralized Pattern Search
It has been shown recently that the efficiency of direct search methods that use opportunistic polling in positive spanning directions can be improved significantly by reordering the poll directions according to descent indicators built from simplex gradients. The purpose of this paper is two-fold. First, we analyse the properties of simplex gradients of nonsmooth functions in the context of direct search methods like the generalized pattern search and the mesh adaptive direct search, for which there exists a convergence analysis in the nonsmooth setting. Our analysis does not require continuous differentiability and can be seen as an extension of the accuracy properties of simplex gradients known for smooth functions. Secondly, we test the use of simplex gradients when pattern search is applied to nonsmooth functions, confirming the merit of the poll ordering strategy for such problems.
14
Theory of Positive Linear Dependence
Chandler Davis · American Journal of Mathematics · 1954 · 287 citations