The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints
Journal of the Society for Industrial and Applied Mathematics · 1960 · 1.2K citations · 12 references
Mathematical ProgrammingNumerical AnalysisLinear ConstraintsEngineeringLinear OptimizationNonlinear ProgrammingSystems EngineeringConstrained OptimizationNonlinear Objective FunctionInverse ProblemsSimplex MethodNonlinear OptimizationLinear ProgrammingUnconstrained OptimizationGradient Projection MethodApproximation TheoryQuadratic ProgrammingOperations Research
The paper discusses nonlinear programming, contrasting linear and nonlinear objective functions, and notes that the gradient projection method can solve linear problems as a special case, building on foundational work by Dantzig and Kuhn–Tucker. It aims to present the gradient projection method for problems with linear constraints, setting the stage for its extension to nonlinear constraints in Part II. Part I demonstrates that the gradient projection method efficiently solves the less difficult linear‑constraint case, and subsequent work has produced computational procedures building on this result.
more constraints or equations, with either a linear or nonlinear objective function. This distinction is made primarily on the basis of the difficulty of solving these two types of nonlinear problems. The first type is the less difficult of the two, and in this, Part I of the paper, it is shown how it is solved by the gradient projection method. It should be noted that since a linear objective function is a special case of a nonlinear objective function, the gradient projection method will also solve a linear programming problem. In Part II of the paper [16], the extension of the gradient projection method to the more difficult problem of nonlinear constraints and equations will be described. The basic paper on linear programming is the paper by Dantzig [5] in which the simplex method for solving the linear programming problem is presented. The nonlinear programming problem is formulated and a necessary and sufficient condition for a constrained maximum is given in terms of an equivalent saddle value problem in the paper by Kuhn and Tucker [10]. Further developments motivated by this paper, including a computational procedure, have been published recently [1]. The gradient projection method was originally presented to the American Mathematical Society
12
A generalized inverse for matrices
Roger Penrose · Mathematical Proceedings of the Cambridge Philosophical Society · 1955
Non-singular MatrixGeneralized InverseMatrix Factorization+8
4.4K citations
Studies in Linear and Non-Linear Programming.
E. M. L. Beale, Kenneth J. Arrow, Leonid Hurwicz et al. · Journal of the Royal Statistical Society Series A (General) · 1959
922 citations
The Simplex Method for Quadratic Programming
Philip Wolfe · Econometrica · 1959
Mathematical ProgrammingEngineeringSemi-definite Optimization+4
517 citations
The Gradient Projection Method for Nonlinear Programming. Part II. Nonlinear Constraints
J. B. Rosen · Journal of the Society for Industrial and Applied Mathematics · 1961
Mathematical ProgrammingNumerical AnalysisNonlinear Constraints+14
517 citations
The Simplex Method for Quadratic Programming
Philip Wolfe · Econometrica · 1960
Mathematical ProgrammingConic OptimizationComputational Procedure+13
510 citations