2017 · 32 citations · 13 references
Natural SciencesMathematicsAlgorithmsDynamical SystemsOptimizationApproximation AlgorithmsControl Of Dynamical SystemsControl TheoryNonlinear ControlOptimal ControlRobust ControlDynamic Systems TheoryNonlinear Optimal ControlOptimal Control FormulationOptimal Control ModelsOptimal Control Of Nonlinear SystemsOptimality ConditionsPontryagin's Minimum PrincipleRobustness
We present a theoretical formulation, and a corresponding numerical algorithm, that can find Pontryagin-optimal inputs for general dynamical systems by using a direct method. Optimal control remains as a versatile and relevant framework in systems theory applications, many decades after being formally defined. Pontryagin-optimal inputs can be found for some classes of problems using indirect methods, but these are often slow or lack robustness. On the other hand, convergent direct optimal control methods are fast, but their solutions usually converge to first-order optimality conditions, which are weaker. Our result, founded on the theory of relaxed inputs as defined by J. Warga, establishes an equivalence between Pontryagin-optimal inputs and optimal relaxed inputs. We also formulate a sampling-based numerical method to approximate the Pontryagin-optimal relaxed inputs using an iterative direct method. Finally, using a provably-convergent numerical method, we synthesize approximations of the Pontryagin-optimal inputs from the sampled relaxed inputs.
13
Automatica · 1997 · 5.5K citations
The Mathematical Theory of Optimal Processes.
E. K. Blum, Pontryagin, Boltyanskii et al. · American Mathematical Monthly · 1963 · 4.3K citations
An Introduction to MCMC for Machine Learning
Christophe Andrieu, Nando de Freitas, Arnaud Doucet et al. · Machine Learning · 2003 · 2.4K citations · Full text
Marshall Freimer, Richard Bellman, Stuart E. Dreyfus · Journal of the American Statistical Association · 1964 · 2.2K citations