IEEE Transactions on Neural Networks and Learning Systems · 2022 · 175 citations · 39 references
Natural SciencesMathematicsDynamical SystemsOptimizationProcess ControlAdaptive ControlControl Of Dynamical SystemsControl TheoryDynamic ProgrammingHamiltonian SystemsOptimal ControlAdaptive Optimal ControlClosed-loop SystemsConvergenceExcitationHamilton - Jacobi - Bellman EquationsHamilton-jacobi-bellman EquationsNonlinear Dynamical SystemsSimulation Studies
This article presents a novel efficient experience-replay-based adaptive dynamic programming (ADP) for the optimal control problem of a class of nonlinear dynamical systems within the Hamiltonian-driven framework. The quasi-Hamiltonian is presented for the policy evaluation problem with an admissible policy. With the quasi-Hamiltonian, a novel composite critic learning mechanism is developed to combine the instantaneous data with the historical data. In addition, the pseudo-Hamiltonian is defined to deal with the performance optimization problem. Based on the pseudo-Hamiltonian, the conventional Hamilton-Jacobi-Bellman (HJB) equation can be represented in a filtered form, which can be implemented online. Theoretical analysis is investigated in terms of the convergence of the adaptive critic design and the stability of the closed-loop systems, where parameter convergence can be achieved under a weakened excitation condition. Simulation studies are investigated to verify the efficacy of the presented design scheme.
39
Pétros Ioannou, Jing Sun · 1995 · 5.7K citations
Danil Prokhorov, Donald C. Wunsch · IEEE Transactions on Neural Networks · 1997 · 1.2K citations