SIAM Journal on Control and Optimization · 1983 · 59 citations · 10 references
Natural SciencesMathematicsDynamical SystemsProbability TheoryStochastic ProcessesBellman EquationsControl TheoryDiffusion ProcessesOptimal ControlState-space ModelsStochastic ControlFilteringHamilton - Jacobi - Bellman EquationsHamilton-jacobi-bellman EquationsNonlinear DiffusionNonlinear FilteringNonlinear Optimal ControlOptimal Control Of Nonlinear SystemsOptimal Control Of Stochastic Systems
The problem of optimal control for partially observable diffusion processes is studied by the dynamic programming in function space approach first proposed by R. E. Mortensen. The density of the conditional distribution of the (unobservable) signal given past and present observations, which satisfies the Zakai equation of nonlinear filtering, is viewed as the new state of the system. A verification result is established for the corresponding Bellman–Hamilton–Jacobi equation, known as Mortensen’s equation.
10
R. L. Stratonovich · Theory of Probability and Its Applications · 1960 · 343 citations
Existence of Optimal Stochastic Control Laws
Vladimír Beneš · SIAM Journal on Control · 1971 · 244 citations