SIAM Journal on Control and Optimization · 1989 · 62 citations · 6 references
Natural SciencesMathematicsOptimizationStochastic ModelingStochastic ProcessesOptimal ControlStochastic CalculusStochastic ControlStochastic Differential EquationsStochastic OptimizationStochastic Systems ModelingAdjoint FormulationMartingale ProblemsMartingale RepresentationMartingale TheoryOptimal Control FormulationOptimal Control Of Stochastic SystemsStochastic FlowsStochastic Optimal Control
Using stochastic flows and the generalized differentiation formula of Bismut and Kunita, the change in cost due to a strong variation of an optimal control is explicitly calculated. Differentiating this expression gives a minimum principle in both the partially observed and stochastic open loop situations. In the latter case the equation satisfied by the adjoint process is obtained by applying a martingale representation result.
6