SIAM Journal on Control and Optimization · 2005 · 67 citations · 17 references
Natural SciencesEconomicsMathematicsDynamical SystemsOptimizationStochastic ProcessesConvex AnalysisConvex OptimizationOptimal ControlOptimization In EconomicsOptimization TheoryStochastic ControlFuel-optimal ControlIrreversible Investment AnalysisOptimal Control FormulationOptimal Control Of Stochastic SystemsOptimal InvestmentOptimal PoliciesSnell EnvelopeStochastic Optimal Control
We present a new approach to solve optimal control problems of the monotone follower type. The key feature of our approach is that it allows us to include an arbitrary dynamic fuel constraint. Instead of dynamic programming, we use the convexity of our cost functional to derive a first order characterization of optimal policies based on the Snell envelope of the objective functional's gradient at the optimum. The optimal control policy is constructed explicitly in terms of the solution to a representation theorem for stochastic processes obtained in Bank and El Karoui (2004), {Ann. Probab.}, 32, pp. 1030--1067. As an illustration, we show how our methodology allows us to extend the scope of the explicit solutions obtained for the classical monotone follower problem and for an irreversible investment problem arising in economics.
17
Controlled markov processes and viscosity solutions
M. R. James · Stochastics and stochastics reports · 1994 · 1.1K citations
Some solvable stochastic control problemst<sup>†</sup>
Vladimír Beneš, L. A. Shepp, H. S. Witsenhausen · Stochastics · 1980 · 342 citations
Frank Riedel, Xia Su · Finance and Stochastics · 2010 · 156 citations