Transactions of the American Mathematical Society · 1979 · 131 citations · 7 references
Natural SciencesMathematicsDynamical SystemsProbability TheoryStochastic ProcessesBellman EquationsMarkov ProcessesOptimal ControlStochastic ControlBellman Expectation EquationContinuous-time Bellman EquationsDirichlet ProcessesOptimal Control Of Stochastic SystemsStochastic Optimal Control
Let <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="upper L Superscript i"> <mml:semantics> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msup> <mml:mi>L</mml:mi> <mml:mi>i</mml:mi> </mml:msup> </mml:mrow> <mml:annotation encoding="application/x-tex">{L^i}</mml:annotation> </mml:semantics> </mml:math> </inline-formula> be a sequence of second order elliptic operators in a bounded <italic>n</italic> -dimensional domain <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="normal upper Omega"> <mml:semantics> <mml:mi mathvariant="normal"> Ω </mml:mi> <mml:annotation encoding="application/x-tex">\Omega</mml:annotation> </mml:semantics> </mml:math> </inline-formula> , and let <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="f Superscript i"> <mml:semantics> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msup> <mml:mi>f</mml:mi> <mml:mi>i</mml:mi> </mml:msup> </mml:mrow> <mml:annotation encoding="application/x-tex">{f^i}</mml:annotation> </mml:semantics> </mml:math> </inline-formula> be given functions. Consider the problem of finding a solution <italic>u</italic> to the Bellman equation <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="sup Underscript i Endscripts left-parenthesis upper L Superscript i Baseline u minus f Superscript i Baseline right-parenthesis equals 0"> <mml:semantics> <mml:mrow> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:munder> <mml:mo movablelimits="true" form="prefix">sup</mml:mo> <mml:mi>i</mml:mi> </mml:munder> </mml:mrow> <mml:mo stretchy="false">(</mml:mo> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msup> <mml:mi>L</mml:mi> <mml:mi>i</mml:mi> </mml:msup> </mml:mrow> <mml:mi>u</mml:mi> <mml:mspace width="thinmathspace"/> <mml:mo> − </mml:mo> <mml:mspace width="thinmathspace"/> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msup> <mml:mi>f</mml:mi> <mml:mi>i</mml:mi> </mml:msup> </mml:mrow> <mml:mo stretchy="false">)</mml:mo> <mml:mspace width="thinmathspace"/> <mml:mo>=</mml:mo> <mml:mspace width="thinmathspace"/> <mml:mn>0</mml:mn> </mml:mrow> <mml:annotation encoding="application/x-tex">{\sup _i}({L^i}u\, - \,{f^i})\, = \,0</mml:annotation> </mml:semantics> </mml:math> </inline-formula> a.e. in <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="normal upper Omega"> <mml:semantics> <mml:mi mathvariant="normal"> Ω </mml:mi> <mml:annotation encoding="application/x-tex">\Omega</mml:annotation> </mml:semantics> </mml:math> </inline-formula> , subject to the Dirichlet boundary condition <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="u equals 0"> <mml:semantics> <mml:mrow> <mml:mi>u</mml:mi> <mml:mspace width="thinmathspace"/> <mml:mo>=</mml:mo> <mml:mspace width="thinmathspace"/> <mml:mn>0</mml:mn> </mml:mrow> <mml:annotation encoding="application/x-tex">u\, = \,0</mml:annotation> </mml:semantics> </mml:math> </inline-formula> on <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="partial-differential normal upper Omega"> <mml:semantics> <mml:mrow> <mml:mi mathvariant="normal"> ∂ </mml:mi> <mml:mi mathvariant="normal"> Ω </mml:mi> </mml:mrow> <mml:annotation encoding="application/x-tex">\partial \Omega</mml:annotation> </mml:semantics> </mml:math> </inline-formula> . It is proved that, provided the leading coefficients of the <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="upper L Superscript i"> <mml:semantics> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msup> <mml:mi>L</mml:mi> <mml:mi>i</mml:mi> </mml:msup> </mml:mrow> <mml:annotation encoding="application/x-tex">{L^i}</mml:annotation> </mml:semantics> </mml:math> </inline-formula> are constants, there exists a unique solution <italic>u</italic> of this problem, belonging to <inline-formula content-type="math/mathml"> <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" alttext="upper W Superscript 1 comma normal infinity Baseline left-parenthesis normal upper Omega right-parenthesis intersection upper W Subscript loc Superscript 2 comma normal infinity Baseline left-parenthesis normal upper Omega right-parenthesis"> <mml:semantics> <mml:mrow> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:msup> <mml:mi>W</mml:mi> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:mn>1</mml:mn> <mml:mo>,</mml:mo> <mml:mi mathvariant="normal"> ∞ </mml:mi> </mml:mrow> </mml:msup> </mml:mrow> <mml:mo stretchy="false">(</mml:mo> <mml:mi mathvariant="normal"> Ω </mml:mi> <mml:mo stretchy="false">)</mml:mo> <mml:mspace width="thinmathspace"/> <mml:mo> ∩ </mml:mo> <mml:mspace width="thinmathspace"/> <mml:msubsup> <mml:mi>W</mml:mi> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:mtext>loc</mml:mtext> </mml:mrow> </mml:mrow> <mml:mrow class="MJX-TeXAtom-ORD"> <mml:mn>2</mml:mn> <mml:mo>,</mml:mo>
7