Advances in Applied Probability · 1978 · 127 citations · 27 references
Social SciencesMathematicsGame TheoryProbability TheoryStochastic ProcessesMarkov ProcessesStochastic ControlStochastic Discount FactorStochastic GamesEquilibriumNon-cooperative GamesOptimal Policy ExistenceState Transition MatricesState-space StructureStationary Discounted PoliciesStochastic Equilibrium ExistenceTransition Probability Matrix
This paper considers non-cooperative N -person stochastic games with a countable state space and compact metric action spaces. We concentrate upon the average return per unit time criterion for which the existence of an equilibrium policy is established under a number of recurrency conditions with respect to the transition probability matrices associated with the stationary policies. These results are obtained by establishing the existence of total discounted return equilibrium policies, for each discount factor α ∈ [0, 1) and by showing that under each one of the aforementioned recurrency conditions, average return equilibrium policies appear as limit policies of sequences of discounted return equilibrium policies, with discount factor tending to one. Finally, we review and extend the results that are known for the case where both the state space and the action spaces are finite.
27
Lloyd S. Shapley · Proceedings of the National Academy of Sciences · 1953 · 2.4K citations · Full text
Discounted Dynamic Programming
David Blackwell · The Annals of Mathematical Statistics · 1965 · 947 citations · Full text
David Blackwell · The Annals of Mathematical Statistics · 1962 · 834 citations
Business, Economics, Mathematics +13