SIAM Journal on Control and Optimization · 1997 · 27 citations · 34 references
Social SciencesMathematicsDynamical SystemsGame TheoryStochastic ProcessesApproximation AlgorithmsStochastic ControlStochastic GamesZero-sum GamesOptimal PoliciesPursuitSaddle Point ProblemsState-space StructureZero-sum Differential GamesZero-sum Stochastic Games
We pursue in this paper our study of approximations of values and $\epsilon$-saddle-point policies in dynamic zero-sum games. After extending the general theorem for approximation, we study zero-sum stochastic games with countable state space and unbounded immediate reward. We focus on the expected average payoff criterion. We use some tools developed in [M. M. Tidball and E. Altman, SIAM J. Control Optim., 34 (1996), pp. 311--328] to obtain the convergence of the values as well as the convergence of the $\epsilon$ saddle-point policies in various approximation problems. We consider several schemes of truncation of the state space (e.g., finite state approximation) and approximations of games with discount factor close to one for the game with expected average cost. We use the extension of the general theorem for approximation to study approximations in stochastic games with complete information. Finally, we consider the problem of approximating the sets of policies. We obtain some general results that we apply to a pursuit evasion differential game.
34
Lloyd S. Shapley · Proceedings of the National Academy of Sciences · 1953 · 2.4K citations · Full text
The Asymptotic Theory of Stochastic Games
Truman F. Bewley, Elon Kohlberg · Mathematics of Operations Research · 1976 · 235 citations
David Blackwell, Thomas S. Ferguson · The Annals of Mathematical Statistics · 1968 · 221 citations · Full text
Approximations of Dynamic Programs, I
Ward Whitt · Mathematics of Operations Research · 1978 · 212 citations