Value iteration in average cost Markov control processes on Borel spaces

Real Analysis and Probability.

Kenneth A. Ross, R. Ash · American Mathematical Monthly · 1975 · 735 citations

Natural Sciences, Mathematics, Probability Theory +11

Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey

Ari Arapostathis, Vivek S. Borkar, E. Fernández-Gaucherand et al. · SIAM Journal on Control and Optimization · 1993 · 610 citations · Full text

Engineering, Industrial Engineering, Markov Decision Processes +16

Adaptive Markov control processes

Onésimo Hernández–Lerma · European Journal of Operational Research · 1990 · 386 citations · Full text

Engineering, Computer Science, Dynamical Systems +6

Controlled Markov processes

Gian‐Carlo Rota · Advances in Mathematics · 1983 · 282 citations

Dynamic programming, Markov chains, and the method of successive approximations

D. J. White · Journal of Mathematical Analysis and Applications · 1963 · 221 citations

Computing, Computer Science, Mathematics +15