Martin L. Puterman

Markov Decision Processes: Discrete Stochastic Dynamic Programming.

Kasra Hazeghi, Martin L. Puterman · Journal of the American Statistical Association · 1995 · 8.4K citations

Markov Decision Process, Engineering, Stochastic Game +15

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Laurence A. Baxter, Martin L. Puterman · Technometrics · 1995 · 1.9K citations

Engineering, Dynamic Programming, Markov Decision Processes +5

Dynamic Multipriority Patient Scheduling for a Diagnostic Resource

Jonathan Patrick, Martin L. Puterman, Maurice Queyranne · Operations Research · 2008 · 364 citations

Engineering, Diagnosis, Operations Research +19

Modified Policy Iteration Algorithms for Discounted Markov Decision Problems

Martin L. Puterman, Moon Chirl Shin · Management Science · 1978 · 235 citations

Mathematical Programming, Policy Iteration, Engineering +11

Maximum-Penalized-Likelihood Estimation for Independent and Markov- Dependent Mixture Models

Brian G. Leroux, Martin L. Puterman · Biometrics · 1992 · 217 citations

Em Algorithm, Mixture Distribution, Engineering +10