Concepedia

Markov Decision Processes

A Markov decision process is a mathematical framework for sequential decision-making under uncertainty in which future states depend solely on the current state and chosen action, enabling the optimization of decision policies over time.

21.5K

Publications

1.3M

Citations

38.4K

Authors

5.2K

Institutions

Publications per year

2017–2026

8.1K

Variants

Markov Decision ProcessMdp

Parents

Children

Publications

21.5K

Human-level control through deep reinforcement learning

Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations

, , +8

Reinforcement Learning: An Introduction

Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations

, , +12

Reinforcement Learning: An Introduction

IEEE Transactions on Neural Networks · 2005 · 25.8K citations

, , +12

Reinforcement Learning: A Survey

Leslie Pack Kaelbling, Michael L. Littman, Andrew Moore · Journal of Artificial Intelligence Research · 1996 · 8.8K citations · Full text

, , +15

Reinforcement Learning: An Introduction

Jeffrey D. Johnson, Jinghong Li, Zengshi Chen · Neurocomputing · 2000 · 8.7K citations

, , +12

1–5 of 21.5K

Authors

38.4K

  1. ML
    Michael L. Littman

    Rutgers, The State University of New Jersey, United States

    63 publications · 20.6K citations

    44

    h-index

  2. SL
    Sergey Levine

    University of California, Berkeley, United States

    61 publications · 6.1K citations

    39

    h-index

  3. SM
    Shie Mannor

    Technion – Israel Institute of Technology, Israel

    73 publications · 4.8K citations

    37

    h-index

  4. CB
    Craig Boutilier

    University of Toronto, Canada

    54 publications · 7.4K citations

    36

    h-index

  5. PA
    Pieter Abbeel

    University of California, Berkeley, United States

    46 publications · 8.2K citations

    32

    h-index

1–5 of 38.4K

Institutions

5.2K

  1. Stanford University

    Stanford, United States

    85 h-index

    577 publications

    51K citations

  2. Carnegie Mellon University

    Pittsburgh, United States

    80 h-index

    620 publications

    59.5K citations

  3. University of California, Berkeley

    Berkeley, United States

    77 h-index

    517 publications

    39.8K citations

  4. Tsinghua University

    Beijing, China

    70 h-index

    956 publications

    55.5K citations

  5. Massachusetts Institute of Technology

    Cambridge, United States

    70 h-index

    604 publications

    43K citations

  6. University of Michigan

    Ann Arbor, United States

    64 h-index

    515 publications

    25.5K citations

  7. University of Toronto

    Toronto, Canada

    63 h-index

    388 publications

    31.2K citations

  8. University of British Columbia

    Vancouver, Canada

    61 h-index

    328 publications

    26K citations

1–8 of 5.2K

Venues

  1. arXiv (Cornell University)

    Repository · 1.2K publications · 63.7K citations

    114

    h-index

  2. Operations Research

    290 publications · 22.3K citations

    85

    h-index

  3. European Journal of Operational Research

    326 publications · 15.5K citations

    66

    h-index

  4. Management Science

    163 publications · 13K citations

    63

    h-index

  5. IEEE Transactions on Automatic Control

    219 publications · 17.2K citations

    62

    h-index

1–5

See also

Markov Decision Processes

Core Methods

Variants

Applications

Evaluation

Limitations