Concepedia

Discrete-time Dynamic Programming

Discrete-Time Dynamic Programming is a mathematical optimization method that distinguishes itself by solving sequential decision-making problems through recursive value functions defined over discrete time intervals, thereby enabling optimal policy computation in systems with discrete state and action spaces.

159

Publications

23.3K

Citations

307

Authors

171

Institutions

Publications per year

2017–2026

33

Parents

Publications

159

Markov Decision Processes: Discrete Stochastic Dynamic Programming.

Kasra Hazeghi, Martin L. Puterman · Journal of the American Statistical Association · 1995 · 8.5K citations

, , +14

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Laurence A. Baxter, Martin L. Puterman · Technometrics · 1995 · 1.9K citations

, , +13

Using dynamic programming for solving variational problems in vision

Amir A. Amini, Terry E. Weymouth, Ramesh Jain · IEEE Transactions on Pattern Analysis and Machine Intelligence · 1990 · 1K citations

, , +16

Discrete Dynamic Programming

David Blackwell · The Annals of Mathematical Statistics · 1962 · 834 citations

, , +13

A generic dynamic programming Matlab function

Olle Sundström, Lino Guzzella · 2009 · 607 citations

, , +16

1–5 of 159

Authors

307

  1. QW
    Qinglai Wei

    Chinese Academy of Sciences, China

    15 publications · 1.4K citations

    15

    h-index

  2. DL
    Derong Liu

    Chinese Academy of Sciences, China

    13 publications · 1.3K citations

    12

    h-index

  3. RS
    Ruizhuo Song

    University of Science and Technology Beijing, China

    6 publications · 624 citations

    6

    h-index

  4. EV
    Eric V. Denardo

    Yale University, United States

    4 publications · 680 citations

    4

    h-index

  5. FL
    Frank L. Lewis

    The University of Texas at Arlington, United States

    3 publications · 282 citations

    3

    h-index

1–5 of 307

Institutions

171

  1. Chinese Academy of Sciences

    Beijing, China

    17 h-index

    41 publications

    4K citations

  2. Shandong Institute of Automation

    Jinan, China

    12 h-index

    29 publications

    3K citations

  3. University of Science and Technology Beijing

    Beijing, China

    8 h-index

    15 publications

    1.2K citations

  4. University of Chinese Academy of Sciences

    Beijing, China

    7 h-index

    16 publications

    1.2K citations

  5. Beijing Academy of Artificial Intelligence

    Beijing, China

    6 h-index

    18 publications

    1.4K citations

  6. Institute of Automation

    Beijing, China

    6 h-index

    16 publications

    1K citations

  7. Northeastern University

    Shenyang, China

    5 h-index

    11 publications

    1K citations

  8. Georgia Institute of Technology

    Atlanta, United States

    5 h-index

    12 publications

    379 citations

1–8 of 171

Venues

  1. IEEE Transactions on Automatic Control

    9 publications · 628 citations

    9

    h-index

  2. 7

    h-index

  3. The Annals of Mathematical Statistics

    6 publications · 1.4K citations

    6

    h-index

  4. Mathematics of Operations Research

    5 publications · 710 citations

    5

    h-index

  5. IEEE Transactions on Cybernetics

    4 publications · 529 citations

    4

    h-index

1–5