Concepedia

Discounted Dynamic Programming

Discounted Dynamic Programming is a dynamic programming framework in optimal control and reinforcement learning that computes the value function and optimal policy by iteratively applying the Bellman equation under a discounted reward criterion, distinguishing it from other dynamic programming methods through its explicit incorporation of a discount factor to weigh future rewards exponentially less than immediate ones.

64

Publications

4.6K

Citations

88

Authors

72

Institutions

Publications per year

2017–2026

4

Parents

Publications

64

Discrete Dynamic Programming

David Blackwell · The Annals of Mathematical Statistics · 1962 · 834 citations

, , +13

Contraction Mappings in the Theory Underlying Dynamic Programming

Eric V. Denardo · SIAM Review · 1967 · 466 citations

, , +13

Discrete Dynamic Programming with Sensitive Discount Optimality Criteria

Arthur F. Veinott · The Annals of Mathematical Statistics · 1969 · 261 citations · Full text

, , +14

Scheduling Independent Tasks on Parallel Processors

Michael H. Rothkopf · Management Science · 1966 · 218 citations

, , +15

On Dynamic Programming with Unbounded Rewards

Steven A. Lippman · Management Science · 1975 · 167 citations

, , +17

1–5 of 64

Authors

88

  1. DP
    Dimitri P. Bertsekas

    Massachusetts Institute of Technology, United States

    4 publications · 206 citations

    4

    h-index

  2. HY
    Huizhen Yu

    Massachusetts Institute of Technology, United States

    3 publications · 156 citations

    3

    h-index

  3. AS
    Andrzej S. Nowak

    University of Zielona Góra, Poland

    3 publications · 77 citations

    3

    h-index

  4. DL
    Derong Liu

    Chinese Academy of Sciences, China

    3 publications · 140 citations

    3

    h-index

  5. DW
    Ding Wang

    Chinese Academy of Sciences, China

    3 publications · 140 citations

    3

    h-index

1–5 of 88

Institutions

72

  1. Massachusetts Institute of Technology

    Cambridge, United States

    5 h-index

    6 publications

    463 citations

  2. Stanford University

    Stanford, United States

    3 h-index

    3 publications

    184 citations

  3. University of Science and Technology Beijing

    Beijing, China

    3 h-index

    3 publications

    140 citations

  4. University of Zielona Góra

    Zielona Góra, Poland

    3 h-index

    5 publications

    128 citations

  5. University of Illinois Chicago

    Chicago, United States

    3 h-index

    3 publications

    221 citations

  6. Laboratoire Lorrain de Recherche en Informatique et ses Applications

    Nancy, France

    2 h-index

    2 publications

    55 citations

  7. Eindhoven University of Technology

    Eindhoven, The Netherlands

    2 h-index

    2 publications

    82 citations

  8. University of Turin

    Turin, Italy

    2 h-index

    2 publications

    56 citations

1–8 of 72

Venues

  1. Management Science

    5 publications · 578 citations

    5

    h-index

  2. Mathematics of Operations Research

    5 publications · 387 citations

    5

    h-index

  3. Economic Theory

    4 publications · 131 citations

    4

    h-index

  4. Operations Research Letters

    3 publications · 51 citations

    3

    h-index

  5. arXiv (Cornell University)

    Repository · 3 publications · 138 citations

    3

    h-index

1–5