Concepedia

Discounted Temporal-difference Learning

Discounted Temporal-Difference Learning is a temporal-difference learning method that updates value estimates based on the discounted difference between subsequent predictions, incorporating a discount factor to weigh future rewards exponentially less than immediate ones.

54

Publications

5.9K

Citations

127

Authors

71

Institutions

Publications per year

2017–2026

15

Parents

Publications

54

Temporal Difference Models and Reward-Related Learning in the Human Brain

John P. O’Doherty, Peter Dayan, Karl Friston et al. · Neuron · 2003 · 1.5K citations · Full text

, , +16

An analysis of temporal-difference learning with function approximation

John N. Tsitsiklis, Benjamin Van Roy · IEEE Transactions on Automatic Control · 1997 · 1.2K citations · Full text

, , +17

Practical issues in temporal difference learning

Gerald Tesauro · Machine Learning · 1992 · 800 citations · Full text

, , +7

Dissociable neural representations of future reward magnitude and delay during temporal discounting

Kacey Ballard, Brian Knutson · NeuroImage · 2008 · 462 citations · Full text

, , +16

Evolutionary Function Approximation for Reinforcement Learning

Shimon Whiteson, Peter Stone · 2006 · 238 citations

, , +11

1–5 of 54

Authors

127

  1. HY
    Huizhen Yu

    Massachusetts Institute of Technology, United States

    7 publications · 153 citations

    7

    h-index

  2. BV
    Benjamin Van Roy

    Stanford University, United States

    3 publications · 1.4K citations

    3

    h-index

  3. JN
    John N. Tsitsiklis

    Massachusetts Institute of Technology, United States

    3 publications · 1.4K citations

    3

    h-index

  4. RA
    Ron Amit

    Technion – Israel Institute of Technology, Israel

    2 publications · 32 citations

    2

    h-index

  5. KC
    Kamil Ciosek

    University of Oxford, United Kingdom

    2 publications · 32 citations

    2

    h-index

1–5 of 127

Institutions

71

  1. Technion – Israel Institute of Technology

    Haifa, Israel

    4 h-index

    8 publications

    478 citations

  2. University of Alberta

    Edmonton, Canada

    3 h-index

    6 publications

    165 citations

  3. Massachusetts Institute of Technology

    Cambridge, United States

    3 h-index

    6 publications

    2.8K citations

  4. The University of Tokyo

    Tokyo, Japan

    2 h-index

    3 publications

    170 citations

  5. Dalle Molle Institute for Artificial Intelligence Research

    Lugano, Switzerland

    2 h-index

    5 publications

    72 citations

  6. Microsoft Research (United Kingdom)

    Cambridge, United Kingdom

    2 h-index

    2 publications

    32 citations

  7. University College London

    London, United Kingdom

    2 h-index

    7 publications

    7.7K citations

  8. IBM Research - Thomas J. Watson Research Center

    Yorktown Heights, United States

    2 h-index

    2 publications

    839 citations

1–8 of 71

Venues

  1. arXiv (Cornell University)

    Repository · 8 publications · 171 citations

    8

    h-index

  2. Machine Learning

    3 publications · 874 citations

    3

    h-index

  3. NeuroImage

    2 publications · 501 citations

    2

    h-index

  4. Journal of Machine Learning Research

    JMLR · 2 publications · 46 citations

    2

    h-index

  5. bioRxiv (Cold Spring Harbor Laboratory)

    Repository · 1 publications · 14 citations

    1

    h-index

1–5