Concepedia

Least-squares Temporal-difference Learning

Least-Squares Temporal-Difference Learning is a value function approximation method that minimizes the Bellman error of temporal-difference updates in a least-squares sense through linear regression, distinguishing itself from other temporal-difference algorithms by solving for parameter updates analytically rather than incrementally.

44

Publications

3.6K

Citations

90

Authors

53

Institutions

Publications per year

2017–2026

9

Variants

Lstd

Parents

Publications

44

Practical issues in temporal difference learning

Gerald Tesauro · Machine Learning · 1992 · 800 citations · Full text

, , +7

Linear Least-Squares algorithms for temporal difference learning

Steven J. Bradtke, Andrew G. Barto · Machine Learning · 1996 · 639 citations · Full text

, , +8

Technical Update: Least-Squares Temporal Difference Learning

Justin A. Boyan · Machine Learning · 2002 · 299 citations · Full text

, , +6

Kernel-Based Least Squares Policy Iteration for Reinforcement Learning

Xin Xu, Dewen Hu, Xicheng Lu · IEEE Transactions on Neural Networks · 2007 · 268 citations

, , +16

Least-Squares Temporal Difference Learning

Justin A. Boyan · 1999 · 262 citations

, , +15

1–5 of 44

Authors

90

  1. MG
    Mohammad Ghavamzadeh

    Adobe Systems (United States), United States

    5 publications · 333 citations

    5

    h-index

  2. IC
    Ioannis Ch. Paschalidis

    Boston University, United States

    3 publications · 63 citations

    3

    h-index

  3. CS
    Csaba Szepesvári

    University of Alberta, Canada

    3 publications · 178 citations

    3

    h-index

  4. XX
    Xin Xu

    National University of Defense Technology, China

    3 publications · 419 citations

    3

    h-index

  5. SJ
    Steven J. Bradtke

    University of Massachusetts Amherst, United States

    2 publications · 664 citations

    2

    h-index

1–5 of 90

Institutions

53

  1. University of Alberta

    Edmonton, Canada

    4 h-index

    6 publications

    352 citations

  2. Boston University

    Boston, United States

    3 h-index

    9 publications

    189 citations

  3. National University of Defense Technology

    Changsha, China

    3 h-index

    7 publications

    1.2K citations

  4. Duke University

    Durham, United States

    2 h-index

    3 publications

    279 citations

  5. Beijing University of Chemical Technology

    Beijing, China

    2 h-index

    7 publications

    124 citations

  6. Centre Inria de l'Université de Lille

    Villeneuve-d'Ascq, France

    2 h-index

    4 publications

    255 citations

  7. Institut national de recherche en sciences et technologies du numérique

    Le Chesnay-Rocquencourt, France

    2 h-index

    4 publications

    255 citations

  8. IBM Research - Thomas J. Watson Research Center

    Yorktown Heights, United States

    2 h-index

    2 publications

    839 citations

1–8 of 53

Venues

  1. Machine Learning

    4 publications · 1.5K citations

    4

    h-index

  2. arXiv (Cornell University)

    Repository · 3 publications · 97 citations

    3

    h-index

  3. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 2 publications · 21 citations

    2

    h-index

  4. 2

    h-index

  5. PolyPublie (École Polytechnique de Montréal)

    Repository · 2 publications · 167 citations

    2

    h-index

1–5