Concepedia

Online Value Iteration

Online Value Iteration is a dynamic programming algorithm that incrementally updates value estimates in real-time using newly observed transitions, distinguishing it from batch or offline variants by its immediate incorporation of experience into the value function without requiring complete environment models or full iterations over the state space.

39

Publications

2.4K

Citations

107

Authors

58

Institutions

Publications per year

2017–2026

23

Parents

Publications

39

Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design

Tao Bian, Zhong‐Ping Jiang · Automatica · 2016 · 318 citations

, , +15

Optimal Tracking Control of Unknown Discrete-Time Linear Systems Using Input-Output Measured Data

Bahare Kiumarsi, Frank L. Lewis, Mohammad Bagher Naghibi Sistani et al. · IEEE Transactions on Cybernetics · 2015 · 243 citations

, , +16

Data-Driven Flotation Industrial Process Operational Optimal Control Based on Reinforcement Learning

Yi Jiang, Jialu Fan, Tianyou Chai et al. · IEEE Transactions on Industrial Informatics · 2017 · 158 citations

, , +16

An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel

Nitin Salodkar, Abhijeet Bhorkar, Abhay Karandikar et al. · IEEE Journal on Selected Areas in Communications · 2008 · 146 citations

, , +16

Reinforcement Learning-Based Cooperative Optimal Output Regulation via Distributed Adaptive Internal Model

Weinan Gao, Mohammed Mynuddin, Donald C. Wunsch et al. · IEEE Transactions on Neural Networks and Learning Systems · 2021 · 131 citations

, , +16

1–5 of 39

Authors

107

  1. FL
    Frank L. Lewis

    The University of Texas at Arlington, United States

    5 publications · 575 citations

    5

    h-index

  2. DW
    Ding Wang

    Chinese Academy of Sciences, China

    3 publications · 99 citations

    3

    h-index

  3. YJ
    Yi Jiang

    Northeastern University, China

    3 publications · 317 citations

    3

    h-index

  4. YH
    Yoon Ho Choi

    Yonsei University, South Korea

    2 publications · 24 citations

    2

    h-index

  5. WG
    Weinan Gao

    Northeastern University, China

    2 publications · 261 citations

    2

    h-index

1–5 of 107

Institutions

58

  1. Northeastern University

    Shenyang, China

    4 h-index

    16 publications

    893 citations

  2. The University of Texas at Arlington

    Arlington, United States

    4 h-index

    6 publications

    818 citations

  3. Beijing University of Technology

    Beijing, China

    3 h-index

    6 publications

    147 citations

  4. Robotics Research (United States)

    Cincinnati, United States

    2 h-index

    4 publications

    88 citations

  5. University of Virginia

    Charlottesville, United States

    2 h-index

    4 publications

    304 citations

  6. Kyonggi University

    Suwon, South Korea

    2 h-index

    2 publications

    24 citations

  7. Florida Institute of Technology

    Melbourne, United States

    2 h-index

    2 publications

    261 citations

  8. Nanjing University of Posts and Telecommunications

    Nanjing, China

    2 h-index

    4 publications

    260 citations

1–8 of 58

Venues

  1. 4

    h-index

  2. IEEE Transactions on Cybernetics

    4 publications · 479 citations

    4

    h-index

  3. Automatica

    2 publications · 338 citations

    2

    h-index

  4. European Journal of Operational Research

    1 publications · 10 citations

    1

    h-index

  5. IEEE Transactions on Vehicular Technology

    1 publications · 72 citations

    1

    h-index

1–5