Concepedia

Constrained Markov Decision Processes

Constrained Markov Decision Processes is a class of Markov decision process models for sequential stochastic control in which an agent optimizes an expected performance criterion (such as discounted or average reward) subject to additional constraints expressed as bounds on expected cumulative costs or risks along controlled trajectories.

336

Publications

15.4K

Citations

770

Authors

308

Institutions

Publications per year

2017–2026

154

Variants

CmdpConstrained Markov Decision ProcessFinite Markov Decision Processes

Parents

Children

Publications

336

Joint Design and Separation Principle for Opportunistic Spectrum Access in the Presence of Sensing Errors

Yunxia Chen, Qing Zhao, Ananthram Swami · IEEE Transactions on Information Theory · 2008 · 434 citations · Full text

, , +17

Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning

Hepeng Li, Zhiqiang Wan, Haibo He · IEEE Transactions on Smart Grid · 2019 · 421 citations · Full text

, , +16

Deep Reinforcement Learning for Delay-Oriented IoT Task Scheduling in SAGIN

Conghao Zhou, Wen Wu, Hongli He et al. · IEEE Transactions on Wireless Communications · 2020 · 319 citations

, , +16

Cognitive Medium Access: Constraining Interference Based on Experimental Models

Stefan Geirhofer, Lang Tong, Brian M. Sadler · IEEE Journal on Selected Areas in Communications · 2008 · 263 citations

, , +16

Joint Status Sampling and Updating for Minimizing Age of Information in the Internet of Things

Bo Zhou, Walid Saad · IEEE Transactions on Communications · 2019 · 239 citations

, , +17

1–5 of 336

Authors

770

  1. EA
    Eugene A. Feinberg

    Stony Brook University, United States

    9 publications · 514 citations

    9

    h-index

  2. AS
    Adam Shwartz

    Technion – Israel Institute of Technology, Israel

    8 publications · 376 citations

    8

    h-index

  3. EA
    Eitan Altman

    Institut national de recherche en sciences et technologies du numérique, France

    8 publications · 289 citations

    8

    h-index

  4. LT
    Lang Tong

    Cornell University, United States

    7 publications · 572 citations

    7

    h-index

  5. NB
    Ness B. Shroff

    The Ohio State University, United States

    7 publications · 171 citations

    7

    h-index

1–5 of 770

Institutions

308

  1. Tsinghua University

    Beijing, China

    19 h-index

    59 publications

    2.6K citations

  2. University of British Columbia

    Vancouver, Canada

    13 h-index

    29 publications

    1.3K citations

  3. Technion – Israel Institute of Technology

    Haifa, Israel

    10 h-index

    11 publications

    461 citations

  4. University of Michigan

    Ann Arbor, United States

    10 h-index

    16 publications

    508 citations

  5. Stony Brook University

    Stony Brook, United States

    9 h-index

    10 publications

    566 citations

  6. University of Southern California

    Los Angeles, United States

    9 h-index

    15 publications

    582 citations

  7. Institut national de recherche en sciences et technologies du numérique

    Le Chesnay-Rocquencourt, France

    8 h-index

    11 publications

    388 citations

  8. University of Maryland, College Park

    College Park, United States

    8 h-index

    13 publications

    462 citations

1–8 of 308

Venues

  1. arXiv (Cornell University)

    Repository · 27 publications · 898 citations

    15

    h-index

  2. IEEE Transactions on Automatic Control

    13 publications · 441 citations

    12

    h-index

  3. Mathematical Methods of Operations Research

    11 publications · 352 citations

    10

    h-index

  4. IEEE Transactions on Wireless Communications

    11 publications · 670 citations

    10

    h-index

  5. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 9 publications · 417 citations

    9

    h-index

1–5