Concepedia

Occupancy Measure Formulation

Occupancy Measure Formulation is a mathematical framework in constrained Markov decision processes that characterizes the long-term frequency of state-action occupancy under a policy, distinguishing itself by enabling the transformation of dynamic programming problems into linear programs through the explicit representation of policy-induced visitation distributions.

22

Publications

1.2K

Citations

49

Authors

34

Institutions

Publications per year

2017–2026

10

Parents

Publications

22

HUOPM: High-Utility Occupancy Pattern Mining

Wensheng Gan, Jerry Chun‐Wei Lin, Philippe Fournier‐Viger et al. · IEEE Transactions on Cybernetics · 2019 · 166 citations · Full text

, , +12

Occupation measures for controlled Markov processes: characterization and optimality

Abhay G. Bhatt, Vivek S. Borkar · The Annals of Probability · 1996 · 132 citations · Full text

, , +15

The age of gossip

Augustin Chaintreau, Jean‐Yves Le Boudec, Nikodin Ristanovic · 2009 · 124 citations · Full text

, , +17

A Generic Mean Field Convergence Result for Systems of Interacting Objects

Jean‐Yves Le Boudec, David McDonald, Jochen Mundinger · 2007 · 124 citations · Full text

, , +17

Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates

Xianping Guo, Alexei Piunovskiy · Mathematics of Operations Research · 2011 · 71 citations

, , +16

1–5 of 22

Authors

49

  1. JL
    Jean‐Yves Le Boudec

    École Polytechnique Fédérale de Lausanne, Switzerland

    3 publications · 272 citations

    3

    h-index

  2. NR
    Nikodin Ristanovic

    École Polytechnique Fédérale de Lausanne, Switzerland

    2 publications · 148 citations

    2

    h-index

  3. EA
    Eitan Altman

    Institut national de recherche en sciences et technologies du numérique, France

    2 publications · 93 citations

    2

    h-index

  4. XG
    Xianping Guo

    Sun Yat-sen University, China

    2 publications · 97 citations

    2

    h-index

  5. AC
    Augustin Chaintreau

    Columbia University, United States

    2 publications · 148 citations

    2

    h-index

1–5 of 49

Institutions

34

  1. École Polytechnique Fédérale de Lausanne

    Lausanne, Switzerland

    3 h-index

    6 publications

    544 citations

  2. Technicolor (France)

    Paris, France

    2 h-index

    2 publications

    148 citations

  3. Sun Yat-sen University

    Guangzhou, China

    2 h-index

    2 publications

    97 citations

  4. Princeton University

    Princeton, United States

    1 h-index

    1 publications

    37 citations

  5. University of Surrey

    Guildford, United Kingdom

    1 h-index

    1 publications

    70 citations

  6. University of Minnesota System

    Minneapolis, United States

    1 h-index

    1 publications

    37 citations

  7. University of Liverpool

    Liverpool, United Kingdom

    1 h-index

    1 publications

    71 citations

  8. Institut national de recherche en sciences et technologies du numérique

    Le Chesnay-Rocquencourt, France

    1 h-index

    1 publications

    40 citations

1–8 of 34

Venues

  1. Mathematics of Operations Research

    4 publications · 178 citations

    4

    h-index

  2. The Annals of Applied Probability

    3 publications · 82 citations

    3

    h-index

  3. arXiv (Cornell University)

    Repository · 2 publications · 49 citations

    2

    h-index

  4. The Annals of Probability

    1 publications · 132 citations

    1

    h-index

  5. IEEE Computational Intelligence Magazine

    CIM · 1 publications · 70 citations

    1

    h-index

1–5