Concepedia

Discrete-time Markov Processes

Discrete-Time Markov Processes is a stochastic process in which the future state depends only on the present state and not on the sequence of preceding states, evolving over discrete time steps according to a fixed set of probabilistic transition rules.

976

Publications

62.7K

Citations

2K

Authors

815

Institutions

Publications per year

2017–2026

191

Variants

Discrete-time Markov Process

Parents

Publications

976

A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle

James D. Hamilton · Econometrica · 1989 · 9.7K citations

, , +17

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Laurence A. Baxter, Martin L. Puterman · Technometrics · 1995 · 1.9K citations

, , +13

The Optimal Control of Partially Observable Markov Processes over a Finite Horizon

Richard D. Smallwood, Edward J. Sondik · Operations Research · 1973 · 1.5K citations

, , +17

Performance models of statistical multiplexing in packet video communications

Dimitris Anastassiou, P. K. Sen, Gunnar Karlsson et al. · IEEE Transactions on Communications · 1988 · 984 citations · Full text

, , +17

Discrete random signals and statistical signal processing

Miloslav Vošvrda · Automatica · 1993 · 811 citations

, , +14

1–5 of 976

Authors

2K

  1. OC
    O.L.V. Costa

    Universidade de São Paulo, Brazil

    10 publications · 463 citations

    10

    h-index

  2. GY
    George Yin

    Wayne State University, United States

    8 publications · 870 citations

    8

    h-index

  3. FD
    François Dufour

    Institut de Mathématiques de Bordeaux, France

    8 publications · 127 citations

    8

    h-index

  4. LZ
    Lixian Zhang

    Harbin Institute of Technology, China

    7 publications · 1.2K citations

    7

    h-index

  5. JC
    José C. Geromel

    Universidade Estadual de Campinas (UNICAMP), Brazil

    7 publications · 352 citations

    7

    h-index

1–5 of 2K

Institutions

815

  1. Institut national de recherche en sciences et technologies du numérique

    Le Chesnay-Rocquencourt, France

    12 h-index

    26 publications

    792 citations

  2. Centre National de la Recherche Scientifique

    Paris, France

    12 h-index

    21 publications

    975 citations

  3. University of Illinois Urbana-Champaign

    Urbana, United States

    12 h-index

    24 publications

    1.7K citations

  4. Stanford University

    Stanford, United States

    12 h-index

    19 publications

    5.4K citations

  5. University of Padua

    Padua, Italy

    11 h-index

    16 publications

    606 citations

  6. University of British Columbia

    Vancouver, Canada

    11 h-index

    17 publications

    1.3K citations

  7. Universidade Estadual de Campinas (UNICAMP)

    Campinas, Brazil

    11 h-index

    27 publications

    839 citations

  8. Politecnico di Milano

    Milan, Italy

    11 h-index

    24 publications

    2.9K citations

1–8 of 815

Venues

  1. IEEE Transactions on Automatic Control

    32 publications · 3K citations

    23

    h-index

  2. Journal of Applied Probability

    JAP · 46 publications · 2K citations

    21

    h-index

  3. IEEE Transactions on Wireless Communications

    18 publications · 1K citations

    17

    h-index

  4. Advances in Applied Probability

    AAP · 21 publications · 1.3K citations

    16

    h-index

  5. IEEE Transactions on Communications

    18 publications · 1.4K citations

    14

    h-index

1–5