Concepedia

Finite-state Markov Chains

Finite-State Markov Chains is a stochastic process belonging to the class of Markov chains characterized by a discrete state space of finite cardinality, where the future state depends solely on the current state and not on the sequence of preceding states.

1.1K

Publications

75.6K

Citations

1.8K

Authors

770

Institutions

Publications per year

2017–2026

89

Variants

Finite-state Markov Chain

Parents

Publications

1.1K

Statistical Inference for Probabilistic Functions of Finite State Markov Chains

Leonard E. Baum, Ted Petrie · The Annals of Mathematical Statistics · 1966 · 2.8K citations · Full text

, , +15

Three models for the description of language

Noam Chomsky · IEEE Transactions on Information Theory · 1956 · 2.8K citations

, , +17

Finite-state Markov channel-a useful model for radio communication channels

Hong Shen Wang, Nader Moayeri · IEEE Transactions on Vehicular Technology · 1995 · 1.7K citations

, , +16

Finite state markov-chain approximations to univariate and vector autoregressions

George Tauchen · Economics Letters · 1986 · 1.6K citations

, , +10

The Optimal Control of Partially Observable Markov Processes over a Finite Horizon

Richard D. Smallwood, Edward J. Sondik · Operations Research · 1973 · 1.5K citations

, , +17

1–5 of 1.1K

Authors

1.8K

  1. VK
    Vikram Krishnamurthy

    University of British Columbia, Canada

    16 publications · 892 citations

    14

    h-index

  2. RL
    Richard L. Tweedie

    Colorado State University, United States

    13 publications · 988 citations

    11

    h-index

  3. PW
    Peter W. Glynn

    Stanford University, United States

    11 publications · 645 citations

    11

    h-index

  4. GY
    George Yin

    Wayne State University, United States

    8 publications · 571 citations

    8

    h-index

  5. AD
    Arnaud Doucet

    University of Cambridge, United Kingdom

    8 publications · 1.1K citations

    8

    h-index

1–5 of 1.8K

Institutions

770

  1. Stanford University

    Stanford, United States

    16 h-index

    29 publications

    4.3K citations

  2. University of California, Berkeley

    Berkeley, United States

    15 h-index

    20 publications

    1.3K citations

  3. Massachusetts Institute of Technology

    Cambridge, United States

    15 h-index

    25 publications

    4.3K citations

  4. University of Southern California

    Los Angeles, United States

    14 h-index

    35 publications

    1.2K citations

  5. Australian National University

    Canberra, Australia

    13 h-index

    23 publications

    2.6K citations

  6. University of British Columbia

    Vancouver, Canada

    13 h-index

    23 publications

    897 citations

  7. Technion – Israel Institute of Technology

    Haifa, Israel

    13 h-index

    20 publications

    1.7K citations

  8. University of Michigan

    Ann Arbor, United States

    13 h-index

    29 publications

    1.7K citations

1–8 of 770

Venues

  1. Journal of Applied Probability

    JAP · 61 publications · 3K citations

    28

    h-index

  2. Advances in Applied Probability

    AAP · 43 publications · 2.3K citations

    25

    h-index

  3. IEEE Transactions on Automatic Control

    32 publications · 2.1K citations

    24

    h-index

  4. IEEE Transactions on Information Theory

    36 publications · 5.8K citations

    24

    h-index

  5. The Annals of Mathematical Statistics

    27 publications · 5K citations

    19

    h-index

1–5