Journal of Applied Probability · 2001 · 50 citations · 9 references
EngineeringMathematicsProbability TheoryStochastic ProcessesTopologyIterated MapsMarkov ChainsMarkov ProcessesQueueing TheoryStochastic Differential EquationsStochastic StabilityContraction PrincipleLipschitz ConditionsLipschitz ContinuityStability Of Markov Processes
We consider Markov chains in the context of iterated random functions and show the existence and uniqueness of an invariant distribution under a local contraction condition combined with a drift condition, extending results of Diaconis and Freedman. From these we deduce various other topological stability properties of the chains. Our conditions are typically satisfied by, for example, queueing and storage models where the global Lipschitz condition used by Diaconis and Freedman normally fails.
9
Persi Diaconis, David A. Freedman · SIAM Review · 1999 · 493 citations
Gareth O. Roberts, Richard L. Tweedie · Stochastic Processes and their Applications · 1999 · 154 citations
STOCHASTICALLY RECURSIVE SEQUENCES AND THEIR GENERALIZATIONS
А. А. Боровков, Sergey Foss · 1992 · 131 citations