Augmented truncations of infinite stochastic matrices

Abstract

We consider the problem of approximating the stationary distribution of a positive-recurrent Markov chain with infinite transition matrix P , by stationary distributions computed from ( n × n ) stochastic matrices formed by augmenting the entries of the ( n × n ) northwest corner truncations of P , as n →∞.