A solution to a set of fundamental equations in Markov chains

Abstract

Let a Markov chain {Xt} with stationary transition probabilities have the matrix of transition probabilities P= [pu\ (i,i = 0, 1, 2, •••)• Then we have as usual CO Z(") (»)