Transactions of the American Mathematical Society · 1952 · 171 citations · 8 references
EngineeringMathematicsDiscrete MathematicsProbability TheoryStochastic ProcessesErgodic TheoryFirst Passage TimesMarkov ChainsMarkov ProcessesRandom WalksFirst-passage ProblemsLimiting ConditionsRandom Walk Limit TheoremsRandom Walk ModelsRecurrenceState Transition ProbabilitiesTransition ProbabilitiesTransition Probability Models
designated by 0, 1, 2, • • • , and with transition probabilities independent of time. Letting xo, xu ■ ■ ■ be the states after 0, 1, • • • steps, we define (1.1) PM(i,j) = P(xn =j\\x0=i), n- 0, 1,. • •, where P(^4|ß) stands for the conditional probability of A, given B. We as-
8
Richard Otter · The Annals of Mathematical Statistics · 1949 · 209 citations · Full text
Recurrence times for the Ehrenfest model
Richard Bellman, T. E. Harris · Pacific Journal of Mathematics · 1951 · 65 citations · Full text