Publication | Closed Access
Hitting time in a finite non-homogeneous Markov chain with applications
19
Citations
2
References
1998
Year
Stochastic Hybrid SystemReliability EngineeringEngineeringDiscrete Dynamical SystemStochastic ProcessesHitting TimeMean Hitting TimeSurvivor FunctionMarkov KernelSystems EngineeringStochastic Dynamical SystemMarkov Decision ProcessesProbability TheorySystem ReliabilityFluid QueueMarkov Decision Process
This paper deals with the computation of the hitting time for a non-homogeneous discrete time Markov chain (NHDTMC or NHMC). We first give the basic definitions of NHMC, then we analyse the hitting time and its survivor function. We also give the sufficient conditions for the existence of the mean hitting time. Finally, a numerical example and an application of this development in reliability evaluation are given in order to illustrate our results. © 1998 John Wiley & Sons, Ltd.
| Year | Citations | |
|---|---|---|
Page 1
Page 1