Publication | Closed Access
The evolution of the theory of non-homogeneous Markov systems
63
Citations
0
References
1997
Year
Stochastic Hybrid SystemMarkov ChainsEngineeringNon-homogeneous Semi-markov SystemsStochastic Process NhmsNatural SciencesStochastic ProcessesMarkov ProcessesMarkov KernelStochastic Dynamical SystemDiscrete Dynamical SystemInteracting Particle SystemStochastic SystemProbability TheoryStochastic PhenomenonNon-homogeneous Markov Systems
A review of the evolution of the theory of non-homogeneous Markov systems (NHMSs) is given. It starts with the definition of the stochastic process NHMS, discusses the variability of the process and provides as examples some real applications of the theory. Then, important novel ideas and basic theorems are presented on: (i) the asymptotic behaviour of NHMSs; (ii) control theory; (iii) cyclic behaviour; (iv) physics of populations: stability, entropy, energy; (v) non-homogeneous semi-Markov systems; (vi) the NHMS in a stochastic environment. © 1998 John Wiley & Sons, Ltd.