Markov Renewal Processes: Definitions and Preliminary Properties

Abstract

This paper contains the definition of and some preliminary results on Markov Renewal processes and Semi-Markov processes. The close relationship between these two types of processes is described. The concept of regularity is introduced and characterized. A classification of the states of a Markov Renewal process is described and studied.