A NEW DIRECTED DIVERGENCE MEASURE AND ITS CHARACTERIZATION∗

Abstract

Abstract A new information-theoretic divergence measure is introduced and characterized. This new measure is related to the Kullback directed divergence but does not require the condition of absolute continuity to be satisfied by the probability distributions involved. Moreover, both the lower and upper bounds for the new measure are established in terms of the variational distance. A symmetric form of the divergence can also be defined and described by the Shannon entropy function. Other properties of the new divergences: nonnegativity, finiteness, semiboundedness, and boundedness are discussed