IMA Journal of Mathematical Control and Information · 1987 · 27 citations · 1 references
Natural SciencesPhysicsProbability TheoryStochastic ProcessesThermodynamicsEntropyInformation MeasuresSecond Law Of ThermodynamicsMeasure-theoretic EntropyRelative EntropyShannon Entropy
In this paper we use six entropy measures to calculate the loss of entropy when the life time is assumed to be truncated exponential on [0, t ) instead of exponential on [0, ∞). Numerical comparisons are made to choose an entropy that has some advantages over the other measures, in the sense that it has the smallest relative loss in entropy for this application.
1
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations