International Journal of Uncertainty Fuzziness and Knowledge-Based Systems · 2002 · 25 citations · 8 references
Natural SciencesMathematicsInformation TheoryProbability TheoryStochastic ProcessesEntropyMeasure-theoretic ProbabilityMeasure-theoretic EntropyShannon Entropy
The concept of entropy is an important part of the theory of additive measures. In this paper, a definition of entropy is introduced for general (not necessarily additive) measures as the infinum of the Shannon entropies of "subordinate" additive measures. Several properties of the general entropy are discussed and proved. Some of the properties require that the measure belongs to the class of so-called "equientropic" general measures introduced and studied in this paper. The definition of general entropy is extended to the countable case for which a sufficient condition of convergence is proved. We introduce a method of "conditional combination" of general measures and prove that in that case the general entropy possesses the "subset independence" property.
8
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Entropy of discrete Choquet capacities
Jean‐Luc Marichal · European Journal of Operational Research · 2002 · 118 citations · Full text
On the entropy of fuzzy measures
Ronald R. Yager · IEEE Transactions on Fuzzy Systems · 2000 · 112 citations