A new method for measuring uncertainty and fuzziness in rough set theory

Abstract

Based on the complement behavior of information gain, a new definition of information entropy is proposed along with its justification in rough set theory. Some properties of this definition imply those of Shannon's entropy. Based on the new information entropy, conditional entropy and mutual information are then introduced and applied to knowledge bases. The new information entropy is proved to also be a fuzzy entropy. Keywords: Rough SetsInformation EntropyUncertaintyFuzzinessRough ClassificationData Analysis