An overview of Renyi Entropy and some potential applications

Abstract

We introduce Renyi Entropy in this paper and review the basic associated properties that differentiate Renyi Entropy from Shannon Entropy. Theoretic and simulation examples are used to illustrate the differences between the two entropies. We suggest several potential applications of Renyi Entropy to such areas as spectral estimation and pattern recognition.