Theory of Probability and Its Applications · 1959 · 135 citations · 0 references
Natural SciencesMathematicsInformation TheoryProbability TheoryStatisticsInformation MeasuresLimit TheoremsMutual InformationProbability DistributionsCentral Limit TheoremsFisher InformationFisher Information AnalysisInformation EntropyLindeberg-feller TheoremShannon Mutual Information
The proof is based on the “information functional” $l(\int_{ - \infty }^{ + \infty } {p(x)\log p(x)dx} + \tfrac{1} {2}\log {\bf D}(x))$ , $p(x)$ being the density of the random variable X. Some new dependencies between the Shannon and Fisher information quantities are established and an information theoretic interpretation of the Lindeberg condition is given.