An Information-Theoretic Proof of the Central Limit Theorem with Lindeberg Conditions

Ju. Linnik

Theory of Probability and Its Applications · 1959 · 135 citations · 0 references

Concepts

Abstract

The proof is based on the “information functional” $l(\int_{ - \infty }^{ + \infty } {p(x)\log p(x)dx} + \tfrac{1} {2}\log {\bf D}(x))$ , $p(x)$ being the density of the random variable X. Some new dependencies between the Shannon and Fisher information quantities are established and an information theoretic interpretation of the Lindeberg condition is given.