IEEE Transactions on Information Theory · 2007 · 152 citations · 38 references
Natural SciencesMathematicsInformation TheoryProbability TheoryStatisticsEntropyInformation MeasuresProbability InequalitiesCentral Limit TheoremsEntropy BoundsFisher InformationFisher Information AnalysisIndependent VariablesMonotonicity ConditionsProbability Inequalities For Sums Of Random Variables
New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of n independent random variables to the information contained in sums over subsets of the random variables, for an arbitrary collection of subsets. As a consequence, a simple proof of the monotonicity of information in central limit theorems is obtained, both in the setting of independent and identically distributed (i.i.d.) summands as well as in the more general setting of independent summands with variance-standardized sums.
38
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Eric R. Ziegel, E. L. Lehmann, George Casella · Technometrics · 1999 · 4.3K citations
The Jackknife Estimate of Variance
B. Efron, C. Stein · The Annals of Statistics · 1981 · 1.5K citations
Information theoretic inequalities
Amir Dembo, Thomas M. Cover, J. Thomas · IEEE Transactions on Information Theory · 1991 · 757 citations