Natural SciencesComputer ScienceMathematicsInformation TheoryProbability TheoryStatisticsComputational StatisticsInferential StatisticsProbability ConceptsSignal Detection TheoryStatistical AnalysisStatistical InferenceInformation-theoretic CapacityMax-entropyStatistical Decision Theory
The main theorems in information theory and statistics are put in context, the differences are discussed, and some of the open research problems are mentioned. The author demonstrates some of the points of intersection of information theory and statistics, and discuss some problems in physics and computer science that require a rigorous probabilistic treatment.
3
Information theoretic inequalities
Amir Dembo, Thomas M. Cover, J. Thomas · IEEE Transactions on Information Theory · 1991 · 757 citations
Entropy and the Central Limit Theorem
Andrew R. Barron · The Annals of Probability · 1986 · 375 citations · Full text