The American Statistician · 1988 · 261 citations · 5 references
Natural SciencesComputer ScienceMathematicsBayesian Data AnalysisProbability TheoryStatisticsBayesian Decision TheoryBayesian InferenceBayesian LearningBayesian StatisticsInformation ProcessingStatistical InferenceBayes EstimationBayes' TheoremOptimal Decision Theory
Abstract In this article statistical inference is viewed as information processing involving input information and output information. After introducing information measures for the input and output information, an information criterion functional is formulated and optimized to obtain an optimal information processing rule (IPR). For the particular information measures and criterion functional adopted, it is shown that Bayes's theorem is the optimal IPR. This optimal IPR is shown to be 100% efficient in the sense that its use leads to the output information being exactly equal to the given input information. Also, the analysis links Bayes's theorem to maximum-entropy considerations.
5
Information theory and statistics
Journal of the Franklin Institute · 1959 · 7.2K citations
Papers on probability, statistics and statistical physics
Acta Applicandae Mathematicae · 1990 · 889 citations
The Algebra of Probable Inference
G. A. Barnard, R. T. Cox · Econometrica · 1962 · 500 citations
The Algebra of Probable Inference
R. T. Cox, E. T. Jaynes · American Journal of Physics · 1963 · 233 citations