Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1984 · 1.4K citations · 41 references
Natural SciencesBiostatisticsEconometricsPsychometricsStatisticsHypothesis TestingInferential StatisticsPower AnalysisStatistical AnalysisStatistical InferenceAsymptotic Distribution TheoryAsymptotic NormalityGoodness-of-fitGoodness-of-fit TestingGoodness-of-fit TestsLikelihood Ratio TestingLikelihood Ratio TestsLog-likelihood Ratio
SUMMARY This article investigates the family {I λ;λ ϵ ℝ} of power divergence statistics for testing the fit of observed frequencies {Xi; i = 1, …, k} to expected frequencies {Ei; i = 1, …, k}. From the definition 2nIλ=2λ(λ+1)∑i=1kXi{(XiEi)λ−1};λ∈ℝ it can easily be seen that Pearson's X 2 (λ = 1), the log likelihood ratio statistic (λ = 0), the Freeman-Tukey statistic (λ = –½) the modified log likelihood ratio statistic (λ = –1) and the Neyman modified X 2 (λ = –2), are all special cases. Most of the work presented is devoted to an analytic study of the asymptotic difference between different I λ however finite sample results have been presented as a check and a supplement to our conclusions. A new goodness-of-fit statistic, where λ = ⅔, emerges as an excellent and compromising alternative to the old warriors, I 0 and I 1.
41
On Measures of Entropy and Information
A. Rényi · Project Euclid (Cornell University) · 1961 · 4K citations
Karl Pearson · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · 1900 · 4K citations
Information Theory and Statistics.
Meyer Dwass, S. Kullback · American Mathematical Monthly · 1960 · 1.5K citations