Econometrica · 1978 · 393 citations · 3 references
BusinessBiostatisticsDecision TheoryInformation TheoryStatistical ModelingGeneralized Linear ModelsModel ComparisonModel Fit AssessmentModel FittingModel SelectionRegressionDecision RulesEstimation Of Regression ModelsInformation-theoretic Model SelectionKullback-leibler DivergenceRegression Model Selection
Some decision rules for discriminating among alternative regression models are proposed and mutually compared. They are essentially based on the Akaike Information Criterion as well as the Kullback-Leibler Information Criterion (KLIC) : namely, the distance between a postulated model and the true unknown structure is measured by the KLIC. The proposed criteria combine the parsimony of parameters with the goodness of fit. Their relationships with conventional criteria are discussed in terms of a new concept of unbiasedness .
3
Information theory and statistics
Journal of the Franklin Institute · 1959 · 7.2K citations