Journal of the American Statistical Association · 2014 · 23 citations · 32 references
ComputingBiostatisticsBayesian Data AnalysisStatistical ModelingUncertainty QuantificationBayesian InferenceBayesian Model AveragingBayesian ModelingBayesian StatisticsPrior SpecificationStatistical InferenceBayesian AnalysisBayesian Model SelectionConsistencyLinear RegressionObjective Bayesian AnalysisPosterior Distribution EstimationPriors For Model Selection
In this article, we present a fully coherent and consistent objective Bayesian analysis of the linear regression model using intrinsic priors. The intrinsic prior is a scaled mixture of <i>g</i>-priors and promotes shrinkage toward the subspace defined by a base (or null) model. While it has been established that the intrinsic prior provides consistent model selectors across a range of models, the posterior distribution of the model parameters has not previously been investigated. We prove that the posterior distribution of the model parameters is consistent under both model selection and model averaging when the number of regressors is fixed. Further, we derive tractable expressions for the intrinsic posterior distribution as well as sampling algorithms for both a selected model and model averaging. We compare the intrinsic prior to other mixtures of <i>g</i>-priors and provide details on the consistency properties of modified versions of the Zellner–Siow prior and hyper <i>g</i>-priors. Supplementary materials for this article are available online.
32
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Arthur E. Hoerl, Robert W. Kennard · Technometrics · 1970 · 8.9K citations
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Arthur E. Hoerl, Robert W. Kennard · Technometrics · 2000 · 6.6K citations
Trevor Park, George Casella · Journal of the American Statistical Association · 2008 · 3K citations