APPROACHES FOR BAYESIAN VARIABLE SELECTION
1997 · 1.2K citations · 20 references
The paper discusses variable selection in normal linear regression, noting nonconjugate SSVS and conjugate formulations that enable analytical simplification. The study aims to describe and compare hierarchical mixture prior formulations for variable selection uncertainty in normal linear regression, examining hyperparameter settings based on practical significance and the use of mixtures with point priors. The authors employ hierarchical mixture priors, analyze hyperparameter settings, and use computational methods such as Gray Code sequencing for exhaustive evaluation in moderate problems and fast MCMC for large problems, illustrating procedures on simulated and real financial index tracking data. Rapid updating methods enable feasible exhaustive evaluation and fast MCMC exploration, improving posterior estimates of model probabilities and total visited probability, as demonstrated on simulated and real financial index tracking problems.
This paper describes and compares various hierarchical mixture prior formulations of variable selection uncertainty in normal linear regression models. These include the nonconjugate SSVS formulation of George and McCulloch (1993), as well as conjugate formulations which allow for analytical simplification. Hyperpa- rameter settings which base selection on practical significance, and the implications of using mixtures with point priors are discussed. Computational methods for pos- terior evaluation and exploration are considered. Rapid updating methods are seen to provide feasible methods for exhaustive evaluation using Gray Code sequencing in moderately sized problems, and fast Markov Chain Monte Carlo exploration in large problems. Estimation of normalization constants is seen to provide improved posterior estimates of individual model probabilities and the total visited probabil- ity. Various procedures are illustrated on simulated sample problems and on a real problem concerning the construction of financial index tracking portfolios.
20
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
Peter J. Green · Biometrika · 1995
5.9K citations
Understanding the Metropolis-Hastings Algorithm
Siddhartha Chib, Edward Greenberg · The American Statistician · 1995
3.7K citations
Markov Chains for Exploring Posterior Distributions
Luke Tierney · The Annals of Statistics · 1994
3.5K citations
Variable Selection via Gibbs Sampling
Edward I. George, Robert E. McCulloch · Journal of the American Statistical Association · 1993
Bayesian StatisticBayesian Decision TheoryMarkov Chain Monte Carlo+19
2.7K citations
Practical Markov Chain Monte Carlo
Charles J. Geyer · Statistical Science · 1992
2K citations