Journal of the American Statistical Association · 2013 · 374 citations · 49 references
Natural SciencesBiostatisticsStatistical LearningStatistical ModelingStatisticsBootstrap MethodsEstimation TheoryInferential StatisticsModel SelectionResampling MethodsStatistical InferenceBaggingBootstrap Confidence IntervalsBootstrap EstimationBootstrap Model SelectionBootstrap Standard ErrorsNonparametric Confidence IntervalsRegression Model SelectionSmoothing
Classical statistical theory neglects the impact of model selection on estimation accuracy. The study examines bootstrap methods that incorporate model selection when estimating standard errors and confidence intervals. The authors use bootstrap smoothing (bagging) to derive a new formula for the accuracy of smoothed estimators, illustrated with nonparametric and parametric regression examples involving Cp-selected degrees and Lasso estimation.
Classical statistical theory ignores model selection in assessing estimation accuracy. Here we consider bootstrap methods for computing standard errors and confidence intervals that take model selection into account. The methodology involves bagging, also known as bootstrap smoothing, to tame the erratic discontinuities of selection-based estimators. A useful new formula for the accuracy of bagging then provides standard errors for the smoothed estimators. Two examples, nonparametric and parametric, are carried through in detail: a regression model where the choice of degree (linear, quadratic, cubic, …) is determined by the Cp criterion and a Lasso-based estimation problem.
49
Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
Adam G. Riess, A. V. Filippenko, P. Challis et al. · The Astronomical Journal · 1998 · 19.5K citations · Full text
Natural Sciences, Astronomy, Physics +14
Measurements of Ω and Λ from 42 High‐Redshift Supernovae
S. Perlmutter, G. Aldering, G. Goldhaber et al. · The Astrophysical Journal · 1999 · 17.9K citations · Full text
Natural Sciences, Astronomy, Physics +13
Bootstrap Methods: Another Look at the Jackknife
B. Efron · The Annals of Statistics · 1979 · 17.4K citations · Full text
Leo Breiman · Machine Learning · 1996 · 17K citations · Full text