Journal of the American Statistical Association · 2007 · 356 citations · 22 references
ComputingBiostatisticsMathematicsMachine LearningOptimizationStatistical LearningApproximation AlgorithmsMaximum Likelihood EstimationParameter EstimationAdaptive LassoAsymptotic TheoryLassoLeast Squares ApproximationLeast Squares ProblemsLinear ModelsOrdinary Least SquaresQuantile Regression
We propose a method of least squares approximation (LSA) for unified yet simple LASSO estimation. Our general theoretical framework includes ordinary least squares, generalized linear models, quantile regression, and many others as special cases. Specifically, LSA can transfer many different types of LASSO objective functions into their asymptotically equivalent least squares problems. Thereafter, the standard asymptotic theory can be established and the LARS algorithm can be applied. In particular, if the adaptive LASSO penalty and a Bayes information criterion–type tuning parameter selector are used, the resulting LSA estimator can be as efficient as the oracle. Extensive numerical studies confirm our theory.
22
Todd R. Golub, Donna K. Slonim, Pablo Tamayo et al. · Science · 1999 · 11.6K citations
Bradley Efron, Trevor Hastie, Iain M. Johnstone et al. · The Annals of Statistics · 2004 · 9.5K citations · Full text
The Adaptive Lasso and Its Oracle Properties
Hui Zou · Journal of the American Statistical Association · 2006 · 7.6K citations