Chinese Journal of Electronics · 2015 · 18 citations · 13 references
BusinessBiostatisticsMachine LearningOptimizationStatistical LearningGeneralized Linear ModelsVariable SelectionElastic NetElastic Net RegressionLassoLasso RegressionLinear RegressionLogistic RegressionShrinkage
Variable selection is one of the most important problems in pattern recognition. In linear regression model, there are many methods can solve this problem, such as Least absolute shrinkage and selection operator (LASSO) and many improved LASSO methods, but there are few variable selection methods in generalized linear models. We study the variable selection problem in logistic regression model. We propose a new variable selection method-the logistic elastic net, prove that it has grouping effect which means that the strongly correlated predictors tend to be in or out of the model together. The logistic elastic net is particularly useful when the number of predictors (p) is much bigger than the number of observations (n). By contrast, the LASSO is not a very satisfactory variable selection method in the case when p is more larger than n. The advantage and effectiveness of this method are demonstrated by real leukemia data and a simulation study.
13
Todd R. Golub, Donna K. Slonim, Pablo Tamayo et al. · Science · 1999 · 11.6K citations
Gene Selection for Cancer Classification using Support Vector Machines
Isabelle Guyon, Jason Weston, S. Barnhill et al. · Machine Learning · 2002 · 9.8K citations · Full text
Bradley Efron, Trevor Hastie, Iain M. Johnstone et al. · The Annals of Statistics · 2004 · 9.5K citations · Full text