2010 · 207 citations · 63 references
ComputingComputer ScienceData MiningMachine LearningOptimizationFeature SelectionLarge-scale OptimizationOptimization For Machine LearningPattern RecognitionRepresentation LearningCoordinate DescentL1 RegularizationLarge-scale ClassificationOptimization For High-dimensional DataRegularization
Large-scale linear classification is widely used in many areas. The L1-regularized form can be applied for feature selection; however, its non-differentiability causes more difficulties in training. Although various optimization methods have been proposed in recent years, these have not yet been compared suitably. In this paper, we first broadly review existing methods. Then, we discuss state-of-the-art software packages in detail and propose two efficient implementations. Extensive comparisons indicate that carefully implemented coordinate descent methods are very suitable for training large document data.
63
Chih-Chung Chang, Chih‐Jen Lin · ACM Transactions on Intelligent Systems and Technology · 2011 · 41.3K citations
Bradley Efron, Trevor Hastie, Iain M. Johnstone et al. · The Annals of Statistics · 2004 · 9.5K citations · Full text