2009 · 72 citations · 9 references
ComputingComputer ScienceData MiningFeature EngineeringMachine LearningClassificationFeature ExtractionFeature SelectionPattern RecognitionRepresentation LearningSupport Vector MachinesFeature LearningFeature Selection For ClassificationLeast Squares Support Vector MachinesMulticlass Support Vector MachinesPruningSupport Vector ClassificationSupport Vector Machine ClassificationSvms
In this paper, a new feature selection method with applications to handwritten digit recognition is proposed. This method is based on recursive feature elimination (RFE) in least squares support vector machines (LS-SVM). Digit recognition is achieved by one-against-all LS-SVMs. The RFE method is adapted to multi-class classification in two ways. One is to prune features for each binary LS-SVM classifier independently, and the other is to prune features for all the binary classifiers jointly. The multi-class RFE is also compared with the wrapper feature selection method which uses genetic algorithms. The experimental results indicate that the joint pruning algorithm yields the best performance and selects more features relevant to intrinsic characteristics of digits.
9
Gene Selection for Cancer Classification using Support Vector Machines
Isabelle Guyon, Jason Weston, S. Barnhill et al. · Machine Learning · 2002 · 9.8K citations · Full text
Least Squares Support Vector Machine Classifiers
Johan A. K. Suykens, Joos Vandewalle · Neural Processing Letters · 1999 · 9.4K citations · Full text
Wrappers for feature subset selection
Ron Kohavi, George H. John · Artificial Intelligence · 1997 · 8.9K citations
In Defense of One-Vs-All Classification
Ryan Rifkin, Aldebaro Klautau · 2004 · 1.4K citations