ComputingComputer ScienceData ScienceData MiningFeature EngineeringMachine LearningDimension ReductionDimensionality ReductionFeature ExtractionFeature SelectionOptimization For Machine LearningRepresentation LearningCorrelation AnalysisDimensionality ControlDimensionality Reduction For Large DataFeature Dimensionality ReductionFeature Selection For ClassificationHigh-dimensional Data MiningHigh-dimensional Feature SelectionOptimization For High-dimensional Data
Feature selection, as a preprocessing step to machine learning, has been effective in reducing dimensionality, removing irrelevant data, increasing learning accuracy, and improving comprehensibility. However, the recent increase of dimensionality of data poses a severe challenge to many existing feature selection methods with respect to efficiency and effectiveness. In this work, we introduce a novel concept, predominant correlation, and propose a fast filter method which can identify relevant features as well as redundancy among relevant features without pairwise correlation analysis. The efficiency and effectiveness of our method is demonstrated through extensive comparisons with other methods using real-world data of high dimensionality. 1.
20
William H. Press, Saul A. Teukolsky, William T. Vetterling et al. · 1994 · 15.4K citations
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations
Wrappers for feature subset selection
Ron Kohavi, George H. John · Artificial Intelligence · 1997 · 8.9K citations
Ian H. Witten, Eibe Frank · ACM SIGMOD Record · 2002 · 5.2K citations
A Comparative Study on Feature Selection in Text Categorization
Yiming Yang, Jan Pedersen · 1997 · 4.8K citations