ComputingComputer ScienceData MiningFeature EngineeringMachine LearningClassificationData PreprocessingDimension ReductionDimensionality ReductionFeature SelectionOverfittingClass ImbalanceData SamplingFeature Selection For ClassificationHigh-dimensional Data MiningHigh-dimensional Feature SelectionImbalanceImbalanced ClassificationMachine Learning Classification
The emerging new data types bring tremendous challenges to data mining. There is an enormous amount of high-dimensional class-imbalanced data in different fields. In this case, traditional classification methods are not appropriate because they are prone to ensure the accuracy of the majority class. Meanwhile, the curse of dimensionality makes situations more complicated. Finding a complicated classifier is not an easy way and such a classifier may overfit for the data. Preprocessing these data before classification is a more direct method. For the cross effect of high-dimension and class-imbalance, it is necessary to know about how preprocessing methods (feature selection and data sampling) affect the final classification. Previous experiments either had less considerations on datasets or introduced other characteristics to make the situation more complicated. We use two types of feature selection (wrapper and filter) and data sampling (oversampling and undersampling) methods on twelve selected datasets with different dimensions and imbalanced-level in four fields, and test the effects on the performance of c4.5 classifier. In our setting, experiments state that (1) feature selection before sampling is mostly better, (2) among the combinations of feature selection and data sampling, undersampling performs better than oversampling when the dataset is largely imbalanced, (3) when dataset is less imbalance, preprocessing may not be necessary, (4) In wrapper-based feature selection, we suggest using the simple searching method.
11
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
Mark Hall, Eibe Frank, Geoffrey Holmes et al. · ACM SIGKDD Explorations Newsletter · 2009 · 17.8K citations
Pierre Geurts, Damien Ernst, Louis Wehenkel · Machine Learning · 2006 · 8.7K citations · Full text
Class prediction for high-dimensional class-imbalanced data
Rok Blagus, Lara Lusa · BMC Bioinformatics · 2010 · 237 citations · Full text