Expert Systems with Applications · 2021 · 39 citations · 33 references
ComputingComputer ScienceData ScienceData MiningMachine LearningStatistical LearningClassificationEnsemble LearningFeature SelectionResampling MethodsResampling TechniquesSupport Vector MachinesBalancingBayesian ClassifiersClassification AlgorithmsFeature Selection For ClassificationImbalanced ClassificationImbalanced LearningSelection AlgorithmsStatistical Significance Testing
This paper studies the effects that combinations of balancing and feature selection techniques have on wide data (many more attributes than instances) when different classifiers are used. For this, an extensive study is done using 14 datasets, 3 balancing strategies, and 7 feature selection algorithms. The evaluation is carried out using 5 classification algorithms, analyzing the results for different percentages of selected features, and establishing the statistical significance using Bayesian tests. Some general conclusions of the study are that it is better to use RUS before the feature selection, while ROS and SMOTE offer better results when applied afterwards. Additionally, specific results are also obtained depending on the classifier used, for example, for Gaussian SVM the best performance is obtained when the feature selection is done with SVM-RFE before balancing the data with RUS.
33
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
Gene Selection for Cancer Classification using Support Vector Machines
Isabelle Guyon, Jason Weston, S. Barnhill et al. · Machine Learning · 2002 · 9.8K citations · Full text
Wrappers for feature subset selection
Ron Kohavi, George H. John · Artificial Intelligence · 1997 · 8.9K citations