Journal Of Big Data · 2021 · 64 citations · 40 references
ComputingComputer ScienceData ScienceArtificial IntelligenceData MiningMachine LearningDeep LearningFeature ExtractionFeature SelectionFeature ImportanceFeature RankingFeature Selection For ClassificationMethod Sensitivity AssessmentModel PerturbationRobust Feature Selection
Abstract Sensitivity analysis is a popular feature selection approach employed to identify the important features in a dataset. In sensitivity analysis, each input feature is perturbed one-at-a-time and the response of the machine learning model is examined to determine the feature's rank. Note that the existing perturbation techniques may lead to inaccurate feature ranking due to their sensitivity to perturbation parameters. This study proposes a novel approach that involves the perturbation of input features using a complex-step. The implementation of complex-step perturbation in the framework of deep neural networks as a feature selection method is provided in this paper, and its efficacy in determining important features for real-world datasets is demonstrated. Furthermore, the filter-based feature selection methods are employed, and the results obtained from the proposed method are compared. While the results obtained for the classification task indicated that the proposed method outperformed other feature ranking methods, in the case of the regression task, it was found to perform more or less similar to that of other feature ranking methods.
40
Neural networks for pattern recognition
Choice Reviews Online · 1994 · 18.7K citations
A survey on feature selection methods
Girish Chandrashekar, Ferat Sahin · Computers & Electrical Engineering · 2013 · 5.1K citations
Selection of relevant features and examples in machine learning
Avrim Blum, Pat Langley · Artificial Intelligence · 1997 · 3.3K citations
Feature selection for classification
Manoranjan Dash, Hua Liu · Intelligent Data Analysis · 1997 · 2.6K citations