IEEE Transactions on Emerging Topics in Computational Intelligence · 2024 · 18 citations · 39 references
ComputingComputer ScienceMachine LearningOptimizationStatistical ModelingDimension ReductionDimensionality ReductionFeature SelectionGenetic ProgrammingRepresentation LearningVariable SelectionFeature Dimensionality ReductionFeature Impact AnalysisFeature Selection For RegressionHigh-dimensional Feature SelectionHigh-dimensional RegressionMathematical Programming ModelsPermutation Feature ImportanceSymbolic Regression
Symbolic regression is increasingly important for discovering mathematical models for various prediction tasks. It works by searching for the arithmetic expressions that best represent a target variable using a set of input features. However, as the number of features increases, the search process becomes more complex. To address high-dimensional symbolic regression, this work proposes a genetic programming for feature selection method based on the impact of feature removal on the performance of SR models. Unlike existing Shapely value methods that simulate feature absence at the data level, the proposed approach suggests removing features at the model level. This approach circumvents the production of unrealistic data instances, which is a major limitation of Shapely value and permutation-based methods. Moreover, after calculating the importance of the features, a cut-off strategy, which works by injecting a number of random features and utilising their importance to automatically set a threshold, is proposed for selecting important features. The experimental results on artificial and real-world high-dimensional data sets show that, compared with state-of-the-art feature selection methods using the permutation importance and Shapely value, the proposed method not only improves the SR accuracy but also selects smaller sets of features.
39
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
J. R. Quinlan · Machine Learning · 1986 · 12.4K citations · Full text
From local explanations to global understanding with explainable AI for trees
Scott Lundberg, Gabriel Erion, Hugh Chen et al. · Nature Machine Intelligence · 2020 · 8.9K citations · Full text
Scikit-learn: Machine Learning in Python
PedregosaFabian, VaroquauxGaël, GramfortAlexandre et al. · Journal of Machine Learning Research · 2011 · 8.2K citations
Joaquín Derrac, Salvador García, Daniel Molina et al. · Swarm and Evolutionary Computation · 2011 · 5.4K citations