Data Mining and Knowledge Discovery · 2022 · 62 citations · 62 references
ComputingComputer ScienceData ScienceData VisualizationFeature EngineeringMachine LearningExplainable Machine LearningFeature SelectionFeature Stability AnalysisFeature Combination StrategiesFeature ImportanceFeature Importance StabilityGrouped Data AnalysisPermutation Feature ImportanceShapley OperatorSimulation Studies
Abstract Interpretable machine learning has become a very active area of research due to the rising popularity of machine learning algorithms and their inherently challenging interpretability. Most work in this area has been focused on the interpretation of single features in a model. However, for researchers and practitioners, it is often equally important to quantify the importance or visualize the effect of feature groups. To address this research gap, we provide a comprehensive overview of how existing model-agnostic techniques can be defined for feature groups to assess the grouped feature importance, focusing on permutation-based, refitting, and Shapley-based methods. We also introduce an importance-based sequential procedure that identifies a stable and well-performing combination of features in the grouped feature space. Furthermore, we introduce the combined features effect plot, which is a technique to visualize the effect of a group of features based on a sparse, interpretable linear combination of features. We used simulation studies and real data examples to analyze, compare, and discuss these methods.
62
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
Greedy function approximation: A gradient boosting machine.
Jerome H. Friedman · The Annals of Statistics · 2001 · 29K citations · Full text
Gene Selection for Cancer Classification using Support Vector Machines
Isabelle Guyon, Jason Weston, S. Barnhill et al. · Machine Learning · 2002 · 9.8K citations · Full text