IEEE Access · 2022 · 58 citations · 22 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningPredictive AnalyticsComputational GenomicsExplainable Machine LearningGenomic PredictionSensitivity AnalysisExplainable Artificial IntelligenceGlobal SensitivityGlobal Sensitivity AnalysisMachine Learning For Genomic PredictionPredictive Model ExplanationReal-world Application
Explainable Artificial Intelligence (XAI) is an increasingly important field of research required to bring AI to the next level in real-world applications. Global sensitivity analysis methods play an important role in XAI, as they can provide an understanding of which (groups of) parameters have high influence in the predictions of machine learning models and the output of simulators and real-world processes. In this paper, we conduct a survey into global sensitivity methods in an XAI context and present both a qualitative and a quantitative analysis of these methods under different conditions. In addition to the overview and comparison, we propose an open source application, GSAreport, that allows you to easily generate extensive reports using a carefully selected set of global sensitivity analysis methods depending on the number of dimensions and samples, to gain a deep understanding of the role of each feature for a given model or data set.We finally present the methods discussed in a complex real-world application of genomic prediction and draw conclusions about when to use which GSA methods.
22
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
From local explanations to global understanding with explainable AI for trees
Scott Lundberg, Gabriel Erion, Hugh Chen et al. · Nature Machine Intelligence · 2020 · 8.9K citations · Full text
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever et al. · arXiv (Cornell University) · 2013 · 5.7K citations · Full text