2019 · 88 citations · 27 references
ComputingComputer ScienceArtificial IntelligenceDecision AnalysisMachine LearningExplainable Machine LearningExplanationExplainabilityExplainable Artificial IntelligenceFairness-aware ExplanationsMental Model Development
Artificial intelligence systems are being increasingly deployed due to their potential to increase the efficiency, scale, consistency, fairness, and accuracy of decisions. However, as many of these systems are opaque in their operation, there is a growing demand for such systems to provide explanations for their decisions. Conventional approaches to this problem attempt to expose or discover the inner workings of a machine learning model with the hope that the resulting explanations will be meaningful to the consumer. In contrast, this paper suggests a new approach to this problem. It introduces a simple, practical framework, called Teaching Explanations for Decisions (TED), that provides meaningful explanations that match the mental model of the consumer. We illustrate the generality and effectiveness of this approach with two different examples, resulting in highly accurate explanations with no loss of prediction accuracy for these two examples.
27
Marco Túlio Ribeiro, Sameer Singh, Carlos Guestrin · 2016 · 15.2K citations
A Unified Approach to Interpreting Model Predictions
Scott Lundberg, Su‐In Lee · arXiv (Cornell University) · 2017 · 7.6K citations · Full text
Intelligible Models for HealthCare
Rich Caruana, Yin Lou, Johannes Gehrke et al. · 2015 · 1.6K citations