International Journal of Human-Computer Interaction · 2022 · 61 citations · 33 references
ComputingComputer ScienceArtificial IntelligenceBusiness EthicsMachine LearningAlgorithmic FairnessArtificial Intelligence AdoptionAutomated ReasoningEthics Of Automated Decision-makingExplainable Machine LearningFairness In Machine LearningAi Ethics In AdoptionArtificial Intelligence In BankingExplainable Artificial IntelligenceFairnessLoan Approval DecisioningMachine Learning EthicsResponsible AiTrustworthy Ai
Despite the existing skepticism about the use of automatic systems in contexts where human knowledge and experience are considered indispensable (e.g., the granting of a mortgage, the prediction of stock prices, or the detection of cancers), our work aims to show how the use of explainability and fairness techniques can lead to the growth of a domain expert’s trust and reliance on an artificial intelligence (AI) system. This article presents a system, applied to the context of loan approval processes, focusing on the two aforementioned ethical principles out of the four defined by the High-Level Expert Group on AI in the document “Ethics Guidelines for Trustworthy AI,” published in April 2019, in which the key requirements that AI systems should meet to be considered trustworthy are identified. The presented case study is realized within a proprietary framework composed of several components for supporting the user throughout the management of the whole life cycle of a machine learning model. The main approaches, consisting of providing an interpretation of the model’s outputs and monitoring the model’s decisions to detect and react to unfair behaviors, are described in more detail to compare our system within state-of-the-art related frameworks. Finally, a novel Trust & Reliance Scale is proposed for evaluating the system, and a usability test is performed to measure the user satisfaction with the effectiveness of the developed user interface; results are obtained, respectively, by the submission of the mentioned novel scale to bank domain experts and the usability questionnaire to a heterogeneous group composed of loan officers, data scientists, and researchers.
33
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das et al. · 2017 · 21.6K citations
Marco Túlio Ribeiro, Sameer Singh, Carlos Guestrin · 2016 · 15.2K citations
Advances in Neural Information Processing Systems 28
Peter Flach, Meelis Kull · 2015 · 14.7K citations
Advances in Neural Information Processing Systems 29
Onur Teymur, Kostas Zygalakis, Ben Calderhead · 2016 · 13.5K citations
Proceedings of the 24th international conference on Machine learning
2007 · 11.7K citations