The human-AI relationship in decision-making: AI explanation to support\n people on justifying their decisions

Abstract

The explanation dimension of Artificial Intelligence (AI) based system has\nbeen a hot topic for the past years. Different communities have raised concerns\nabout the increasing presence of AI in people's everyday tasks and how it can\naffect people's lives. There is a lot of research addressing the\ninterpretability and transparency concepts of explainable AI (XAI), which are\nusually related to algorithms and Machine Learning (ML) models. But in\ndecision-making scenarios, people need more awareness of how AI works and its\noutcomes to build a relationship with that system. Decision-makers usually need\nto justify their decision to others in different domains. If that decision is\nsomehow based on or influenced by an AI-system outcome, the explanation about\nhow the AI reached that result is key to building trust between AI and humans\nin decision-making scenarios. In this position paper, we discuss the role of\nXAI in decision-making scenarios, our vision of Decision-Making with AI-system\nin the loop, and explore one case from the literature about how XAI can impact\npeople justifying their decisions, considering the importance of building the\nhuman-AI relationship for those scenarios.\n