Knowledge graphs as tools for explainable machine learning: A survey

Ilaria Tiddi, Stefan Schlobach

Artificial Intelligence · 2021 · 256 citations · 76 references

DOIFull text

Open access

TL;DR

Explainable AI has become a highly active research area, addressing the limitations of accurate but opaque machine learning models, and there is growing interest in integrating knowledge representation techniques to create hybrid intelligent systems. This paper provides an extensive overview of the use of knowledge graphs in explainable machine learning, hypothesizing that knowledge graphs can be integrated to deliver more meaningful, insightful, and trustworthy explanations. The authors conducted a systematic literature review and developed an analytical framework to examine how large‑scale structured knowledge is integrated into explainable machine learning across multiple domains, identifying key characteristics of such hybrid systems. The survey highlights that knowledge‑graph‑based explainable systems improve understandability, reactivity, and accuracy, but face challenges in handling noise and efficient knowledge extraction, and it outlines several open research directions.

Abstract

This paper provides an extensive overview of the use of knowledge graphs in the context of Explainable Machine Learning. As of late, explainable AI has become a very active field of research by addressing the limitations of the latest machine learning solutions that often provide highly accurate, but hardly scrutable and interpretable decisions. An increasing interest has also been shown in the integration of Knowledge Representation techniques in Machine Learning applications, mostly motivated by the complementary strengths and weaknesses that could lead to a new generation of hybrid intelligent systems. Following this idea, we hypothesise that knowledge graphs, which naturally provide domain background knowledge in a machine-readable format, could be integrated in Explainable Machine Learning approaches to help them provide more meaningful, insightful and trustworthy explanations. Using a systematic literature review methodology we designed an analytical framework to explore the current landscape of Explainable Machine Learning. We focus particularly on the integration with structured knowledge at large scale, and use our framework to analyse a variety of Machine Learning domains, identifying the main characteristics of such knowledge-based, explainable systems from different perspectives. We then summarise the strengths of such hybrid systems, such as improved understandability, reactivity, and accuracy, as well as their limitations, e.g. in handling noise or extracting knowledge efficiently. We conclude by discussing a list of open challenges left for future research.

References

76