On the failings of Shapley values for explainability

Explainable Artificial Intelligence (XAI) is widely considered to be critical for building trust into the deployment of systems that integrate the use of machine learning (ML) models. For more than two decades Shapley values have been used as the theoretical underpinning for some methods of XAI, bei...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International journal of approximate reasoning Jg. 171; S. 109112
Hauptverfasser: Huang, Xuanxiang, Marques-Silva, Joao
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Inc 01.08.2024
Schlagworte:
Abductive explanations
Explainable AI (XAI)
SHAP scores
Shapley values
Shapley values
SHAP scores
Abductive explanations
Explainable AI (XAI)
ISSN:0888-613X, 1873-4731
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Explainable Artificial Intelligence (XAI) is widely considered to be critical for building trust into the deployment of systems that integrate the use of machine learning (ML) models. For more than two decades Shapley values have been used as the theoretical underpinning for some methods of XAI, being commonly referred to as SHAP scores. Some of these methods of XAI now rank among the most widely used, including in high-risk domains. This paper proves that the existing definitions of SHAP scores will necessarily yield misleading information about the relative importance of features for predictions. The paper identifies a number of ways in which misleading information can be conveyed to human decision makers, and proves that there exist classifiers which will yield such misleading information. Furthermore, the paper offers empirical evidence that such theoretical limitations of SHAP scores are routinely observed in ML classifiers.
ISSN:0888-613X
1873-4731
DOI:10.1016/j.ijar.2023.109112