English
Related papers

Related papers: The Inadequacy of Shapley Values for Explainabilit…

200 papers

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

Machine Learning · Statistics 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

Artificial Intelligence · Computer Science 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

Shapley values have seen widespread use in machine learning as a way to explain model predictions and estimate the importance of covariates. Accurately explaining models is critical in real-world models to both aid in decision making and to…

Machine Learning · Statistics 2024-08-19 Daniel de Marchi , Michael Kosorok , Scott de Marchi

As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has become popular in…

Artificial Intelligence · Computer Science 2024-04-18 Nils Ole Breuer , Andreas Sauter , Majid Mohammadi , Erman Acar

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift…

Machine Learning · Computer Science 2024-05-31 Jacob Dineen , Don Kridel , Daniel Dolk , David Castillo

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Explainable artificial intelligence (XAI) aims to help uncover flaws in an AI model's internal representations. But do people draw the right conclusions from its explanations? Specifically, do they recognize an AI's inability to distinguish…

Human-Computer Interaction · Computer Science 2026-02-03 Romy Müller , Wiebke Klausing

Explainable AI~(XAI) methods such as SHAP can help discover feature attributions in black-box models. If the method reveals a significant attribution from a ``protected feature'' (e.g., gender, race) on the model output, the model is…

Machine Learning · Computer Science 2024-08-14 Jun Yuan , Aritra Dasgupta

Explainable artificial intelligence (XAI) is motivated by the problem of making AI predictions understandable, transparent, and responsible, as AI becomes increasingly impactful in society and high-stakes domains. The evaluation and…

Artificial Intelligence · Computer Science 2025-06-02 Weina Jin , Xiaoxiao Li , Ghassan Hamarneh

Explainable Artificial Intelligence (XAI) has received widespread interest in recent years, and two of the most popular types of explanations are feature attributions, and counterfactual explanations. These classes of approaches have been…

Artificial Intelligence · Computer Science 2023-07-14 Emanuele Albini , Shubham Sharma , Saumitra Mishra , Danial Dervovic , Daniele Magazzeni

Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documented,…

Machine Learning · Computer Science 2026-04-27 Inês Oliveira e Silva , Sérgio Jesus , Iker Perez , Rita P. Ribeiro , Carlos Soares , Hugo Ferreira , Pedro Bizarro

There is much interest lately in explainability in statistics and machine learning. One aspect of explainability is to quantify the importance of various features (or covariates). Two popular methods for defining variable importance are…

Methodology · Statistics 2023-03-13 Isabella Verdinelli , Larry Wasserman

Shapley value is a popular approach for measuring the influence of individual features. While Shapley feature attribution is built upon desiderata from game theory, some of its constraints may be less natural in certain machine learning…

Machine Learning · Computer Science 2022-09-28 Yongchan Kwon , James Zou

Despite the progress observed with model-agnostic explainable AI (XAI), it is the case that model-agnostic XAI can produce incorrect explanations. One alternative are the so-called formal approaches to XAI, that include PI-explanations.…

Machine Learning · Computer Science 2022-07-12 Yacine Izza , Joao Marques-Silva

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Feature attribution methods based on game theory are ubiquitous in the field of eXplainable Artificial Intelligence (XAI). Recent works proposed rigorous feature attribution using logic-based explanations, specifically targeting high-stakes…

Artificial Intelligence · Computer Science 2025-08-19 Xuanxiang Huang , Olivier Létoffé , Joao Marques-Silva

Shapley values underlie one of the most popular model-agnostic methods within explainable artificial intelligence. These values are designed to attribute the difference between a model's prediction and an average baseline to the different…

Artificial Intelligence · Computer Science 2020-11-04 Tom Heskes , Evi Sijben , Ioan Gabriel Bucur , Tom Claassen

In spite of increased attention on explainable machine learning models, explaining multi-output predictions has not yet been extensively addressed. Methods that use Shapley values to attribute feature contributions to the decision making…

Machine Learning · Computer Science 2023-03-31 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Jesse Read

In Explainable AI (XAI), Shapley values are a popular model-agnostic framework for explaining predictions made by complex machine learning models. The computation of Shapley values requires estimating non-trivial contribution functions…

Machine Learning · Computer Science 2026-01-27 Lars Henry Berge Olsen , Martin Jullum