中文
相关论文

相关论文: The Inadequacy of Shapley Values for Explainabilit…

200 篇论文

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

机器学习 · 统计学 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

人工智能 · 计算机科学 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

Shapley values have seen widespread use in machine learning as a way to explain model predictions and estimate the importance of covariates. Accurately explaining models is critical in real-world models to both aid in decision making and to…

机器学习 · 统计学 2024-08-19 Daniel de Marchi , Michael Kosorok , Scott de Marchi

As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has become popular in…

人工智能 · 计算机科学 2024-04-18 Nils Ole Breuer , Andreas Sauter , Majid Mohammadi , Erman Acar

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift…

机器学习 · 计算机科学 2024-05-31 Jacob Dineen , Don Kridel , Daniel Dolk , David Castillo

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

机器学习 · 计算机科学 2026-03-30 Jörg Martin , Stefan Haufe

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

机器学习 · 计算机科学 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Explainable artificial intelligence (XAI) aims to help uncover flaws in an AI model's internal representations. But do people draw the right conclusions from its explanations? Specifically, do they recognize an AI's inability to distinguish…

人机交互 · 计算机科学 2026-02-03 Romy Müller , Wiebke Klausing

Explainable AI~(XAI) methods such as SHAP can help discover feature attributions in black-box models. If the method reveals a significant attribution from a ``protected feature'' (e.g., gender, race) on the model output, the model is…

机器学习 · 计算机科学 2024-08-14 Jun Yuan , Aritra Dasgupta

Explainable artificial intelligence (XAI) is motivated by the problem of making AI predictions understandable, transparent, and responsible, as AI becomes increasingly impactful in society and high-stakes domains. The evaluation and…

人工智能 · 计算机科学 2025-06-02 Weina Jin , Xiaoxiao Li , Ghassan Hamarneh

Explainable Artificial Intelligence (XAI) has received widespread interest in recent years, and two of the most popular types of explanations are feature attributions, and counterfactual explanations. These classes of approaches have been…

人工智能 · 计算机科学 2023-07-14 Emanuele Albini , Shubham Sharma , Saumitra Mishra , Danial Dervovic , Daniele Magazzeni

Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documented,…

There is much interest lately in explainability in statistics and machine learning. One aspect of explainability is to quantify the importance of various features (or covariates). Two popular methods for defining variable importance are…

统计方法学 · 统计学 2023-03-13 Isabella Verdinelli , Larry Wasserman

Shapley value is a popular approach for measuring the influence of individual features. While Shapley feature attribution is built upon desiderata from game theory, some of its constraints may be less natural in certain machine learning…

机器学习 · 计算机科学 2022-09-28 Yongchan Kwon , James Zou

Despite the progress observed with model-agnostic explainable AI (XAI), it is the case that model-agnostic XAI can produce incorrect explanations. One alternative are the so-called formal approaches to XAI, that include PI-explanations.…

机器学习 · 计算机科学 2022-07-12 Yacine Izza , Joao Marques-Silva

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

机器学习 · 统计学 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Feature attribution methods based on game theory are ubiquitous in the field of eXplainable Artificial Intelligence (XAI). Recent works proposed rigorous feature attribution using logic-based explanations, specifically targeting high-stakes…

人工智能 · 计算机科学 2025-08-19 Xuanxiang Huang , Olivier Létoffé , Joao Marques-Silva

Shapley values underlie one of the most popular model-agnostic methods within explainable artificial intelligence. These values are designed to attribute the difference between a model's prediction and an average baseline to the different…

人工智能 · 计算机科学 2020-11-04 Tom Heskes , Evi Sijben , Ioan Gabriel Bucur , Tom Claassen

In spite of increased attention on explainable machine learning models, explaining multi-output predictions has not yet been extensively addressed. Methods that use Shapley values to attribute feature contributions to the decision making…

机器学习 · 计算机科学 2023-03-31 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Jesse Read

In Explainable AI (XAI), Shapley values are a popular model-agnostic framework for explaining predictions made by complex machine learning models. The computation of Shapley values requires estimating non-trivial contribution functions…

机器学习 · 计算机科学 2026-01-27 Lars Henry Berge Olsen , Martin Jullum