English
Related papers

Related papers: Explainability is NOT a Game

200 papers

This paper develops a rigorous argument for why the use of Shapley values in explainable AI (XAI) will necessarily yield provably misleading information about the relative importance of features for predictions. Concretely, this paper…

Machine Learning · Computer Science 2023-02-17 Xuanxiang Huang , Joao Marques-Silva

Recent advances in game informatics have enabled us to find strong strategies across a diverse range of games. However, these strategies are usually difficult for humans to interpret. On the other hand, research in Explainable Artificial…

Multiagent Systems · Computer Science 2024-03-13 Satoru Fujii

Explainable AI (XAI) is critical for ensuring transparency, accountability, and trust in machine learning systems as black-box models are increasingly deployed within high-stakes domains. Among XAI methods, Shapley values are widely used…

Machine Learning · Computer Science 2025-02-19 Jiaxin Xu , Hung Chau , Angela Burden

Recent work demonstrated the existence of critical flaws in the current use of Shapley values in explainable AI (XAI), i.e. the so-called SHAP scores. These flaws are significant in that the scores provided to a human decision-maker can be…

Artificial Intelligence · Computer Science 2025-02-18 Joao Marques-Silva , Xuanxiang Huang , Olivier Letoffe

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

eXplainable Artificial Intelligence (XAI) is a sub-field of Artificial Intelligence (AI) that is at the forefront of AI research. In XAI, feature attribution methods produce explanations in the form of feature importance. People often use…

Artificial Intelligence · Computer Science 2022-02-09 Jamie Duell , Monika Seisenberger , Gert Aarts , Shangming Zhou , Xiuyi Fan

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

Recent work demonstrated the inadequacy of Shapley values for explainable artificial intelligence (XAI). Although to disprove a theory a single counterexample suffices, a possible criticism of earlier work is that the focus was solely on…

Artificial Intelligence · Computer Science 2023-10-03 Xuanxiang Huang , Joao Marques-Silva

A central goal of eXplainable Artificial Intelligence (XAI) is to assign relative importance to the features of a Machine Learning (ML) model given some prediction. The importance of this task of explainability by feature attribution is…

Artificial Intelligence · Computer Science 2024-05-21 Olivier Letoffe , Xuanxiang Huang , Nicholas Asher , Joao Marques-Silva

For around a decade, non-symbolic methods have been the option of choice when explaining complex machine learning (ML) models. Unfortunately, such methods lack rigor and can mislead human decision-makers. In high-stakes uses of ML, the lack…

Artificial Intelligence · Computer Science 2026-05-28 Olivier Létoffé , Xuanxiang Huang , Joao Marques-Silva

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift…

Machine Learning · Computer Science 2024-05-31 Jacob Dineen , Don Kridel , Daniel Dolk , David Castillo

With wide application of Artificial Intelligence (AI), it has become particularly important to make decisions of AI systems explainable and transparent. In this paper, we proposed a new Explainable Artificial Intelligence (XAI) method…

Artificial Intelligence · Computer Science 2025-04-01 Chi Zhao , Jing Liu , Elena Parilina

The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The…

Machine Learning · Computer Science 2021-02-23 Daniel Fryer , Inga Strümke , Hien Nguyen

EXplainable Artificial Intelligence (XAI) aims to help users to grasp the reasoning behind the predictions of an Artificial Intelligence (AI) system. Many XAI approaches have emerged in recent years. Consequently, a subfield related to the…

eXplainable artificial intelligence (XAI) methods have emerged to convert the black box of machine learning (ML) models into a more digestible form. These methods help to communicate how the model works with the aim of making ML models more…

SHAP scores represent the proposed use of the well-known Shapley values in eXplainable Artificial Intelligence (XAI). Recent work has shown that the exact computation of SHAP scores can produce unsatisfactory results. Concretely, for some…

Machine Learning · Computer Science 2024-12-20 Olivier Letoffe , Xuanxiang Huang , Joao Marques-Silva

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and…

Artificial Intelligence · Computer Science 2021-10-05 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

Human-Computer Interaction · Computer Science 2023-03-22 Savio Rozario , George Čevora

Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements…

Artificial Intelligence · Computer Science 2020-07-01 I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , Sorelle Friedler

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal
‹ Prev 1 2 3 10 Next ›