English
Related papers

Related papers: The Inadequacy of Shapley Values for Explainabilit…

200 papers

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

Machine Learning · Computer Science 2020-06-29 Luke Merrick , Ankur Taly

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

The applications of Artificial Intelligence (AI) methods especially machine learning techniques have increased in recent years. Classification algorithms have been successfully applied to different problems such as requirement…

Software Engineering · Computer Science 2023-02-13 Behnaz Jamasb , Reza Akbari , Seyed Raouf Khayami

This paper proposes a novel approach to explain the predictions made by data-driven methods. Since such predictions rely heavily on the data used for training, explanations that convey information about how the training data affects the…

Machine Learning · Statistics 2022-12-09 Andreas Brandsæter , Ingrid K. Glad

In recent years, the community of 'explainable artificial intelligence' (XAI) has created a vast body of methods to bridge a perceived gap between model 'complexity' and 'interpretability'. However, a concrete problem to be solved by XAI…

Machine Learning · Computer Science 2023-06-05 Rick Wilming , Leo Kieslich , Benedict Clark , Stefan Haufe

Explainable Artificial Intelligence (XAI) provides tools to help understanding how the machine learning models work and reach a specific outcome. It helps to increase the interpretability of models and makes the models more trustworthy and…

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

Machine Learning · Computer Science 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam

For neural models to garner widespread public trust and ensure fairness, we must have human-intelligible explanations for their predictions. Recently, an increasing number of works focus on explaining the predictions of neural models in…

Computation and Language · Computer Science 2020-12-15 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

In recent years, Artificial Intelligence (AI) algorithms have been proven to outperform traditional statistical methods in terms of predictivity, especially when a large amount of data was available. Nevertheless, the "black box" nature of…

Machine Learning · Statistics 2021-10-14 Nicola Picchiotti , Marco Gori

A popular explainable AI (XAI) approach to quantify feature importance of a given model is via Shapley values. These Shapley values arose in cooperative games, and hence a critical ingredient to compute these in an XAI context is a…

Machine Learning · Computer Science 2022-02-25 Chih-Kuan Yeh , Kuan-Yun Lee , Frederick Liu , Pradeep Ravikumar

Explainable artificial intelligence (XAI) has witnessed significant advances in the field of object recognition, with saliency maps being used to highlight image features relevant to the predictions of learned models. Although these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Michihiro Kuroki , Toshihiko Yamasaki

Local feature-based explanations are a key component of the XAI toolkit. These explanations compute feature importance values relative to an ``interpretable'' feature representation. In tabular data, feature values themselves are often…

Machine Learning · Computer Science 2025-05-14 Hyunseung Hwang , Andrew Bell , Joao Fonseca , Venetia Pliatsika , Julia Stoyanovich , Steven Euijong Whang

Shapley values have become one of the go-to methods to explain complex models to end-users. They provide a model agnostic post-hoc explanation with foundations in game theory: what is the worth of a player (in machine learning, a feature…

Machine Learning · Computer Science 2023-06-21 Joran Michiels , Maarten De Vos , Johan Suykens

We propose a novel definition of Shapley values with uncertain value functions based on first principles using probability theory. Such uncertain value functions can arise in the context of explainable machine learning as a result of…

Machine Learning · Computer Science 2023-04-03 Raoul Heese , Sascha Mücke , Matthias Jakobs , Thore Gerlach , Nico Piatkowski

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Algorithmic decisions in critical domains such as hiring, college admissions, and lending are often based on rankings. Given the impact of these decisions on individuals, organizations, and population groups, it is essential to understand…

Artificial Intelligence · Computer Science 2025-07-29 Venetia Pliatsika , Joao Fonseca , Kateryna Akhynko , Ivan Shevchenko , Julia Stoyanovich

Shapley value-based methods have become foundational in explainable artificial intelligence (XAI), offering theoretically grounded feature attributions through cooperative game theory. However, in practice, particularly in vision tasks, the…

Artificial Intelligence · Computer Science 2026-02-20 Xiangyu Zhou , Chenhan Xiao , Yang Weng

Explainable AI (XAI) promises to provide insight into machine learning models' decision processes, where one goal is to identify failures such as shortcut learning. This promise relies on the field's assumption that input features marked as…

Machine Learning · Computer Science 2026-02-19 Benedict Clark , Marta Oliveira , Rick Wilming , Stefan Haufe

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI (XAI) and its promise to render AI devices more…

Artificial Intelligence · Computer Science 2023-02-27 Giovanni Cinà , Tabea E. Röber , Rob Goedhart , Ş. İlker Birbil