English
Related papers

Related papers: Problems with Shapley-value-based explanations as …

200 papers

The problem of explaining the behavior of deep neural networks has recently gained a lot of attention. While several attribution methods have been proposed, most come without strong theoretical foundations, which raises questions about…

Machine Learning · Computer Science 2019-06-24 Marco Ancona , Cengiz Öztireli , Markus Gross

As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has become popular in…

Artificial Intelligence · Computer Science 2024-04-18 Nils Ole Breuer , Andreas Sauter , Majid Mohammadi , Erman Acar

Shapley values are extensively used in explainable artificial intelligence (XAI) as a framework to explain predictions made by complex machine learning (ML) models. In this work, we focus on conditional Shapley values for predictive models…

Machine Learning · Statistics 2023-12-07 Lars Henry Berge Olsen

Explainable Artificial Intelligence (XAI) has received widespread interest in recent years, and two of the most popular types of explanations are feature attributions, and counterfactual explanations. These classes of approaches have been…

Artificial Intelligence · Computer Science 2023-07-14 Emanuele Albini , Shubham Sharma , Saumitra Mishra , Danial Dervovic , Daniele Magazzeni

Originating in game theory, Shapley values are widely used for explaining a machine learning model's prediction by quantifying the contribution of each feature's value to the prediction. This requires a scalar prediction as in binary…

Machine Learning · Computer Science 2025-02-13 Paul-Gauthier Noé , Miquel Perelló-Nieto , Jean-François Bonastre , Peter Flach

This paper deals with an important subject in classification problems addressed by machine learning techniques: the evaluation of the influence of each of the features on the classification of individuals. Specifically, a measure of that…

Machine Learning · Statistics 2023-04-21 L. Davila-Pena , Ignacio García-Jurado , B. Casas-Méndez

We discuss promising recent contributions on quantifying feature relevance using Shapley values, where we observed some confusion on which probability distribution is the right one for dropped features. We argue that the confusion is based…

Machine Learning · Statistics 2019-11-28 Dominik Janzing , Lenon Minorics , Patrick Blöbaum

Many existing approaches for estimating feature importance are problematic because they ignore or hide dependencies among features. A causal graph, which encodes the relationships among input variables, can aid in assigning feature…

Machine Learning · Computer Science 2021-03-01 Jiaxuan Wang , Jenna Wiens , Scott Lundberg

The Shapley value is a game-theoretic notion for wealth distribution that is nowadays extensively used to explain complex data-intensive computation, for instance, in network analysis or machine learning. Recent theoretical works show that…

Databases · Computer Science 2022-01-04 Daniel Deutch , Nave Frost , Benny Kimelfeld , Mikaël Monet

Explaining AI systems is fundamental both to the development of high performing models and to the trust placed in them by their users. The Shapley framework for explainability has strength in its general applicability combined with its…

Machine Learning · Statistics 2021-12-21 Christopher Frye , Colin Rowat , Ilya Feige

Measuring contributions is a classical problem in cooperative game theory where the Shapley value is the most well-known solution concept. In this paper, we establish the convergence property of the Shapley value in parametric Bayesian…

Machine Learning · Computer Science 2022-06-15 Lucas Agussurja , Xinyi Xu , Bryan Kian Hsiang Low

The presence of artificial intelligence (AI) in our society is increasing, which brings with it the need to understand the behavior of AI mechanisms, including machine learning predictive algorithms fed with tabular data, text or images,…

Machine Learning · Statistics 2025-06-06 Pedro Delicado , Cristian Pachón-García

Shapley values are today extensively used as a model-agnostic explanation framework to explain complex predictive machine learning models. Shapley values have desirable theoretical properties and a sound mathematical foundation in the field…

Machine Learning · Statistics 2022-08-16 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

We investigate the application of the Shapley value to quantifying the contribution of a tuple to a query answer. The Shapley value is a widely known numerical measure in cooperative game theory and in many applications of game theory for…

Databases · Computer Science 2023-06-22 Ester Livshits , Leopoldo Bertossi , Benny Kimelfeld , Moshe Sebag

This paper concerns the analysis of the Shapley value in matching games. Matching games constitute a fundamental class of cooperative games which help understand and model auctions and assignments. In a matching game, the value of a…

Computer Science and Game Theory · Computer Science 2013-07-02 Haris Aziz , Bart de Keijzer

As the use of complex machine learning models continues to grow, so does the need for reliable explainability methods. One of the most popular methods for model explainability is based on Shapley values. There are two most commonly used…

Machine Learning · Statistics 2024-12-18 Ilya Rozenfeld

Attribution scores can be applied in data management to quantify the contribution of individual items to conclusions from the data, as part of the explanation of what led to these conclusions. In Artificial Intelligence, Machine Learning,…

Databases · Computer Science 2024-01-15 Leopoldo Bertossi , Benny Kimelfeld , Ester Livshits , Mikaël Monet

We propose and study a framework for quantifying the importance of the choices of parameter values to the result of a query over a database. These parameters occur as constants in logical queries, such as conjunctive queries. In our…

Databases · Computer Science 2024-11-19 Amir Gilad , Martin Grohe , Benny Kimelfeld , Peter Lindner , Christoph Standke

The Shapley value is commonly illustrated by roll call votes in which players support or reject a proposal in sequence. If all sequences are equiprobable, a voter's Shapley value can be interpreted as the probability of being pivotal, i.e.,…

Computer Science and Game Theory · Computer Science 2018-10-04 Sascha Kurz , Stefan Napel