English
Related papers

Related papers: Is Shapley Explanation for a model unique?

200 papers

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Shapley values originated in cooperative game theory but are extensively used today as a model-agnostic explanation framework to explain predictions made by complex machine learning models in the industry and academia. There are several…

Machine Learning · Statistics 2024-04-15 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

Shapley values has established itself as one of the most appropriate and theoretically sound frameworks for explaining predictions from complex machine learning models. The popularity of Shapley values in the explanation setting is probably…

Machine Learning · Statistics 2021-06-24 Martin Jullum , Annabelle Redelmeier , Kjersti Aas

This paper proposes a novel approach to explain the predictions made by data-driven methods. Since such predictions rely heavily on the data used for training, explanations that convey information about how the training data affects the…

Machine Learning · Statistics 2022-12-09 Andreas Brandsæter , Ingrid K. Glad

Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a…

Machine Learning · Computer Science 2021-12-21 Christopher Frye , Damien de Mijolla , Tom Begley , Laurence Cowton , Megan Stanley , Ilya Feige

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

Machine Learning · Computer Science 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam

Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad…

Machine Learning · Statistics 2021-03-09 Daniel Vidali Fryer , Inga Strümke , Hien Nguyen

The Shapley value is commonly illustrated by roll call votes in which players support or reject a proposal in sequence. If all sequences are equiprobable, a voter's Shapley value can be interpreted as the probability of being pivotal, i.e.,…

Computer Science and Game Theory · Computer Science 2018-10-04 Sascha Kurz , Stefan Napel

Shapley value is a classic notion from game theory, historically used to quantify the contributions of individuals within groups, and more recently applied to assign values to data points when training machine learning models. Despite its…

Machine Learning · Computer Science 2020-02-28 Amirata Ghorbani , Michael P. Kim , James Zou

Feature attribution methods help make machine learning-based inference explainable by determining how much one or several features have contributed to a model's output. A particularly popular attribution method is based on the Shapley value…

Artificial Intelligence · Computer Science 2025-11-04 Filip Naudot , Tobias Sundqvist , Timotheus Kampik

Shapley values have seen widespread use in machine learning as a way to explain model predictions and estimate the importance of covariates. Accurately explaining models is critical in real-world models to both aid in decision making and to…

Machine Learning · Statistics 2024-08-19 Daniel de Marchi , Michael Kosorok , Scott de Marchi

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

Shapley values are today extensively used as a model-agnostic explanation framework to explain complex predictive machine learning models. Shapley values have desirable theoretical properties and a sound mathematical foundation in the field…

Machine Learning · Statistics 2022-08-16 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

Explainability in yield prediction helps us fully explore the potential of machine learning models that are already able to achieve high accuracy for a variety of yield prediction scenarios. The data included for the prediction of yields…

Machine Learning · Computer Science 2023-04-17 Florian Huber , Hannes Engler , Anna Kicherer , Katja Herzog , Reinhard Töpfer , Volker Steinhage

This paper develops a rigorous argument for why the use of Shapley values in explainable AI (XAI) will necessarily yield provably misleading information about the relative importance of features for predictions. Concretely, this paper…

Machine Learning · Computer Science 2023-02-17 Xuanxiang Huang , Joao Marques-Silva

The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The…

Machine Learning · Computer Science 2021-02-23 Daniel Fryer , Inga Strümke , Hien Nguyen

For neural models to garner widespread public trust and ensure fairness, we must have human-intelligible explanations for their predictions. Recently, an increasing number of works focus on explaining the predictions of neural models in…

Computation and Language · Computer Science 2020-12-15 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

There is much interest lately in explainability in statistics and machine learning. One aspect of explainability is to quantify the importance of various features (or covariates). Two popular methods for defining variable importance are…

Methodology · Statistics 2023-03-13 Isabella Verdinelli , Larry Wasserman

Many existing approaches for estimating feature importance are problematic because they ignore or hide dependencies among features. A causal graph, which encodes the relationships among input variables, can aid in assigning feature…

Machine Learning · Computer Science 2021-03-01 Jiaxuan Wang , Jenna Wiens , Scott Lundberg