English
Related papers

Related papers: The Explanation Game: Explaining Machine Learning …

200 papers

Shapley values underlie one of the most popular model-agnostic methods within explainable artificial intelligence. These values are designed to attribute the difference between a model's prediction and an average baseline to the different…

Artificial Intelligence · Computer Science 2020-11-04 Tom Heskes , Evi Sijben , Ioan Gabriel Bucur , Tom Claassen

As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has become popular in…

Artificial Intelligence · Computer Science 2024-04-18 Nils Ole Breuer , Andreas Sauter , Majid Mohammadi , Erman Acar

Shapley values, a game theoretic concept, has been one of the most popular tools for explaining Machine Learning (ML) models in recent years. Unfortunately, the two most common approaches, conditional and marginal, to calculating Shapley…

Computer Science and Game Theory · Computer Science 2024-09-11 Ilya Rozenfeld

Existing methods of explainable AI and interpretable ML cannot explain change in the values of an output variable for a statistical unit in terms of the change in the input values and the change in the "mechanism" (the function transforming…

Machine Learning · Computer Science 2022-06-28 Kailash Budhathoki , George Michailidis , Dominik Janzing

Predictive Process Analytics is becoming an essential aid for organizations, providing online operational support of their processes. However, process stakeholders need to be provided with an explanation of the reasons why a given process…

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and…

Artificial Intelligence · Computer Science 2021-10-05 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The…

Machine Learning · Computer Science 2021-02-23 Daniel Fryer , Inga Strümke , Hien Nguyen

When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among…

Machine Learning · Computer Science 2022-03-03 Yasunobu Nohara , Koutarou Matsumoto , Hidehisa Soejima , Naoki Nakashima

Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning. In this paper, we first discuss fundamental concepts of cooperative game theory and axiomatic…

Machine Learning · Computer Science 2022-05-27 Benedek Rozemberczki , Lauren Watson , Péter Bayer , Hao-Tsung Yang , Olivér Kiss , Sebastian Nilsson , Rik Sarkar

A large branch of explainable machine learning is grounded in cooperative game theory. However, research indicates that game-theoretic explanations may mislead or be hard to interpret. We argue that often there is a critical mismatch…

Machine Learning · Computer Science 2024-10-28 Luca Franceschi , Michele Donini , Cédric Archambeau , Matthias Seeger

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

Explainable artificial intelligence (XAI) aims to help human decision-makers in understanding complex machine learning (ML) models. One of the hallmarks of XAI are measures of relative feature importance, which are theoretically justified…

Artificial Intelligence · Computer Science 2024-02-12 Joao Marques-Silva , Xuanxiang Huang

For reinforcement learning systems to be widely adopted, their users must understand and trust them. We present a theoretical analysis of explaining reinforcement learning using Shapley values, following a principled approach from game…

Machine Learning · Computer Science 2023-06-12 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

The presence of artificial intelligence (AI) in our society is increasing, which brings with it the need to understand the behavior of AI mechanisms, including machine learning predictive algorithms fed with tabular data, text or images,…

Machine Learning · Statistics 2025-06-06 Pedro Delicado , Cristian Pachón-García

A variety of recent papers discuss the application of Shapley values, a concept for explaining coalitional games, for feature attribution in machine learning. However, the correct way to connect a machine learning model to a coalitional…

Machine Learning · Computer Science 2020-06-30 Hugh Chen , Joseph D. Janizek , Scott Lundberg , Su-In Lee

In the classical context, the cooperative game theory concept of the Shapley value has been adapted for post hoc explanations of machine learning models. However, this approach does not easily translate to eXplainable Quantum ML (XQML).…

Emerging Technologies · Computer Science 2024-11-05 Iain Burge , Michel Barbeau , Joaquin Garcia-Alfaro

Missing data is a prevalent issue that can significantly impair model performance and explainability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and…

Machine Learning · Computer Science 2025-01-23 Tuan L. Vo , Thu Nguyen , Luis M. Lopez-Ramos , Hugo L. Hammer , Michael A. Riegler , Pal Halvorsen

Changes in input distribution can induce shifts in the average predictions of machine learning models. Such prediction shifts may impact downstream business outcomes (e.g. a bank's loan approval rate), so understanding their causes can be…

Machine Learning · Computer Science 2026-04-14 Tom Bewley , Salim I. Amoukou , Emanuele Albini , Saumitra Mishra , Manuela Veloso

Shapley value is a concept from game theory. Recently, it has been used for explaining complex models produced by machine learning techniques. Although the mathematical definition of Shapley value is straight-forward, the implication of…

Machine Learning · Computer Science 2020-08-13 Sisi Ma , Roshan Tourani