English
Related papers

Related papers: Towards trustable SHAP scores

200 papers

Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad…

Machine Learning · Statistics 2021-03-09 Daniel Vidali Fryer , Inga Strümke , Hien Nguyen

This work focuses on developing efficient post-hoc explanations for quantum AI algorithms. In classical contexts, the cooperative game theory concept of the Shapley value adapts naturally to post-hoc explanations, where it can be used to…

Quantum Physics · Physics 2025-04-18 Iain Burge , Michel Barbeau , Joaquin Garcia-Alfaro

With the advances in artificial intelligence (AI), data-driven algorithms are becoming increasingly popular in the medical domain. However, due to the nonlinear and complex behavior of many of these algorithms, decision-making by such…

Quantitative Methods · Quantitative Biology 2024-07-18 Amirehsan Ghasemi , Soheil Hashtarkhani , David L Schwartz , Arash Shaban-Nejad

Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning. In this paper, we first discuss fundamental concepts of cooperative game theory and axiomatic…

Machine Learning · Computer Science 2022-05-27 Benedek Rozemberczki , Lauren Watson , Péter Bayer , Hao-Tsung Yang , Olivér Kiss , Sebastian Nilsson , Rik Sarkar

In the past years, many new explanation methods have been proposed to achieve interpretability of machine learning predictions. However, the utility of these methods in practical applications has not been researched extensively. In this…

Machine Learning · Computer Science 2019-07-09 Hilde J. P. Weerts , Werner van Ipenburg , Mykola Pechenizkiy

Shapley values are today extensively used as a model-agnostic explanation framework to explain complex predictive machine learning models. Shapley values have desirable theoretical properties and a sound mathematical foundation in the field…

Machine Learning · Statistics 2022-08-16 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

The field of explainable AI (XAI) has quickly become a thriving and prolific community. However, a silent, recurrent and acknowledged issue in this area is the lack of consensus regarding its terminology. In particular, each new…

Artificial Intelligence · Computer Science 2021-11-03 Sebastian Palacio , Adriano Lucieri , Mohsin Munir , Jörn Hees , Sheraz Ahmed , Andreas Dengel

Predominately in explainable artificial intelligence (XAI) research, the Shapley value (SV) is applied to determine feature attributions for any black box model. Shapley interaction indices extend the SV to define any-order feature…

Machine Learning · Computer Science 2023-10-31 Fabian Fumagalli , Maximilian Muschalik , Patrick Kolpaczki , Eyke Hüllermeier , Barbara Hammer

We propose probabilistic Shapley inference (PSI), a novel probabilistic framework to model and infer sufficient statistics of feature attributions in flexible predictive models, via latent random variables whose mean recovers Shapley…

Machine Learning · Computer Science 2025-09-09 Mert Ketenci , Iñigo Urteaga , Victor Alfonso Rodriguez , Noémie Elhadad , Adler Perotte

Explainable artificial intelligence (XAI) enables data-driven understanding of factor associations with response variables, yet communicating XAI outputs to laypersons remains challenging, hindering trust in AI-based predictions. Large…

Artificial Intelligence · Computer Science 2026-03-13 Tomoaki Yamaguchi , Yutong Zhou , Masahiro Ryo , Keisuke Katsura

The Shapley value (SV) is adopted in various scenarios in machine learning (ML), including data valuation, agent valuation, and feature attribution, as it satisfies their fairness requirements. However, as exact SVs are infeasible to…

Machine Learning · Computer Science 2022-12-02 Zijian Zhou , Xinyi Xu , Rachael Hwee Ling Sim , Chuan Sheng Foo , Kian Hsiang Low

We propose a novel definition of Shapley values with uncertain value functions based on first principles using probability theory. Such uncertain value functions can arise in the context of explainable machine learning as a result of…

Machine Learning · Computer Science 2023-04-03 Raoul Heese , Sascha Mücke , Matthias Jakobs , Thore Gerlach , Nico Piatkowski

A popular explainable AI (XAI) approach to quantify feature importance of a given model is via Shapley values. These Shapley values arose in cooperative games, and hence a critical ingredient to compute these in an XAI context is a…

Machine Learning · Computer Science 2022-02-25 Chih-Kuan Yeh , Kuan-Yun Lee , Frederick Liu , Pradeep Ravikumar

We propose and study a framework for quantifying the importance of the choices of parameter values to the result of a query over a database. These parameters occur as constants in logical queries, such as conjunctive queries. In our…

Databases · Computer Science 2024-11-19 Amir Gilad , Martin Grohe , Benny Kimelfeld , Peter Lindner , Christoph Standke

Artificial Intelligence (AI) has become essential for analyzing complex data and solving highly-challenging tasks. It is being applied across numerous disciplines beyond computer science, including Food Engineering, where there is a growing…

Many important questions about a model cannot be answered just by explaining how much each feature contributes to its output. To answer a broader set of questions, we generalize a popular, mathematically well-grounded explanation technique,…

Machine Learning · Computer Science 2020-06-16 Dillon Bowen , Lyle Ungar

The recent criticisms of the robustness of post hoc model approximation explanation methods (like LIME and SHAP) have led to the rise of model-precise abductive explanations. For each data point, abductive explanations provide a minimal…

Artificial Intelligence · Computer Science 2023-10-13 Gagan Biradar , Yacine Izza , Elita Lobo , Vignesh Viswanathan , Yair Zick

Explainable artificial intelligence (XAI) is motivated by the problem of making AI predictions understandable, transparent, and responsible, as AI becomes increasingly impactful in society and high-stakes domains. The evaluation and…

Artificial Intelligence · Computer Science 2025-06-02 Weina Jin , Xiaoxiao Li , Ghassan Hamarneh

Current practice in interpretable machine learning often focuses on explaining the final model trained from data, e.g., by using the Shapley additive explanations (SHAP) method. The recently developed Shapley variable importance cloud…

Machine Learning · Computer Science 2022-12-19 Yilin Ning , Mingxuan Liu , Nan Liu

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe