English
Related papers

Related papers: Explaining a Series of Models by Propagating Shapl…

200 papers

Recently, several fast algorithms have been proposed to decompose predicted value into Shapley values, enabling individualized feature contribution analysis in tree models. While such local decomposition offers valuable insights, it…

Machine Learning · Statistics 2025-05-28 Zhongli Jiang , Min Zhang , Dabao Zhang

Local feature-based explanations are a key component of the XAI toolkit. These explanations compute feature importance values relative to an ``interpretable'' feature representation. In tabular data, feature values themselves are often…

Machine Learning · Computer Science 2025-05-14 Hyunseung Hwang , Andrew Bell , Joao Fonseca , Venetia Pliatsika , Julia Stoyanovich , Steven Euijong Whang

While SHAP (SHapley Additive exPlanations) and other feature attribution methods are commonly employed to explain model predictions, their application within information retrieval (IR), particularly for complex outputs such as ranked lists,…

Information Retrieval · Computer Science 2025-05-01 Maria Heuss , Maarten de Rijke , Avishek Anand

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

Machine Learning · Computer Science 2020-06-29 Luke Merrick , Ankur Taly

The use of data-driven methods in fluid mechanics has surged dramatically in recent years due to their capacity to adapt to the complex and multi-scale nature of turbulent flows, as well as to detect patterns in large-scale simulations or…

Fluid Dynamics · Physics 2024-09-19 Andrés Cremades , Sergio Hoyas , Ricardo Vinuesa

The deployment of Machine Learning models intraoperatively for tissue characterisation can assist decision making and guide safe tumour resections. For image classification models, pixel attribution methods are popular to infer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Alfie Roddan , Chi Xu , Serine Ajlouni , Irini Kakaletri , Patra Charalampaki , Stamatia Giannarou

Shapley values provide model agnostic feature attributions for model outcome at a particular instance by simulating feature absence under a global population distribution. The use of a global population can lead to potentially misleading…

Machine Learning · Computer Science 2021-06-29 Sahra Ghalebikesabi , Lucile Ter-Minassian , Karla Diaz-Ordaz , Chris Holmes

In recent years, two parallel research trends have emerged in machine learning, yet their intersections remain largely unexplored. On one hand, there has been a significant increase in literature focused on Individual Treatment Effect (ITE)…

Feature attribution methods identify which features of an input most influence a model's output. Most widely-used feature attribution methods (such as SHAP, LIME, and Grad-CAM) are "class-dependent" methods in that they generate a feature…

Machine Learning · Computer Science 2023-02-28 Neil Jethani , Adriel Saporta , Rajesh Ranganath

Feature attribution methods such as SHapley Additive exPlanations (SHAP) have become instrumental in understanding machine learning models, but their role in guiding model optimization remains underexplored. In this paper, we propose a…

Machine Learning · Computer Science 2025-08-01 Amal Saadallah

While preference modelling is becoming one of the pillars of machine learning, the problem of preference explanation remains challenging and underexplored. In this paper, we propose \textsc{Pref-SHAP}, a Shapley value-based model…

Machine Learning · Statistics 2022-11-09 Robert Hu , Siu Lun Chau , Jaime Ferrando Huertas , Dino Sejdinovic

Shapley values have become one of the go-to methods to explain complex models to end-users. They provide a model agnostic post-hoc explanation with foundations in game theory: what is the worth of a player (in machine learning, a feature…

Machine Learning · Computer Science 2023-06-21 Joran Michiels , Maarten De Vos , Johan Suykens

Understanding why a model makes a certain prediction can be as crucial as the prediction's accuracy in many applications. However, the highest accuracy for large modern datasets is often achieved by complex models that even experts struggle…

Artificial Intelligence · Computer Science 2017-11-28 Scott Lundberg , Su-In Lee

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

Machine Learning · Computer Science 2021-04-26 Ian Covert , Su-In Lee

Shapley values are model-agnostic methods for explaining model predictions. Many commonly used methods of computing Shapley values, known as off-manifold methods, rely on model evaluations on out-of-distribution input samples. Consequently,…

Machine Learning · Statistics 2023-02-28 Muhammad Faaiz Taufiq , Patrick Blöbaum , Lenon Minorics

Because of their strong theoretical properties, Shapley values have become very popular as a way to explain predictions made by black box models. Unfortuately, most existing techniques to compute Shapley values are computationally very…

Machine Learning · Computer Science 2022-08-29 Arne Gevaert , Yvan Saeys

Interpreting predictions from tree ensemble methods such as gradient boosting machines and random forests is important, yet feature attribution for trees is often heuristic and not individualized for each prediction. Here we show that…

Machine Learning · Computer Science 2019-03-08 Scott M. Lundberg , Gabriel G. Erion , Su-In Lee

As diffusion models are deployed in real-world settings, and their performance is driven by training data, appraising the contribution of data contributors is crucial to creating incentives for sharing quality data and to implementing…

Machine Learning · Computer Science 2025-03-05 Chris Lin , Mingyu Lu , Chanwoo Kim , Su-In Lee

SHAP (SHapley Additive exPlanations) has become a popular method to attribute the prediction of a machine learning model on an input to its features. One main challenge of SHAP is the computation time. An exact computation of Shapley values…

Machine Learning · Statistics 2023-09-06 Linwei Hu , Ke Wang

Explainable AI (XAI) is critical for ensuring transparency, accountability, and trust in machine learning systems as black-box models are increasingly deployed within high-stakes domains. Among XAI methods, Shapley values are widely used…

Machine Learning · Computer Science 2025-02-19 Jiaxin Xu , Hung Chau , Angela Burden