English
Related papers

Related papers: Fast Calculation of Feature Contributions in Boost…

200 papers

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

While shallow decision trees may be interpretable, larger ensemble models like gradient-boosted trees, which often set the state of the art in machine learning problems involving tabular data, still remain black box models. As a remedy, the…

Machine Learning · Computer Science 2024-06-21 Maximilian Muschalik , Fabian Fumagalli , Barbara Hammer , Eyke Hüllermeier

Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values…

Machine Learning · Statistics 2020-02-07 Kjersti Aas , Martin Jullum , Anders Løland

Shapley values are widely used to explain black-box models, but they are costly to calculate because they require many model evaluations. We introduce FastSHAP, a method for estimating Shapley values in a single forward pass using a learned…

Machine Learning · Statistics 2022-03-24 Neil Jethani , Mukund Sudarshan , Ian Covert , Su-In Lee , Rajesh Ranganath

SHAP is one of the most popular local feature-attribution methods. Given a function f and an input x, it quantifies each feature's contribution to f(x). Recently, SHAP has been increasingly used for global insights: practitioners average…

Machine Learning · Computer Science 2025-04-01 Robi Bhattacharjee , Karolin Frohnapfel , Ulrike von Luxburg

Distributional data Shapley value (DShapley) has recently been proposed as a principled framework to quantify the contribution of individual datum in machine learning. DShapley develops the foundational game theory concept of Shapley values…

Machine Learning · Statistics 2021-02-19 Yongchan Kwon , Manuel A. Rivas , James Zou

Machine and deep learning have grown in popularity and use in biological research over the last decade but still present challenges in interpretability of the fitted model. The development and use of metrics to determine features driving…

Machine Learning · Statistics 2025-07-31 Daniel Claborne , Javier Flores , Samantha Erwin , Luke Durell , Rachel Richardson , Ruby Fore , Lisa Bramer

Shapley values are widely recognized as a principled method for attributing importance to input features in machine learning. However, the exact computation of Shapley values scales exponentially with the number of features, severely…

Machine Learning · Computer Science 2025-08-21 Majid Mohammadi , Krikamol Muandet , Ilaria Tiddi , Annette Ten Teije , Siu Lun Chau

Clustering algorithms often assume all features contribute equally to the data structure, an assumption that usually fails in high-dimensional or noisy settings. Feature weighting methods can address this, but most require additional…

Machine Learning · Computer Science 2025-08-12 Richard J. Fawley , Renato Cordeiro de Amorim

SHapley Additive exPlanations (SHAP) is a key tool for interpreting decision tree ensembles by assigning contribution values to features. It is widely used in finance, advertising, medicine, and other domains. Two main approaches to SHAP…

Machine Learning · Computer Science 2026-04-14 Alexander Nadel , Ron Wettenstein

SHAP (SHapley Additive exPlanation) values provide a game theoretic interpretation of the predictions of machine learning models based on Shapley values. While exact calculation of SHAP values is computationally intractable in general, a…

Machine Learning · Computer Science 2022-02-04 Rory Mitchell , Eibe Frank , Geoffrey Holmes

We study the efficient computation of Shapley values for \emph{product games} -- cooperative games in which the coalition value factorizes as a product of per-player terms. Such games arise in machine learning explainability whenever the…

Machine Learning · Computer Science 2026-05-19 Majid Mohammadi , Grigory Reznikov , Pavel Sinitcyn , Krikamol Muandet , Siu Lun Chau

Feature selection is a classical problem in statistics and machine learning, and it continues to remain an extremely challenging problem especially in the context of unknown non-linear relationships with dependent features. On the other…

Machine Learning · Statistics 2026-04-17 Chenghui Zheng , Garvesh Raskutti

This work aims to address an open problem in data valuation literature concerning the efficient computation of Data Shapley for weighted $K$ nearest neighbor algorithm (WKNN-Shapley). By considering the accuracy of hard-label KNN with…

Data Structures and Algorithms · Computer Science 2024-01-23 Jiachen T. Wang , Prateek Mittal , Ruoxi Jia

Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to attribute model predictions to specific input features. However, computing Shapley values exactly is…

Machine Learning · Computer Science 2025-03-11 Christopher Musco , R. Teal Witter

Shapley-related techniques have gained attention as both global and local interpretation tools because of their desirable properties. However, their computation using conditional expectations is computationally expensive. Approximation…

Machine Learning · Statistics 2022-07-13 Zhipu Zhou , Jie Chen , Linwei Hu

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic

Shapley additive explanations (SHAP) are widely recognised as computationally intractable for neural networks, since they induce an exponential search space over the input features. In this work, we take a first step towards scaling exact…

Machine Learning · Computer Science 2026-05-26 David Boetius , Shahaf Bassan , Guy Katz , Stefan Leue , Tobias Sutter

In healthcare, making the best possible predictions with complex models (e.g., neural networks, ensembles/stacks of different models) can impact patient welfare. In order to make these complex models explainable, we present DeepSHAP for…

Machine Learning · Computer Science 2019-11-28 Hugh Chen , Scott Lundberg , Su-In Lee

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee