English
Related papers

Related papers: Understanding Interventional TreeSHAP : How and Wh…

200 papers

In this growing age of data and technology, large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex data patterns. The deficiency of these methods, however, is their…

Machine Learning · Computer Science 2026-04-09 Justin Lin , Julia Fukuyama

In healthcare, making the best possible predictions with complex models (e.g., neural networks, ensembles/stacks of different models) can impact patient welfare. In order to make these complex models explainable, we present DeepSHAP for…

Machine Learning · Computer Science 2019-11-28 Hugh Chen , Scott Lundberg , Su-In Lee

Shapley values are model-agnostic methods for explaining model predictions. Many commonly used methods of computing Shapley values, known as off-manifold methods, rely on model evaluations on out-of-distribution input samples. Consequently,…

Machine Learning · Statistics 2023-02-28 Muhammad Faaiz Taufiq , Patrick Blöbaum , Lenon Minorics

Due to their power and ease of use, tree-based machine learning models, such as random forests and gradient-boosted tree ensembles, have become very popular. To interpret them, local feature attributions based on marginal expectations, e.g.…

Machine Learning · Computer Science 2024-05-09 Khashayar Filom , Alexey Miroshnikov , Konstandinos Kotsiopoulos , Arjun Ravi Kannan

Feature attribution methods help make machine learning-based inference explainable by determining how much one or several features have contributed to a model's output. A particularly popular attribution method is based on the Shapley value…

Artificial Intelligence · Computer Science 2025-11-04 Filip Naudot , Tobias Sundqvist , Timotheus Kampik

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

SHAP (SHapley Additive exPlanations) has become a popular method to attribute the prediction of a machine learning model on an input to its features. One main challenge of SHAP is the computation time. An exact computation of Shapley values…

Machine Learning · Statistics 2023-09-06 Linwei Hu , Ke Wang

This study proposes Interaction Tensor SHAP (IT-SHAP), a tensor algebraic formulation of the Shapley Taylor Interaction Index (STII) that makes its computational structure explicit. STII extends the Shapley value to higher order…

Machine Learning · Computer Science 2026-01-06 Hiroki Hasegawa , Yukihiko Okada

Shapley values underlie one of the most popular model-agnostic methods within explainable artificial intelligence. These values are designed to attribute the difference between a model's prediction and an average baseline to the different…

Artificial Intelligence · Computer Science 2020-11-04 Tom Heskes , Evi Sijben , Ioan Gabriel Bucur , Tom Claassen

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

Machine Learning · Computer Science 2020-06-29 Luke Merrick , Ankur Taly

The Shapley value is a ubiquitous framework for attribution in machine learning, encompassing feature importance, data valuation, and causal inference. However, its exact computation is generally intractable, necessitating efficient…

Machine Learning · Computer Science 2026-02-03 Fabian Fumagalli , Landon Butler , Justin Singh Kang , Kannan Ramchandran , R. Teal Witter

SHAP explanations are a popular feature-attribution mechanism for explainable AI. They use game-theoretic notions to measure the influence of individual features on the prediction of a machine learning model. Despite a lot of recent…

Artificial Intelligence · Computer Science 2021-02-02 Guy Van den Broeck , Anton Lykov , Maximilian Schleich , Dan Suciu

Shapley value is a popular approach for measuring the influence of individual features. While Shapley feature attribution is built upon desiderata from game theory, some of its constraints may be less natural in certain machine learning…

Machine Learning · Computer Science 2022-09-28 Yongchan Kwon , James Zou

Recently, SHapley Additive exPlanations (SHAP) has been widely utilized in various research domains. This is particularly evident in application fields, where SHAP analysis serves as a crucial tool for identifying biomarkers and assisting…

Computation · Statistics 2026-02-02 Kyungjin Kim , Youngro Lee , Jongmo Seo

We study instancewise feature importance scoring as a method for model interpretation. Any such method yields, for each predicted instance, a vector of importance scores associated with the feature vector. Methods based on the Shapley score…

Machine Learning · Computer Science 2018-08-09 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan

Shapley effects are a particularly interpretable approach to assessing how a function depends on its various inputs. The existing literature contains various estimators for this class of sensitivity indices in the context of nonparametric…

Methodology · Statistics 2025-05-27 Akira Horiguchi , Matthew T. Pratola

Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kanglong Fan , Yunqiao Yang , Chen Ma

Interpreting predictions from tree ensemble methods such as gradient boosting machines and random forests is important, yet feature attribution for trees is often heuristic and not individualized for each prediction. Here we show that…

Machine Learning · Computer Science 2019-03-08 Scott M. Lundberg , Gabriel G. Erion , Su-In Lee

Shapley values has established itself as one of the most appropriate and theoretically sound frameworks for explaining predictions from complex machine learning models. The popularity of Shapley values in the explanation setting is probably…

Machine Learning · Statistics 2021-06-24 Martin Jullum , Annabelle Redelmeier , Kjersti Aas

Machine Learning (ML) is gaining popularity for hypothesis-free discovery of risk and protective factors in healthcare studies. ML is strong at discovering nonlinearities and interactions, but this power is compromised by a lack of reliable…

Machine Learning · Statistics 2026-01-01 Giorgio Spadaccini , Marjolein Fokkema , Mark A. van de Wiel