English
Related papers

Related papers: Understanding Interventional TreeSHAP : How and Wh…

200 papers

SHAP (SHapley Additive exPlanations) values are a widely used method for local feature attribution in interpretable and explainable AI. We propose an efficient two-stage algorithm for computing SHAP values in both black-box setting and…

Machine Learning · Computer Science 2025-10-24 Ali Gorji , Andisheh Amrollahi , Andreas Krause

Shapley values are a standard tool for explaining predictions of tree ensembles, with Path-Dependent SHAP being the most widely used variant. Despite substantial progress, existing methods still exhibit trade-offs between depth-dependent…

Machine Learning · Computer Science 2026-05-07 Ron Wettenstein , Rory Mitchell , Peng Yu

Interpretability is central for scientific machine learning, as understanding \emph{why} models make predictions enables hypothesis generation and validation. While tabular foundation models show strong performance, existing explanation…

Machine Learning · Computer Science 2026-04-01 Luan Borges Teodoro Reis Sena , Francisco Galuppo Azevedo

The overarching goal of Explainable AI is to develop systems that not only exhibit intelligent behaviours, but also are able to explain their rationale and reveal insights. In explainable machine learning, methods that produce a high level…

Artificial Intelligence · Computer Science 2020-05-06 Xiuyi Fan , Siyuan Liu , Thomas C. Henderson

Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to attribute model predictions to specific input features. However, computing Shapley values exactly is…

Machine Learning · Computer Science 2025-03-11 Christopher Musco , R. Teal Witter

Changes in input distribution can induce shifts in the average predictions of machine learning models. Such prediction shifts may impact downstream business outcomes (e.g. a bank's loan approval rate), so understanding their causes can be…

Machine Learning · Computer Science 2026-04-14 Tom Bewley , Salim I. Amoukou , Emanuele Albini , Saumitra Mishra , Manuela Veloso

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

Shapley-related techniques have gained attention as both global and local interpretation tools because of their desirable properties. However, their computation using conditional expectations is computationally expensive. Approximation…

Machine Learning · Statistics 2022-07-13 Zhipu Zhou , Jie Chen , Linwei Hu

Originally introduced in cooperative game theory, Shapley values have become a very popular tool to explain machine learning predictions. Based on Shapley's fairness axioms, every input (feature component) gets a credit how it contributes…

Machine Learning · Statistics 2025-08-19 Michael Mayer , Mario V. Wüthrich

Besides accuracy, recent studies on machine learning models have been addressing the question on how the obtained results can be interpreted. Indeed, while complex machine learning models are able to provide very good results in terms of…

Machine Learning · Computer Science 2022-11-07 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte , Michel Grabisch

Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements…

Artificial Intelligence · Computer Science 2020-07-01 I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , Sorelle Friedler

Unpacking and comprehending how black-box machine learning algorithms make decisions has been a persistent challenge for researchers and end-users. Explaining time-series predictive models is useful for clinical applications with high…

Machine Learning · Computer Science 2023-05-09 Amin Nayebi , Sindhu Tipirneni , Chandan K Reddy , Brandon Foreman , Vignesh Subbian

Explainability in yield prediction helps us fully explore the potential of machine learning models that are already able to achieve high accuracy for a variety of yield prediction scenarios. The data included for the prediction of yields…

Machine Learning · Computer Science 2023-04-17 Florian Huber , Hannes Engler , Anna Kicherer , Katja Herzog , Reinhard Töpfer , Volker Steinhage

Local feature attribution methods are increasingly used to explain complex machine learning models. However, current methods are limited because they are extremely expensive to compute or are not capable of explaining a distributed series…

Machine Learning · Computer Science 2022-10-12 Hugh Chen , Scott M. Lundberg , Su-In Lee

Understanding predictions made by Machine Learning models is critical in many applications. In this work, we investigate the performance of two methods for explaining tree-based models- Tree Interpreter (TI) and SHapley Additive…

Artificial Intelligence · Computer Science 2020-10-15 Pulkit Sharma , Shezan Rohinton Mirzan , Apurva Bhandari , Anish Pimpley , Abhiram Eswaran , Soundar Srinivasan , Liqun Shao

Deep Neural Networks are widely used in academy as well as corporate and public applications, including safety critical applications such as health care and autonomous driving. The ability to explain their output is critical for safety…

Machine Learning · Computer Science 2024-03-14 Florian Eilers , Xiaoyi Jiang

Among explainability techniques, SHAP stands out as one of the most popular, but often overlooks the causal structure of the problem. In response, do-SHAP employs interventional queries, but its reliance on estimands hinders its practical…

Machine Learning · Computer Science 2026-01-13 Álvaro Parafita , Tomas Garriga , Axel Brando , Francisco J. Cazorla

Interpretability of learning algorithms is crucial for applications involving critical decisions, and variable importance is one of the main interpretation tools. Shapley effects are now widely used to interpret both tree ensembles and…

Machine Learning · Statistics 2022-02-03 Clément Bénard , Gérard Biau , Sébastien da Veiga , Erwan Scornet

With the adoption of machine learning into routine clinical practice comes the need for Explainable AI methods tailored to medical applications. Shapley values have sparked wide interest for locally explaining models. Here, we demonstrate…

Machine Learning · Computer Science 2024-02-02 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes

Interpretable Machine Learning (IML) is expected to remove significant barriers for the application of Machine Learning (ML) algorithms in power systems. This letter first seeks to showcase the benefits of SHapley Additive exPlanations…