English
Related papers

Related papers: SHAP for additively modeled features in a boosted …

200 papers

We propose PathBoost, a gradient tree boosting method for graph-level classification and regression that learns discriminative path-based features directly from the input graph structure. Building on a previous work, which was tailored to a…

Machine Learning · Computer Science 2026-05-12 Claudio Meggio , Johan Pensar , Riccardo De Bin

Shapley values are model-agnostic methods for explaining model predictions. Many commonly used methods of computing Shapley values, known as off-manifold methods, rely on model evaluations on out-of-distribution input samples. Consequently,…

Machine Learning · Statistics 2023-02-28 Muhammad Faaiz Taufiq , Patrick Blöbaum , Lenon Minorics

We discuss promising recent contributions on quantifying feature relevance using Shapley values, where we observed some confusion on which probability distribution is the right one for dropped features. We argue that the confusion is based…

Machine Learning · Statistics 2019-11-28 Dominik Janzing , Lenon Minorics , Patrick Blöbaum

Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving complex problems. However, training these systems remains notoriously difficult due to the…

Artificial Intelligence · Computer Science 2026-02-10 Yanming Li , Xuelin Zhang , WenJie Lu , Ziye Tang , Maodong Wu , Haotian Luo , Tongtong Wu , Zijie Peng , Hongze Mi , Yibo Feng , Naiqiang Tan , Chao Huang , Hong Chen , Li Shen

The use of Shap scores has become widespread in Explainable AI. However, their computation is in general intractable, in particular when done with a black-box classifier, such as neural network. Recent research has unveiled classes of…

Artificial Intelligence · Computer Science 2023-07-25 Leopoldo Bertossi , Jorge E. Leon

This research paper explores the impact of various input parameters, including Infill percentage, Layer Height, Extrusion Temperature, and Print Speed, on the resulting Tensile Strength in objects produced through additive manufacturing.…

Machine Learning · Computer Science 2023-05-31 Akshansh Mishra , Vijaykumar S Jatti

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

Machine Learning · Computer Science 2021-04-26 Ian Covert , Su-In Lee

Shapley values have become one of the go-to methods to explain complex models to end-users. They provide a model agnostic post-hoc explanation with foundations in game theory: what is the worth of a player (in machine learning, a feature…

Machine Learning · Computer Science 2023-06-21 Joran Michiels , Maarten De Vos , Johan Suykens

SHAP is one of the most popular local feature-attribution methods. Given a function f and an input x, it quantifies each feature's contribution to f(x). Recently, SHAP has been increasingly used for global insights: practitioners average…

Machine Learning · Computer Science 2025-04-01 Robi Bhattacharjee , Karolin Frohnapfel , Ulrike von Luxburg

Hyperparameter optimization (HPO) is a crucial step in achieving strong predictive performance. Yet, the impact of individual hyperparameters on model generalization is highly context-dependent, prohibiting a one-size-fits-all solution and…

Machine Learning · Computer Science 2025-11-11 Marcel Wever , Maximilian Muschalik , Fabian Fumagalli , Marius Lindauer

Post-hoc explanations are widely used to justify, contest, and review automated decisions in high-stakes domains such as lending, employment, and healthcare. Among these methods, SHAP is often treated as providing a reliable account of…

Machine Learning · Computer Science 2026-01-27 Hyunseung Hwang , Seungeun Lee , Lucas Rosenblatt , Steven Euijong Whang , Julia Stoyanovich

Multimodal AI models have achieved impressive performance in tasks that require integrating information from multiple modalities, such as vision and language. However, their "black-box" nature poses a major barrier to deployment in…

Artificial Intelligence · Computer Science 2026-02-18 Zhanliang Wang , Kai Wang

Surging interest in deep learning from high-stakes domains has precipitated concern over the inscrutable nature of black box neural networks. Explainable AI (XAI) research has led to an abundance of explanation algorithms for these black…

Machine Learning · Computer Science 2023-10-31 Zachariah Carmichael , Walter J. Scheirer

In the context of human-in-the-loop Machine Learning applications, like Decision Support Systems, interpretability approaches should provide actionable insights without making the users wait. In this paper, we propose Accelerated…

Machine Learning · Computer Science 2021-12-24 David Dandolo , Chiara Masiero , Mattia Carletti , Davide Dalle Pezze , Gian Antonio Susto

We identify first-mover bias -- path-dependent concentration of SHAP feature importance from sequential residual fitting in gradient boosting -- as a mechanistic contributor to attribution instability under multicollinearity. Scaling up a…

Machine Learning · Computer Science 2026-04-08 Drake Caraker , Bryan Arnold , David Rhoads

Existing feature attribution methods like SHAP often suffer from global dependence, failing to capture true local model behavior. This paper introduces VARSHAP, a novel model-agnostic local feature attribution method which uses the…

Machine Learning · Computer Science 2025-06-10 Mateusz Gajewski , Mikołaj Morzy , Adam Karczmarz , Piotr Sankowski

Local feature-based explanations are a key component of the XAI toolkit. These explanations compute feature importance values relative to an ``interpretable'' feature representation. In tabular data, feature values themselves are often…

Machine Learning · Computer Science 2025-05-14 Hyunseung Hwang , Andrew Bell , Joao Fonseca , Venetia Pliatsika , Julia Stoyanovich , Steven Euijong Whang

This study analyzes the Ames Housing Dataset using CatBoost and LightGBM models to explore feature importance and causal relationships in housing price prediction. We examine the correlation between SHAP values and EconML predictions,…

Machine Learning · Computer Science 2024-09-25 Muhammad Arbab Arshad , Pallavi Kandanur , Saurabh Sonawani , Laiba Batool , Muhammad Umar Habib

Originally introduced in cooperative game theory, Shapley values have become a very popular tool to explain machine learning predictions. Based on Shapley's fairness axioms, every input (feature component) gets a credit how it contributes…

Machine Learning · Statistics 2025-08-19 Michael Mayer , Mario V. Wüthrich

Time-series forecasting underpins critical decisions across aviation, energy, retail and health. Classical autoregressive integrated moving average (ARIMA) models offer interpretability via coefficients but struggle with nonlinearities,…

Machine Learning · Computer Science 2025-08-25 Manish Shukla