English
Related papers

Related papers: Consistent feature attribution for tree ensembles

200 papers

Feature attribution methods based on game theory are ubiquitous in the field of eXplainable Artificial Intelligence (XAI). Recent works proposed rigorous feature attribution using logic-based explanations, specifically targeting high-stakes…

Artificial Intelligence · Computer Science 2025-08-19 Xuanxiang Huang , Olivier Létoffé , Joao Marques-Silva

Feature attributions are a common paradigm for model explanations due to their simplicity in assigning a single numeric score for each input feature to a model. In the actionable recourse setting, wherein the goal of the explanations is to…

Machine Learning · Computer Science 2022-05-17 Emanuele Albini , Jason Long , Danial Dervovic , Daniele Magazzeni

Anomaly detection algorithms are often thought to be limited because they don't facilitate the process of validating results performed by domain experts. In Contrast, deep learning algorithms for anomaly detection, such as autoencoders,…

Machine Learning · Computer Science 2020-07-02 Liat Antwarg , Ronnie Mindlin Miller , Bracha Shapira , Lior Rokach

In healthcare, making the best possible predictions with complex models (e.g., neural networks, ensembles/stacks of different models) can impact patient welfare. In order to make these complex models explainable, we present DeepSHAP for…

Machine Learning · Computer Science 2019-11-28 Hugh Chen , Scott Lundberg , Su-In Lee

Feature-importance methods show promise in transforming machine learning models from predictive engines into tools for scientific discovery. However, due to data sampling and algorithmic stochasticity, expressive models can be unstable,…

Machine Learning · Statistics 2026-05-29 Joseph Paillard , Angel Reyero Lobo , Denis A. Engemann , Bertrand Thirion

Shapley additive explanations (SHAP) are widely recognised as computationally intractable for neural networks, since they induce an exponential search space over the input features. In this work, we take a first step towards scaling exact…

Machine Learning · Computer Science 2026-05-26 David Boetius , Shahaf Bassan , Guy Katz , Stefan Leue , Tobias Sutter

We propose a modification that corrects for split-improvement variable importance measures in Random Forests and other tree-based methods. These methods have been shown to be biased towards increasing the importance of features with more…

Machine Learning · Statistics 2020-03-25 Zhengze Zhou , Giles Hooker

Decision trees are well-known due to their ease of interpretability. To improve accuracy, we need to grow deep trees or ensembles of trees. These are hard to interpret, offsetting their original benefits. Shapley values have recently become…

Machine Learning · Computer Science 2023-01-26 Peng Yu , Chao Xu , Albert Bifet , Jesse Read

We consider an investment process that includes a number of features, each of which can be active or inactive. Our goal is to attribute or decompose an achieved performance to each of these features, plus a baseline value. There are many…

Computational Finance · Quantitative Finance 2021-02-12 Nicholas Moehle , Stephen Boyd , Andrew Ang

Random Forests have been one of the most popular bagging methods in the past few decades, especially due to their success at handling tabular datasets. They have been extensively studied and compared to boosting models, like XGBoost, which…

Machine Learning · Computer Science 2024-10-28 Dimitris Bertsimas , Vasiliki Stoumpou

Shapley values are extensively used in explainable artificial intelligence (XAI) as a framework to explain predictions made by complex machine learning (ML) models. In this work, we focus on conditional Shapley values for predictive models…

Machine Learning · Statistics 2023-12-07 Lars Henry Berge Olsen

As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has become popular in…

Artificial Intelligence · Computer Science 2024-04-18 Nils Ole Breuer , Andreas Sauter , Majid Mohammadi , Erman Acar

Disturbances to the climate system, both natural and anthropogenic, have far reaching impacts that are not always easy to identify or quantify using traditional climate science analyses or causal modeling techniques. In this paper, we…

Machine Learning · Computer Science 2024-12-30 Meredith G. L. Brown , Matt Peterson , Irina Tezaur , Kara Peterson , Diana Bull

The increasing complexity of foundational models underscores the necessity for explainability, particularly for fine-tuning, the most widely used training method for adapting models to downstream tasks. Instance attribution, one type of…

Machine Learning · Computer Science 2024-06-10 Jingtan Wang , Xiaoqiang Lin , Rui Qiao , Chuan-Sheng Foo , Bryan Kian Hsiang Low

This study focuses on the problem of credit default prediction, builds a modeling framework based on machine learning, and conducts comparative experiments on a variety of mainstream classification algorithms. Through preprocessing, feature…

Machine Learning · Computer Science 2026-02-24 Shiqi Yang , Ziyi Huang , Wengran Xiao , Xinyu Shen

Recent work demonstrated the existence of critical flaws in the current use of Shapley values in explainable AI (XAI), i.e. the so-called SHAP scores. These flaws are significant in that the scores provided to a human decision-maker can be…

Artificial Intelligence · Computer Science 2025-02-18 Joao Marques-Silva , Xuanxiang Huang , Olivier Letoffe

Shapley value is a classic notion from game theory, historically used to quantify the contributions of individuals within groups, and more recently applied to assign values to data points when training machine learning models. Despite its…

Machine Learning · Computer Science 2020-02-28 Amirata Ghorbani , Michael P. Kim , James Zou

The Shapley value is one of the most widely used measures of feature importance partly as it measures a feature's average effect on a model's prediction. We introduce joint Shapley values, which directly extend Shapley's axioms and…

Machine Learning · Statistics 2022-02-11 Chris Harris , Richard Pymar , Colin Rowat

Machine learning (ML) for transient stability assessment has gained traction due to the significant increase in computational requirements as renewables connect to power systems. To achieve a high degree of accuracy; black-box ML models are…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Robert I. Hamilton , Panagiotis N. Papadopoulos

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic