English
Related papers

Related papers: Improved Feature Importance Computations for Tree …

200 papers

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

Machine Learning · Statistics 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

Interpretability of learning algorithms is crucial for applications involving critical decisions, and variable importance is one of the main interpretation tools. Shapley effects are now widely used to interpret both tree ensembles and…

Machine Learning · Statistics 2022-02-03 Clément Bénard , Gérard Biau , Sébastien da Veiga , Erwan Scornet

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

We revisit the use of probabilistic values, which include the well-known Shapley and Banzhaf values, to rank features for explaining the local predicted values of decision trees. The quality of feature rankings is typically assessed with…

Machine Learning · Computer Science 2026-04-22 Weida Li , Yaoliang Yu , Bryan Kian Hsiang Low

Banzhaf values provide a popular, interpretable alternative to the widely-used Shapley values for quantifying the importance of features in machine learning models. Like Shapley values, computing Banzhaf values exactly requires time…

Machine Learning · Computer Science 2025-02-19 Yurong Liu , R. Teal Witter , Flip Korn , Tarfah Alrashed , Dimitris Paparas , Christopher Musco , Juliana Freire

Decision trees are well-known due to their ease of interpretability. To improve accuracy, we need to grow deep trees or ensembles of trees. These are hard to interpret, offsetting their original benefits. Shapley values have recently become…

Machine Learning · Computer Science 2023-01-26 Peng Yu , Chao Xu , Albert Bifet , Jesse Read

With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in explainable AI. They are used for feature attribution, data attribution, data valuation, and more.…

Machine Learning · Computer Science 2026-01-14 R. Teal Witter , Yurong Liu , Christopher Musco

SHAP (SHapley Additive exPlanation) values are one of the leading tools for interpreting machine learning models, with strong theoretical guarantees (consistency, local accuracy) and a wide availability of implementations and use cases.…

Machine Learning · Computer Science 2022-07-28 Jilei Yang

Due to their power and ease of use, tree-based machine learning models, such as random forests and gradient-boosted tree ensembles, have become very popular. To interpret them, local feature attributions based on marginal expectations, e.g.…

Machine Learning · Computer Science 2024-05-09 Khashayar Filom , Alexey Miroshnikov , Konstandinos Kotsiopoulos , Arjun Ravi Kannan

Shapley-related techniques have gained attention as both global and local interpretation tools because of their desirable properties. However, their computation using conditional expectations is computationally expensive. Approximation…

Machine Learning · Statistics 2022-07-13 Zhipu Zhou , Jie Chen , Linwei Hu

Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost with respect to the…

Machine Learning · Computer Science 2022-12-06 Gabriel Laberge , Yann Pequignot

Shapley values have become a cornerstone of explainable AI, but they are computationally expensive to use, especially when features are dependent. Evaluating them requires approximating a large number of conditional expectations, either via…

Artificial Intelligence · Computer Science 2026-02-11 Lars Henry Berge Olsen , Dennis Christensen

Shapley values are a standard tool for explaining predictions of tree ensembles, with Path-Dependent SHAP being the most widely used variant. Despite substantial progress, existing methods still exhibit trade-offs between depth-dependent…

Machine Learning · Computer Science 2026-05-07 Ron Wettenstein , Rory Mitchell , Peng Yu

Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kanglong Fan , Yunqiao Yang , Chen Ma

Shapley and Banzhaf interactions capture the complex dynamics inherent in modern machine learning applications. However, current estimators for these higher-order interactions trade off between speed and accuracy. To overcome this…

While shallow decision trees may be interpretable, larger ensemble models like gradient-boosted trees, which often set the state of the art in machine learning problems involving tabular data, still remain black box models. As a remedy, the…

Machine Learning · Computer Science 2024-06-21 Maximilian Muschalik , Fabian Fumagalli , Barbara Hammer , Eyke Hüllermeier

Despite the popularity of Shapley Values in explaining neural text classification models, computing them is prohibitive for large pretrained models due to a large number of model evaluations. In practice, Shapley Values are often estimated…

Computation and Language · Computer Science 2023-06-01 Chenghao Yang , Fan Yin , He He , Kai-Wei Chang , Xiaofei Ma , Bing Xiang

Shapley values are great analytical tools in game theory to measure the importance of a player in a game. Due to their axiomatic and desirable properties such as efficiency, they have become popular for feature importance analysis in data…

Machine Learning · Computer Science 2020-10-26 Ramin Okhrati , Aldo Lipani

The problem of explaining the behavior of deep neural networks has recently gained a lot of attention. While several attribution methods have been proposed, most come without strong theoretical foundations, which raises questions about…

Machine Learning · Computer Science 2019-06-24 Marco Ancona , Cengiz Öztireli , Markus Gross

Shapley values have become one of the most popular feature attribution explanation methods. However, most prior work has focused on post-hoc Shapley explanations, which can be computationally demanding due to its exponential time complexity…

Machine Learning · Computer Science 2021-04-07 Rui Wang , Xiaoqian Wang , David I. Inouye
‹ Prev 1 2 3 10 Next ›