English
Related papers

Related papers: From global to local MDI variable importances for …

200 papers

Feature and Interaction Importance (FII) methods are essential in supervised learning for assessing the relevance of input variables and their interactions in complex prediction models. In many domains, such as personalized medicine, local…

Machine Learning · Statistics 2025-12-15 Kata Vuk , Nicolas Alexander Ihlo , Merle Behr

We discuss promising recent contributions on quantifying feature relevance using Shapley values, where we observed some confusion on which probability distribution is the right one for dropped features. We argue that the confusion is based…

Machine Learning · Statistics 2019-11-28 Dominik Janzing , Lenon Minorics , Patrick Blöbaum

We introduce a new Shapley value approach for global sensitivity analysis and machine learning explainability. The method is based on the first-order partial derivatives of the underlying function. The computational complexity of the method…

Machine Learning · Computer Science 2023-03-28 Hui Duan , Giray Ökten

This paper introduces and develops a novel variable importance score function in the context of ensemble learning and demonstrates its appeal both theoretically and empirically. Our proposed score function is simple and more straightforward…

Machine Learning · Statistics 2015-01-27 Ernest Fokoué

Variable importance measures are the main tools to analyze the black-box mechanisms of random forests. Although the mean decrease accuracy (MDA) is widely accepted as the most efficient variable importance measure for random forests, little…

Machine Learning · Statistics 2022-03-02 Clément Bénard , Sébastien da Veiga , Erwan Scornet

Shapley values are widely used for model-agnostic data valuation and feature attribution, yet they implicitly assume contributors are interchangeable. This can be problematic when contributors are dependent (e.g., reused/augmented data or…

Machine Learning · Computer Science 2026-02-11 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang

We propose probabilistic Shapley inference (PSI), a novel probabilistic framework to model and infer sufficient statistics of feature attributions in flexible predictive models, via latent random variables whose mean recovers Shapley…

Machine Learning · Computer Science 2025-09-09 Mert Ketenci , Iñigo Urteaga , Victor Alfonso Rodriguez , Noémie Elhadad , Adler Perotte

In clinical prediction settings the importance of a high-dimensional feature like genomics is often assessed by evaluating the change in predictive performance when adding it to a set of traditional clinical variables. This approach is…

Machine Learning · Statistics 2026-03-06 Mark A. van de Wiel , Jeroen Goedhart , Martin Jullum , Kjersti Aas

There is much interest lately in explainability in statistics and machine learning. One aspect of explainability is to quantify the importance of various features (or covariates). Two popular methods for defining variable importance are…

Methodology · Statistics 2023-03-13 Isabella Verdinelli , Larry Wasserman

We propose Group Shapley, a metric that extends the classical individual-level Shapley value framework to evaluate the importance of feature groups, addressing the structured nature of predictors commonly found in business and economic…

Machine Learning · Statistics 2025-01-07 Jingyi Wang , Ying Chen , Paolo Giudici

Shapley data valuation provides a principled, axiomatic framework for assigning importance to individual datapoints, and has gained traction in dataset curation, pruning, and pricing. However, it is a combinatorial measure that requires…

Machine Learning · Computer Science 2025-11-05 Rodrigo Mendoza-Smith

Causal random forests provide efficient estimates of heterogeneous treatment effects. However, forest algorithms are also well-known for their black-box nature, and therefore, do not characterize how input variables are involved in…

Machine Learning · Statistics 2023-08-08 Clément Bénard , Julie Josse

It is becoming increasingly important to explain complex, black-box machine learning models. Although there is an expanding literature on this topic, Shapley values stand out as a sound method to explain predictions from any type of machine…

Machine Learning · Statistics 2020-07-03 Annabelle Redelmeier , Martin Jullum , Kjersti Aas

The true population-level importance of a variable in a prediction task provides useful knowledge about the underlying data-generating mechanism and can help in deciding which measurements to collect in subsequent experiments. Valid…

Methodology · Statistics 2025-10-23 Brian D. Williamson , Jean Feng

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

Machine Learning · Computer Science 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam

Performing (variance-based) global sensitivity analysis (GSA) with dependent inputs has recently benefited from cooperative game theory concepts.By using this theory, despite the potential correlation between the inputs, meaningful…

Statistics Theory · Mathematics 2022-10-25 Margot Herin , Marouane Il Idrissi , Vincent Chabridon , Bertrand Iooss

In this paper, we consider a perturbation-based metric of predictive faithfulness of feature rankings (or attributions) that we call PGI squared. When applied to decision tree-based regression models, the metric can be computed accurately…

Machine Learning · Computer Science 2025-02-26 Mateusz Gajewski , Adam Karczmarz , Mateusz Rapicki , Piotr Sankowski

Reliability-oriented sensitivity analysis methods have been developed for understanding the influence of model inputs relative to events which characterize the failure of a system (e.g., a threshold exceedance of the model output). In this…

Statistics Theory · Mathematics 2025-07-04 Marouane Il Idrissi , Vincent Chabridon , Bertrand Iooss

A shortcoming of black-box supervised learning models is their lack of interpretability or transparency. To facilitate interpretation, post-hoc global variable importance measures (VIMs) are widely used to assign to each predictor or input…

Methodology · Statistics 2025-12-25 Jingyu Zhu , Daniel W. Apley

With the adoption of machine learning-based solutions in routine clinical practice, the need for reliable interpretability tools has become pressing. Shapley values provide local explanations. The method gained popularity in recent years.…

Methodology · Statistics 2023-06-27 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes