English
Related papers

Related papers: Inferring feature importance with uncertainties in…

200 papers

Machine Learning (ML) is gaining popularity for hypothesis-free discovery of risk and protective factors in healthcare studies. ML is strong at discovering nonlinearities and interactions, but this power is compromised by a lack of reliable…

Machine Learning · Statistics 2026-01-01 Giorgio Spadaccini , Marjolein Fokkema , Mark A. van de Wiel

Shapley values are widely used for model-agnostic data valuation and feature attribution, yet they implicitly assume contributors are interchangeable. This can be problematic when contributors are dependent (e.g., reused/augmented data or…

Machine Learning · Computer Science 2026-02-11 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang

Recent advances in game informatics have enabled us to find strong strategies across a diverse range of games. However, these strategies are usually difficult for humans to interpret. On the other hand, research in Explainable Artificial…

Multiagent Systems · Computer Science 2024-03-13 Satoru Fujii

In this paper, we consider a perturbation-based metric of predictive faithfulness of feature rankings (or attributions) that we call PGI squared. When applied to decision tree-based regression models, the metric can be computed accurately…

Machine Learning · Computer Science 2025-02-26 Mateusz Gajewski , Adam Karczmarz , Mateusz Rapicki , Piotr Sankowski

Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to attribute model predictions to specific input features. However, computing Shapley values exactly is…

Machine Learning · Computer Science 2025-03-11 Christopher Musco , R. Teal Witter

Attribution scores reflect how important the feature values in an input entity are for the output of a machine learning model. One of the most popular attribution scores is the SHAP score, which is an instantiation of the general Shapley…

Artificial Intelligence · Computer Science 2024-08-14 Santiago Cifuentes , Leopoldo Bertossi , Nina Pardal , Sergio Abriola , Maria Vanina Martinez , Miguel Romero

eXplainable Artificial Intelligence (XAI) is a sub-field of Artificial Intelligence (AI) that is at the forefront of AI research. In XAI, feature attribution methods produce explanations in the form of feature importance. People often use…

Artificial Intelligence · Computer Science 2022-02-09 Jamie Duell , Monika Seisenberger , Gert Aarts , Shangming Zhou , Xiuyi Fan

Despite their ubiquitous use, Shapley value feature attributions can be misleading due to feature interaction in both model and data. We propose an alternative attribution approach, Shapley Sets, which awards value to sets of features.…

Machine Learning · Computer Science 2023-07-06 Torty Sivill , Peter Flach

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

Machine Learning · Computer Science 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam

This paper makes the case for using Shapley value to quantify the importance of random input variables to a function. Alternatives based on the ANOVA decomposition can run into conceptual and computational problems when the input variables…

Statistics Theory · Mathematics 2017-03-22 Art B. Owen , Clémentine Prieur

Ensemble forecasts often outperform forecasts from individual standalone models, and have been used to support decision-making and policy planning in various fields. As collaborative forecasting efforts to create effective ensembles grow,…

Methodology · Statistics 2026-01-12 Minsu Kim , Evan L. Ray , Nicholas G. Reich

Shapley values has established itself as one of the most appropriate and theoretically sound frameworks for explaining predictions from complex machine learning models. The popularity of Shapley values in the explanation setting is probably…

Machine Learning · Statistics 2021-06-24 Martin Jullum , Annabelle Redelmeier , Kjersti Aas

Shapley values are today extensively used as a model-agnostic explanation framework to explain complex predictive machine learning models. Shapley values have desirable theoretical properties and a sound mathematical foundation in the field…

Machine Learning · Statistics 2022-08-16 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

In global sensitivity analysis, the well known Sobol' sensitivity indices aim to quantify how the variance in the output of a mathematical model can be apportioned to the different variances of its input random variables. These indices are…

Statistics Theory · Mathematics 2018-01-11 Nazih Benoumechiara , Kevin Elie-Dit-Cosaque

Random forests have been widely used for their ability to provide so-called importance measures, which give insight at a global (per dataset) level on the relevance of input variables to predict a certain output. On the other hand, methods…

Machine Learning · Statistics 2021-11-04 Antonio Sutera , Gilles Louppe , Van Anh Huynh-Thu , Louis Wehenkel , Pierre Geurts

In many studies, we want to determine the influence of certain features on a dependent variable. More specifically, we are interested in the strength of the influence -- i.e., is the feature relevant? -- and, if so, how the feature…

Machine Learning · Statistics 2023-03-03 Yannick Gerstorfer , Lena Krieg , Max Hahn-Klimroth

In this paper we introduce a metric aimed at helping machine learning practitioners quickly summarize and communicate the overall importance of each feature in any black-box machine learning prediction model. Our proposed metric, based on a…

Methodology · Statistics 2019-08-27 Nickalus Redell

As opaque black-box predictive models become more prevalent, the need to develop interpretations for these models is of great interest. The concept of variable importance and Shapley values are interpretability measures that applies to any…

Machine Learning · Statistics 2025-03-10 Zexuan Sun , Garvesh Raskutti

Feature selection is a classical problem in statistics and machine learning, and it continues to remain an extremely challenging problem especially in the context of unknown non-linear relationships with dependent features. On the other…

Machine Learning · Statistics 2026-04-17 Chenghui Zheng , Garvesh Raskutti

Understanding why a model makes a certain prediction can be as crucial as the prediction's accuracy in many applications. However, the highest accuracy for large modern datasets is often achieved by complex models that even experts struggle…

Artificial Intelligence · Computer Science 2017-11-28 Scott Lundberg , Su-In Lee