English
Related papers

Related papers: Geometric Data Valuation via Leverage Scores

200 papers

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic

Suppose an $n \times d$ design matrix in a linear regression problem is given, but the response for each point is hidden unless explicitly requested. The goal is to sample only a small number $k \ll n$ of the responses, and then produce a…

Machine Learning · Computer Science 2018-09-06 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

Data augmentation via synthetic data generation has been shown to be effective in improving model performance and robustness in the context of scarce or low-quality data. Using the data valuation framework to statistically identify…

Machine Learning · Computer Science 2025-02-11 Tommaso Ferracci , Leonie Tabea Goldmann , Anton Hinel , Francesco Sanna Passino

Bayesian methodologies prioritising accurate associations above sparsity in Gaussian graphical model (GGM) estimation remain relatively scarce in scientific literature. It is well accepted that the $\ell_2$ penalty enjoys a smaller…

Methodology · Statistics 2022-10-31 J. Smith , M. Arashi , A. Bekker

Machine Learning is becoming increasingly more important in today's world. It is therefore very important to provide understanding of the decision-making process of machine-learning models. A popular way to do this is by looking at the…

Machine Learning · Statistics 2025-10-07 David van Batenburg

Finding valuable training data points for deep neural networks has been a core research challenge with many applications. In recent years, various techniques for calculating the "value" of individual training datapoints have been proposed…

Machine Learning · Computer Science 2021-04-29 Soumi Das , Arshdeep Singh , Saptarshi Chatterjee , Suparna Bhattacharya , Sourangshu Bhattacharya

Random Fourier features is a widely used, simple, and effective technique for scaling up kernel methods. The existing theoretical analysis of the approach, however, remains focused on specific learning tasks and typically gives pessimistic…

Machine Learning · Statistics 2021-02-08 Zhu Li , Jean-Francois Ton , Dino Oglic , Dino Sejdinovic

The Shapley value has become a popular method to attribute the prediction of a machine-learning model on an input to its base features. The use of the Shapley value is justified by citing [16] showing that it is the \emph{unique} method…

Artificial Intelligence · Computer Science 2020-02-10 Mukund Sundararajan , Amir Najmi

SHAP scores represent the proposed use of the well-known Shapley values in eXplainable Artificial Intelligence (XAI). Recent work has shown that the exact computation of SHAP scores can produce unsatisfactory results. Concretely, for some…

Machine Learning · Computer Science 2024-12-20 Olivier Letoffe , Xuanxiang Huang , Joao Marques-Silva

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature…

Machine Learning · Statistics 2025-10-03 Wangxuan Fan , Siqi Li , Doudou Zhou , Yohei Okada , Chuan Hong , Molei Liu , Nan Liu

Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements…

Artificial Intelligence · Computer Science 2020-07-01 I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , Sorelle Friedler

Integrated gradients are widely employed to evaluate the contribution of input features in classification models because it satisfies the axioms for attribution of prediction. This method, however, requires an appropriate baseline for…

Machine Learning · Computer Science 2018-11-28 Kazuki Tachikawa , Yuji Kawai , Jihoon Park , Minoru Asada

Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad…

Machine Learning · Statistics 2021-03-09 Daniel Vidali Fryer , Inga Strümke , Hien Nguyen

Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values…

Machine Learning · Statistics 2020-02-07 Kjersti Aas , Martin Jullum , Anders Løland

Game-theoretic attribution techniques based on Shapley values are used to interpret black-box machine learning models, but their exact calculation is generally NP-hard, requiring approximation methods for non-trivial models. As the…

Machine Learning · Statistics 2022-02-04 Rory Mitchell , Joshua Cooper , Eibe Frank , Geoffrey Holmes

Shapley effects are a particularly interpretable approach to assessing how a function depends on its various inputs. The existing literature contains various estimators for this class of sensitivity indices in the context of nonparametric…

Methodology · Statistics 2025-05-27 Akira Horiguchi , Matthew T. Pratola

Pixel-level feature attributions are an important tool in eXplainable AI for Computer Vision (XCV), providing visual insights into how image features influence model predictions. The Owen formula for hierarchical Shapley values has been…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Muhammad Rashid , Elvio G. Amparore , Enrico Ferrari , Damiano Verda

The game-theoretic notion of the semivalue offers a popular framework for credit attribution and data valuation in machine learning. Semivalues have been proposed for a variety of high-stakes decisions involving data, such as determining…

Machine Learning · Computer Science 2025-06-17 Hannah Diehl , Ashia C. Wilson

Shapley values are today extensively used as a model-agnostic explanation framework to explain complex predictive machine learning models. Shapley values have desirable theoretical properties and a sound mathematical foundation in the field…

Machine Learning · Statistics 2022-08-16 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

As opaque black-box predictive models become more prevalent, the need to develop interpretations for these models is of great interest. The concept of variable importance and Shapley values are interpretability measures that applies to any…

Machine Learning · Statistics 2025-03-10 Zexuan Sun , Garvesh Raskutti