English
Related papers

Related papers: Beyond Additivity: Sparse Isotonic Shapley Regress…

200 papers

A powerful concept behind much of the recent progress in machine learning is the extraction of common features across data from heterogeneous sources or tasks. Intuitively, using all of one's data to learn a common representation function…

Machine Learning · Statistics 2024-10-15 Thomas T. C. K. Zhang , Leonardo F. Toso , James Anderson , Nikolai Matni

The Shapley value has become a popular method to attribute the prediction of a machine-learning model on an input to its base features. The use of the Shapley value is justified by citing [16] showing that it is the \emph{unique} method…

Artificial Intelligence · Computer Science 2020-02-10 Mukund Sundararajan , Amir Najmi

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, additive models consider…

Machine Learning · Statistics 2017-10-18 Sheng Chen , Arindam Banerjee

The increasing complexity of foundational models underscores the necessity for explainability, particularly for fine-tuning, the most widely used training method for adapting models to downstream tasks. Instance attribution, one type of…

Machine Learning · Computer Science 2024-06-10 Jingtan Wang , Xiaoqiang Lin , Rui Qiao , Chuan-Sheng Foo , Bryan Kian Hsiang Low

This paper introduces the shapr R package, a versatile tool for generating Shapley value-based prediction explanations for machine learning and statistical regression models. Moreover, the shaprpy Python library brings the core capabilities…

Machine Learning · Computer Science 2026-02-03 Martin Jullum , Lars Henry Berge Olsen , Jon Lachmann , Annabelle Redelmeier

We present a novel framework for estimation and inference with the broad class of universal approximators. Estimation is based on the decomposition of model predictions into Shapley values. Inference relies on analyzing the bias and…

Machine Learning · Statistics 2024-12-06 Andreas Joseph

Originally rooted in game theory, the Shapley Value (SV) has recently become an important tool in machine learning research. Perhaps most notably, it is used for feature attribution and data valuation in explainable artificial intelligence.…

Missing data is a prevalent issue that can significantly impair model performance and explainability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and…

Machine Learning · Computer Science 2025-01-23 Tuan L. Vo , Thu Nguyen , Luis M. Lopez-Ramos , Hugo L. Hammer , Michael A. Riegler , Pal Halvorsen

Recent progress in scaling large models has motivated recommender systems to increase model depth and capacity to better leverage massive behavioral data. However, recommendation inputs are high-dimensional and extremely sparse, and simply…

Information Retrieval · Computer Science 2026-04-23 Yantao Yu , Sen Qiao , Lei Shen , Bing Wang , Xiaoyi Zeng

Estimating feature importance is a significant aspect of explaining data-based models. Besides explaining the model itself, an equally relevant question is which features are important in the underlying data generating process. We present a…

Machine Learning · Computer Science 2021-09-21 Pål Vegard Johnsen , Inga Strümke , Signe Riemer-Sørensen , Andrew Thomas DeWan , Mette Langaas

The proliferation of large models has intensified the need for efficient data valuation methods to quantify the contribution of individual data providers. Traditional approaches, such as game-theory-based Shapley value and…

Artificial Intelligence · Computer Science 2025-09-24 Le Ma , Shirao Yang , Zihao Wang , Yinggui Wang , Lei Wang , Tao Wei , Kejun Zhang

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

Explainability and fairness have mainly been considered separately, with recent exceptions trying the explain the sources of unfairness. This paper shows that the Shapley value can be used to both define and explain unfairness, under…

Machine Learning · Computer Science 2026-03-31 Fadoua Amri-Jouidel , Emmanuel Kemel , Stéphane Mussard

When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among…

Machine Learning · Computer Science 2022-03-03 Yasunobu Nohara , Koutarou Matsumoto , Hidehisa Soejima , Naoki Nakashima

Computing the importance of features in supervised classification tasks is critical for model interpretability. Shapley values are a widely used approach for explaining model predictions, but require direct access to the underlying model,…

Machine Learning · Computer Science 2026-05-18 Joao Fonseca , Julia Stoyanovich

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

The growing environmental footprint of artificial intelligence (AI), especially in terms of storage and computation, calls for more frugal and interpretable models. Sparse models (e.g., linear, neural networks) offer a promising solution by…

Machine Learning · Statistics 2025-09-23 Sylvain Sardy , Maxime van Cutsem , Xiaoyu Ma

Shapley values have emerged as a widely accepted and trustworthy tool, grounded in theoretical axioms, for addressing challenges posed by black-box models like deep neural networks. However, computing Shapley values encounters exponential…

Machine Learning · Computer Science 2024-05-24 Borui Zhang , Baotong Tian , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Sparse linear models are one of several core tools for interpretable machine learning, a field of emerging importance as predictive models permeate decision-making in many domains. Unfortunately, sparse linear models are far less flexible…

Machine Learning · Statistics 2024-01-03 Ryan Thompson , Amir Dezfouli , Robert Kohn

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami