English
Related papers

Related papers: Data Shapley in One Training Run

200 papers

Large Language Models (LLMs) are increasingly used in systems that retrieve and summarize content from multiple sources, such as search engines and AI assistants. While these systems enhance user experience through coherent summaries, they…

Computation and Language · Computer Science 2026-01-08 Zikun Ye , Hema Yoganarasimhan

Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning. In this paper, we first discuss fundamental concepts of cooperative game theory and axiomatic…

Machine Learning · Computer Science 2022-05-27 Benedek Rozemberczki , Lauren Watson , Péter Bayer , Hao-Tsung Yang , Olivér Kiss , Sebastian Nilsson , Rik Sarkar

We propose probabilistic Shapley inference (PSI), a novel probabilistic framework to model and infer sufficient statistics of feature attributions in flexible predictive models, via latent random variables whose mean recovers Shapley…

Machine Learning · Computer Science 2025-09-09 Mert Ketenci , Iñigo Urteaga , Victor Alfonso Rodriguez , Noémie Elhadad , Adler Perotte

We develop a new, principled algorithm for estimating the contribution of training data points to the behavior of a deep learning model, such as a specific prediction it makes. Our algorithm estimates the AME, a quantity that measures the…

Machine Learning · Computer Science 2022-06-22 Jinkun Lin , Anqi Zhang , Mathias Lecuyer , Jinyang Li , Aurojit Panda , Siddhartha Sen

The application of Shapley values to high-dimensional, time-series-like data is computationally challenging - and sometimes impossible. For $N$ inputs the problem is $2^N$ hard. In image processing, clusters of pixels, referred to as…

Quantitative Methods · Quantitative Biology 2024-09-30 Lauren Elborough , Duncan Taylor , Melissa Humphries

Data attribution methods quantify the influence of training data on model outputs and are becoming increasingly relevant for a wide range of LLM research and applications, including dataset curation, model interpretability, data valuation.…

Computation and Language · Computer Science 2025-10-28 Cathy Jiao , Yijun Pan , Emily Xiao , Daisy Sheng , Niket Jain , Hanzhang Zhao , Ishita Dasgupta , Jiaqi W. Ma , Chenyan Xiong

Explainable AI (XAI) has become an increasingly important topic for understanding and attributing the predictions made by complex Time Series Classification (TSC) models. Among attribution methods, SHapley Additive exPlanations (SHAP) is…

Artificial Intelligence · Computer Science 2025-09-05 Davide Italo Serramazza , Nikos Papadeas , Zahraa Abdallah , Georgiana Ifrim

One of the most popular methods of the machine learning prediction explanation is the SHapley Additive exPlanations method (SHAP). An imprecise SHAP as a modification of the original SHAP is proposed for cases when the class probability…

Machine Learning · Computer Science 2021-06-18 Lev V. Utkin , Andrei V. Konstantinov , Kirill A. Vishniakov

Training data attribution (TDA) methods aim to identify which training examples influence a model's predictions on specific test data most. By quantifying these influences, TDA supports critical applications such as data debugging,…

Machine Learning · Computer Science 2025-05-30 Xingyuan Pan , Chenlu Ye , Joseph Melkonian , Jiaqi W. Ma , Tong Zhang

We consider an investment process that includes a number of features, each of which can be active or inactive. Our goal is to attribute or decompose an achieved performance to each of these features, plus a baseline value. There are many…

Computational Finance · Quantitative Finance 2021-02-12 Nicholas Moehle , Stephen Boyd , Andrew Ang

In this article, we provide an axiomatic characterization of feature attribution for multi-output predictors within the Shapley framework. While SHAP explanations are routinely computed independently for each output coordinate, the…

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

As data plays an increasingly pivotal role in decision-making, the emergence of data markets underscores the growing importance of data valuation. Within the machine learning landscape, Data Shapley stands out as a widely embraced method…

Machine Learning · Statistics 2024-07-30 Mengmeng Wu , Zhihong Liu , Xiang Li , Ruoxi Jia , Xiangyu Chang

With the adoption of machine learning-based solutions in routine clinical practice, the need for reliable interpretability tools has become pressing. Shapley values provide local explanations. The method gained popularity in recent years.…

Methodology · Statistics 2023-06-27 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes

A learning algorithm $A$ trained on a dataset $D$ is revealed to have poor performance on some subpopulation at test time. Where should the responsibility for this lay? It can be argued that the data is responsible, if for example training…

Machine Learning · Computer Science 2021-05-04 Gal Yona , Amirata Ghorbani , James Zou

As an effective approach to quantify how training samples influence test sample, data attribution is crucial for understanding data and model and further enhance the transparency of machine learning models. We find that prevailing data…

Machine Learning · Computer Science 2025-08-08 Linxiao Yang , Xinyu Gu , Liang Sun

Recent work on time-series models has leveraged self-supervised training to learn meaningful features and patterns in order to improve performance on downstream tasks and generalize to unseen modalities. While these pretraining methods have…

Machine Learning · Computer Science 2026-04-10 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Data-driven artificial intelligence models require explainability in intelligent manufacturing to streamline adoption and trust in modern industry. However, recently developed explainable artificial intelligence (XAI) techniques that…

Machine Learning · Computer Science 2025-02-04 Joseph Cohen , Xun Huan , Jun Ni

We introduce a framework for optimizing domain-specific dataset construction in foundation model training. Specifically, we seek a cost-efficient way to estimate the quality of data sources (e.g. synthetically generated or filtered web…

Feature selection is one of the most relevant processes in any methodology for creating a statistical learning model. Usually, existing algorithms establish some criterion to select the most influential variables, discarding those that do…

Machine Learning · Statistics 2024-05-10 Carlos Sebastián , Carlos E. González-Guillén
‹ Prev 1 3 4 5 6 7 10 Next ›