中文
相关论文

相关论文: Data Shapley in One Training Run

200 篇论文

Large Language Models (LLMs) are increasingly used in systems that retrieve and summarize content from multiple sources, such as search engines and AI assistants. While these systems enhance user experience through coherent summaries, they…

计算与语言 · 计算机科学 2026-01-08 Zikun Ye , Hema Yoganarasimhan

Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning. In this paper, we first discuss fundamental concepts of cooperative game theory and axiomatic…

We propose probabilistic Shapley inference (PSI), a novel probabilistic framework to model and infer sufficient statistics of feature attributions in flexible predictive models, via latent random variables whose mean recovers Shapley…

机器学习 · 计算机科学 2025-09-09 Mert Ketenci , Iñigo Urteaga , Victor Alfonso Rodriguez , Noémie Elhadad , Adler Perotte

We develop a new, principled algorithm for estimating the contribution of training data points to the behavior of a deep learning model, such as a specific prediction it makes. Our algorithm estimates the AME, a quantity that measures the…

机器学习 · 计算机科学 2022-06-22 Jinkun Lin , Anqi Zhang , Mathias Lecuyer , Jinyang Li , Aurojit Panda , Siddhartha Sen

The application of Shapley values to high-dimensional, time-series-like data is computationally challenging - and sometimes impossible. For $N$ inputs the problem is $2^N$ hard. In image processing, clusters of pixels, referred to as…

定量方法 · 定量生物学 2024-09-30 Lauren Elborough , Duncan Taylor , Melissa Humphries

Data attribution methods quantify the influence of training data on model outputs and are becoming increasingly relevant for a wide range of LLM research and applications, including dataset curation, model interpretability, data valuation.…

计算与语言 · 计算机科学 2025-10-28 Cathy Jiao , Yijun Pan , Emily Xiao , Daisy Sheng , Niket Jain , Hanzhang Zhao , Ishita Dasgupta , Jiaqi W. Ma , Chenyan Xiong

Explainable AI (XAI) has become an increasingly important topic for understanding and attributing the predictions made by complex Time Series Classification (TSC) models. Among attribution methods, SHapley Additive exPlanations (SHAP) is…

人工智能 · 计算机科学 2025-09-05 Davide Italo Serramazza , Nikos Papadeas , Zahraa Abdallah , Georgiana Ifrim

One of the most popular methods of the machine learning prediction explanation is the SHapley Additive exPlanations method (SHAP). An imprecise SHAP as a modification of the original SHAP is proposed for cases when the class probability…

机器学习 · 计算机科学 2021-06-18 Lev V. Utkin , Andrei V. Konstantinov , Kirill A. Vishniakov

Training data attribution (TDA) methods aim to identify which training examples influence a model's predictions on specific test data most. By quantifying these influences, TDA supports critical applications such as data debugging,…

机器学习 · 计算机科学 2025-05-30 Xingyuan Pan , Chenlu Ye , Joseph Melkonian , Jiaqi W. Ma , Tong Zhang

We consider an investment process that includes a number of features, each of which can be active or inactive. Our goal is to attribute or decompose an achieved performance to each of these features, plus a baseline value. There are many…

计算金融 · 定量金融 2021-02-12 Nicholas Moehle , Stephen Boyd , Andrew Ang

In this article, we provide an axiomatic characterization of feature attribution for multi-output predictors within the Shapley framework. While SHAP explanations are routinely computed independently for each output coordinate, the…

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

机器学习 · 计算机科学 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

As data plays an increasingly pivotal role in decision-making, the emergence of data markets underscores the growing importance of data valuation. Within the machine learning landscape, Data Shapley stands out as a widely embraced method…

机器学习 · 统计学 2024-07-30 Mengmeng Wu , Zhihong Liu , Xiang Li , Ruoxi Jia , Xiangyu Chang

With the adoption of machine learning-based solutions in routine clinical practice, the need for reliable interpretability tools has become pressing. Shapley values provide local explanations. The method gained popularity in recent years.…

统计方法学 · 统计学 2023-06-27 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes

A learning algorithm $A$ trained on a dataset $D$ is revealed to have poor performance on some subpopulation at test time. Where should the responsibility for this lay? It can be argued that the data is responsible, if for example training…

机器学习 · 计算机科学 2021-05-04 Gal Yona , Amirata Ghorbani , James Zou

As an effective approach to quantify how training samples influence test sample, data attribution is crucial for understanding data and model and further enhance the transparency of machine learning models. We find that prevailing data…

机器学习 · 计算机科学 2025-08-08 Linxiao Yang , Xinyu Gu , Liang Sun

Recent work on time-series models has leveraged self-supervised training to learn meaningful features and patterns in order to improve performance on downstream tasks and generalize to unseen modalities. While these pretraining methods have…

机器学习 · 计算机科学 2026-04-10 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Data-driven artificial intelligence models require explainability in intelligent manufacturing to streamline adoption and trust in modern industry. However, recently developed explainable artificial intelligence (XAI) techniques that…

机器学习 · 计算机科学 2025-02-04 Joseph Cohen , Xun Huan , Jun Ni

We introduce a framework for optimizing domain-specific dataset construction in foundation model training. Specifically, we seek a cost-efficient way to estimate the quality of data sources (e.g. synthetically generated or filtered web…

Feature selection is one of the most relevant processes in any methodology for creating a statistical learning model. Usually, existing algorithms establish some criterion to select the most influential variables, discarding those that do…

机器学习 · 统计学 2024-05-10 Carlos Sebastián , Carlos E. González-Guillén