中文
相关论文

相关论文: Data Shapley in One Training Run

200 篇论文

Developing modern machine learning (ML) applications is data-centric, of which one fundamental challenge is to understand the influence of data quality to ML training -- "Which training examples are 'guilty' in making the trained ML model…

机器学习 · 计算机科学 2022-04-28 Bojan Karlaš , David Dao , Matteo Interlandi , Bo Li , Sebastian Schelter , Wentao Wu , Ce Zhang

Large language models (LLMs) demonstrate strong capabilities in in-context learning, but verifying the correctness of their generated responses remains a challenge. Prior work has explored attribution at the sentence level, but these…

计算与语言 · 计算机科学 2025-07-10 Yingtai Xiao , Yuqing Zhu , Sirat Samyoun , Wanrong Zhang , Jiachen T. Wang , Jian Du

In this paper, we propose ShapTST, a framework that enables time-series transformers to efficiently generate Shapley-value-based explanations alongside predictions in a single forward pass. Shapley values are widely used to evaluate the…

机器学习 · 计算机科学 2025-01-28 Qisen Cheng , Jinming Xing , Chang Xue , Xiaoran Yang

As diffusion models are deployed in real-world settings, and their performance is driven by training data, appraising the contribution of data contributors is crucial to creating incentives for sharing quality data and to implementing…

机器学习 · 计算机科学 2025-03-05 Chris Lin , Mingyu Lu , Chanwoo Kim , Su-In Lee

Fair credit assignment is essential in various machine learning (ML) applications, and Shapley values have emerged as a valuable tool for this purpose. However, in critical ML applications such as data valuation and feature attribution, the…

机器学习 · 计算机科学 2025-03-11 Pranoy Panda , Siddharth Tandon , Vineeth N Balasubramanian

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

机器学习 · 计算机科学 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

Collaborative machine learning enables multiple data owners to jointly train models for improved predictive performance. However, ensuring incentive compatibility and fair contribution-based rewards remains a critical challenge. Prior work…

计算机科学与博弈论 · 计算机科学 2025-10-16 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

"How much is my data worth?" is an increasingly common question posed by organizations and individuals alike. An answer to this question could allow, for instance, fairly distributing profits among multiple data contributors and determining…

机器学习 · 计算机科学 2023-03-07 Ruoxi Jia , David Dao , Boxin Wang , Frances Ann Hubis , Nick Hynes , Nezihe Merve Gurel , Bo Li , Ce Zhang , Dawn Song , Costas Spanos

We consider the dataset valuation problem, that is, the problem of quantifying the incremental gain, to some relevant pre-defined utility of a machine learning task, of aggregating an individual dataset to others. The Shapley value is a…

人工智能 · 计算机科学 2025-02-25 Felipe Garrido-Lucero , Benjamin Heymann , Maxime Vono , Patrick Loiseau , Vianney Perchet

As data emerges as a vital driver of technological and economic advancements, a key challenge is accurately quantifying its value in algorithmic decision-making. The Shapley value, a well-established concept from cooperative game theory,…

计算机科学与博弈论 · 计算机科学 2025-11-20 Xi Zheng , Xiangyu Chang , Ruoxi Jia , Yong Tan

Data attribution has become an important component of pricing, auditing, and governance in machine learning pipelines, yet most attribution methods implicitly assume that attribution values faithfully reflect participants' contributions. We…

机器学习 · 计算机科学 2026-05-18 Xian Gao , Bo Hui , Min-Te Sun , Wei-Shinn Ku

Feature attribution methods such as SHapley Additive exPlanations (SHAP) have become instrumental in understanding machine learning models, but their role in guiding model optimization remains underexplored. In this paper, we propose a…

机器学习 · 计算机科学 2025-08-01 Amal Saadallah

While large text-to-image models are able to synthesize "novel" images, these images are necessarily a reflection of the training data. The problem of data attribution in such models -- which of the images in the training set are most…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Sheng-Yu Wang , Alexei A. Efros , Jun-Yan Zhu , Richard Zhang

Attribution scores can be applied in data management to quantify the contribution of individual items to conclusions from the data, as part of the explanation of what led to these conclusions. In Artificial Intelligence, Machine Learning,…

数据库 · 计算机科学 2024-01-15 Leopoldo Bertossi , Benny Kimelfeld , Ester Livshits , Mikaël Monet

Although Shapley values have been shown to be highly effective for identifying harmful training instances, dataset size and model complexity constraints limit the ability to apply Shapley-based data valuation to fine-tuning large…

计算与语言 · 计算机科学 2023-06-21 Stephanie Schoch , Ritwick Mishra , Yangfeng Ji

Originally introduced in cooperative game theory, Shapley values have become a very popular tool to explain machine learning predictions. Based on Shapley's fairness axioms, every input (feature component) gets a credit how it contributes…

机器学习 · 统计学 2025-08-19 Michael Mayer , Mario V. Wüthrich

Automated data preparation pipeline construction is critical for machine learning success, yet existing methods suffer from two fundamental limitations: they treat pipeline construction as black-box optimization without quantifying…

数据库 · 计算机科学 2025-11-03 Jing Chang , Chang Liu , Jinbin Huang , Shuyuan Zheng , Rui Mao , Jianbin Qin

As large language models are increasingly trained and fine-tuned, practitioners need methods to identify which training data drive specific behaviors, particularly unintended ones. Training Data Attribution (TDA) methods address this by…

Feature attribution methods help make machine learning-based inference explainable by determining how much one or several features have contributed to a model's output. A particularly popular attribution method is based on the Shapley value…

人工智能 · 计算机科学 2025-11-04 Filip Naudot , Tobias Sundqvist , Timotheus Kampik

Training data attribution (TDA) plays a critical role in understanding the influence of individual training data points on model predictions. Gradient-based TDA methods, popularized by \textit{influence function} for their superior…

机器学习 · 计算机科学 2025-09-17 Shiyuan Zhang , Junwei Deng , Juhan Bae , Jiaqi Ma