English
Related papers

Related papers: Exploring Training Data Attribution under Limited …

200 papers

Diffusion models have led to significant advancements in generative modelling. Yet their widespread adoption poses challenges regarding data attribution and interpretability. In this paper, we aim to help address such challenges in…

Machine Learning · Computer Science 2025-05-27 Bruno Mlodozeniec , Runa Eschenhagen , Juhan Bae , Alexander Immer , David Krueger , Richard Turner

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Deep neural networks are often considered opaque systems, prompting the need for explainability methods to improve trust and accountability. Existing approaches typically attribute test-time predictions either to input features (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Aziz Bacha , Thomas George

Unsupervised Domain Adaptation (UDA) aims at classifying unlabeled target images leveraging source labeled ones. In this work, we consider the Partial Domain Adaptation (PDA) variant, where we have extra source classes not present in the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Tiago Salvador , Kilian Fatras , Ioannis Mitliagkas , Adam Oberman

Reliable models should not only predict correctly, but also justify decisions with acceptable evidence. Yet conventional supervised learning typically provides only class-level labels, allowing models to achieve high accuracy through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ruoyu Chen , Shangquan Sun , Xiaoqing Guo , Sanyi Zhang , Kangwei Liu , Shiming Liu , Zhangcheng Wang , Qunli Zhang , Hua Zhang , Xiaochun Cao

Data attribution methods trace model behavior back to its training dataset, offering an effective approach to better understand ''black-box'' neural networks. While prior research has established quantifiable links between model output and…

Machine Learning · Computer Science 2024-07-30 Tong Xie , Haoyu Li , Andrew Bai , Cho-Jui Hsieh

Unsupervised domain adaptation (UDA) is a statistical learning problem when the distribution of training (source) data is different from that of test (target) data. In this setting, one has access to labeled data only from the source domain…

Machine Learning · Computer Science 2026-02-24 Seonghwi Kim , Sung Ho Jo , Wooseok Ha , Minwoo Chae

Adversarial adaptation models have demonstrated significant progress towards transferring knowledge from a labeled source dataset to an unlabeled target dataset. Partial domain adaptation (PDA) investigates the scenarios in which the source…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Mohsen Kheirandishfard , Fariba Zohrizadeh , Farhad Kamangar

Data attribution methods aim to answer useful counterfactual questions like "what would a ML model's prediction be if it were trained on a different dataset?" However, estimation of data attribution models through techniques like empirical…

Machine Learning · Computer Science 2025-08-19 Ari Karchmer , Martin Pawelczyk , Seth Neel

Language models (LMs) have been shown to memorize a great deal of factual knowledge contained in their training data. But when an LM generates an assertion, it is often difficult to determine where it learned this information and whether it…

Computation and Language · Computer Science 2022-10-26 Ekin Akyürek , Tolga Bolukbasi , Frederick Liu , Binbin Xiong , Ian Tenney , Jacob Andreas , Kelvin Guu

While conditional diffusion models have achieved remarkable success in various applications, they require abundant data to train from scratch, which is often infeasible in practice. To address this issue, transfer learning has emerged as an…

Machine Learning · Computer Science 2025-10-28 Ziheng Cheng , Tianyu Xie , Shiyue Zhang , Cheng Zhang

Data Shapley provides a principled framework for attributing data's contribution within machine learning contexts. However, existing approaches require re-training models on different data subsets, which is computationally intensive,…

Machine Learning · Computer Science 2025-06-10 Jiachen T. Wang , Prateek Mittal , Dawn Song , Ruoxi Jia

Domain adaptation is critical for learning in new and unseen environments. With domain adversarial training, deep networks can learn disentangled and transferable features that effectively diminish the dataset shift between the source and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zhangjie Cao , Kaichao You , Mingsheng Long , Jianmin Wang , Qiang Yang

There has been a tremendous progress in Domain Adaptation (DA) for visual recognition tasks. Particularly, open-set DA has gained considerable attention wherein the target domain contains additional unseen categories. Existing open-set DA…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jogendra Nath Kundu , Naveen Venkat , Ambareesh Revanur , Rahul M , R. Venkatesh Babu

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

Good models require good training data. For overparameterized deep models, the causal relationship between training data and model predictions is increasingly opaque and poorly understood. Influence analysis partially demystifies training's…

Machine Learning · Computer Science 2024-04-02 Zayd Hammoudeh , Daniel Lowd

Tabular data plays an important role in many fields and industries, including those with elevated privacy considerations and risks. As such, there is a rising interest in generating high-quality synthetic proxies for real tabular data as a…

Data attribution aims to explain model predictions by estimating how they would change if certain training points were removed, and is used in a wide range of applications, from interpretability and credit assignment to unlearning and…

Machine Learning · Computer Science 2026-05-19 Ittai Rubinstein , Samuel B. Hopkins

As graph representation learning often suffers from label scarcity problems in real-world applications, researchers have proposed graph domain adaptation (GDA) as an effective knowledge-transfer paradigm across graphs. In particular, to…

Machine Learning · Computer Science 2024-12-31 Boshen Shi , Yongqing Wang , Fangda Guo , Bingbing Xu , Huawei Shen , Xueqi Cheng