English
Related papers

Related papers: Intriguing Properties of Data Attribution on Diffu…

200 papers

Training data attribution (TDA) methods aim to measure how training data impacts a model's predictions. While gradient-based attribution methods, such as influence functions, offer theoretical grounding, their computational costs make them…

Machine Learning · Computer Science 2025-11-27 Weiwei Sun , Haokun Liu , Nikhil Kandpal , Colin Raffel , Yiming Yang

Training data attribution (TDA) plays a critical role in understanding the influence of individual training data points on model predictions. Gradient-based TDA methods, popularized by \textit{influence function} for their superior…

Machine Learning · Computer Science 2025-09-17 Shiyuan Zhang , Junwei Deng , Juhan Bae , Jiaqi Ma

To better understand the output of deep neural networks (DNN), attribution based methods have been an important approach for model interpretability, which assign a score for each input dimension to indicate its importance towards the model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Zhiyu Zhu , Huaming Chen , Jiayu Zhang , Xinyi Wang , Zhibo Jin , Minhui Xue , Dongxiao Zhu , Kim-Kwang Raymond Choo

Text-to-image (T2I) models have recently gained widespread adoption. This has spurred concerns about safeguarding intellectual property rights and an increasing demand for mechanisms that prevent the generation of specific artistic styles.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Anand Kumar , Jiteng Mu , Nuno Vasconcelos

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Diffusion models have achieved remarkable success in generating high-quality images thanks to their novel training procedures applied to unprecedented amounts of data. However, training a diffusion model from scratch is computationally…

Machine Learning · Computer Science 2023-03-28 Michał Zając , Kamil Deja , Anna Kuzina , Jakub M. Tomczak , Tomasz Trzciński , Florian Shkurti , Piotr Miłoś

Data attribution methods play a crucial role in understanding machine learning models, providing insight into which training data points are most responsible for model outputs during deployment. However, current state-of-the-art approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Vasu Singla , Pedro Sandoval-Segura , Micah Goldblum , Jonas Geiping , Tom Goldstein

Diffusion-based learning has settled as a rising paradigm in generative recommendation, outperforming traditional approaches built upon variational autoencoders and generative adversarial networks. Despite their effectiveness, concerns have…

Information Retrieval · Computer Science 2025-08-12 Daniele Malitesta , Giacomo Medda , Erasmo Purificato , Mirko Marras , Fragkiskos D. Malliaros , Ludovico Boratto

Diffusion models have shown remarkable abilities in generating realistic and high-quality images from text prompts. However, a trained model remains largely black-box; little do we know about the roles of its components in exhibiting a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Quang H. Nguyen , Hoang Phan , Khoa D. Doan

Feature attribution explains neural network outputs by identifying relevant input features. The attribution has to be faithful, meaning that the attributed features must mirror the input features that influence the output. One recent trend…

Machine Learning · Computer Science 2024-02-15 Yang Zhang , Yawei Li , Hannah Brown , Mina Rezaei , Bernd Bischl , Philip Torr , Ashkan Khakzar , Kenji Kawaguchi

While traditional recommendation techniques have made significant strides in the past decades, they still suffer from limited generalization performance caused by factors like inadequate collaborative signals, weak latent representations,…

Information Retrieval · Computer Science 2024-09-17 Jianghao Lin , Jiaqi Liu , Jiachen Zhu , Yunjia Xi , Chengkai Liu , Yangtian Zhang , Yong Yu , Weinan Zhang

Data attribution methods aim to quantify the influence of individual training samples on the prediction of artificial intelligence (AI) models. As training data plays an increasingly crucial role in the modern development of large-scale AI…

Machine Learning · Computer Science 2024-10-08 Junwei Deng , Ting-Wei Li , Shiyuan Zhang , Shixuan Liu , Yijun Pan , Hao Huang , Xinhe Wang , Pingbang Hu , Xingjian Zhang , Jiaqi W. Ma

In the landscape of generative artificial intelligence, diffusion-based models have emerged as a promising method for generating synthetic images. However, the application of diffusion models poses numerous challenges, particularly…

Machine Learning · Computer Science 2026-05-04 Simeon Allmendinger , Domenique Zipperling , Lukas Struppek , Niklas Kühl

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often…

Machine Learning · Computer Science 2024-06-11 Huijie Zhang , Jinfan Zhou , Yifu Lu , Minzhe Guo , Peng Wang , Liyue Shen , Qing Qu

Despite the remarkable generation capabilities of Diffusion Models (DMs), conducting training and inference remains computationally expensive. Previous works have been devoted to accelerating diffusion sampling, but achieving data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yize Li , Yihua Zhang , Sijia Liu , Xue Lin

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Training data attribution (TDA) methods aim to identify which training examples influence a model's predictions on specific test data most. By quantifying these influences, TDA supports critical applications such as data debugging,…

Machine Learning · Computer Science 2025-05-30 Xingyuan Pan , Chenlu Ye , Joseph Melkonian , Jiaqi W. Ma , Tong Zhang

Cutting-edge diffusion models produce images with high quality and customizability, enabling them to be used for commercial art and graphic design purposes. But do diffusion models create unique works of art, or are they replicating content…

Machine Learning · Computer Science 2022-12-13 Gowthami Somepalli , Vasu Singla , Micah Goldblum , Jonas Geiping , Tom Goldstein