English
Related papers

Related papers: Training Data Attribution: Was Your Model Secretly…

200 papers

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

Machine Learning · Computer Science 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Machine learning models are being used in an increasing number of critical applications; thus, securing their integrity and ownership is critical. Recent studies observed that adversarial training and watermarking have a conflicting…

Machine Learning · Computer Science 2024-01-09 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

Many training data attribution (TDA) methods aim to estimate how a model's behavior would change if one or more data points were removed from the training set. Methods based on implicit differentiation, such as influence functions, can be…

Machine Learning · Computer Science 2024-05-22 Juhan Bae , Wu Lin , Jonathan Lorraine , Roger Grosse

In this work, we introduce a novel deep learning-based approach to text-in-image watermarking, a method that embeds and extracts textual information within images to enhance data security and integrity. Leveraging the capabilities of deep…

Multimedia · Computer Science 2024-04-23 Bishwa Karki , Chun-Hua Tsai , Pei-Chi Huang , Xin Zhong

Data privacy is an important issue for "machine learning as a service" providers. We focus on the problem of membership inference attacks: given a data sample and black-box access to a model's API, determine whether the sample existed in…

Machine Learning · Computer Science 2020-03-17 Sorami Hisamoto , Matt Post , Kevin Duh

Recent fine-tuning techniques for diffusion models enable them to reproduce specific image sets, such as particular faces or artistic styles, but also introduce copyright and security risks. Dataset watermarking has been proposed to ensure…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xincheng Wang , Hanchi Sun , Wenjun Sun , Kejun Xue , Wangqiu Zhou , Jianbo Zhang , Wei Sun , Dandan Zhu , Xiongkuo Min , Jun Jia , Zhijun Fang

Watermarking the outputs of generative models is a crucial technique for tracing copyright and preventing potential harm from AI-generated content. In this paper, we introduce a novel technique called Tree-Ring Watermarking that robustly…

Machine Learning · Computer Science 2023-07-06 Yuxin Wen , John Kirchenbauer , Jonas Geiping , Tom Goldstein

State-of-the-art text-to-image models generate photorealistic images at an unprecedented speed. This work focuses on models that operate in a bitwise autoregressive manner over a discrete set of tokens that is practically infinite in size.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Louis Kerner , Michel Meintz , Bihe Zhao , Franziska Boenisch , Adam Dziedzic

The rapid progress of text-to-image diffusion models raises significant concerns regarding the unauthorized reproduction of trademarked content. While prior work targets general concepts (e.g., styles, celebrities), it fails to address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dawid Malarz , Filip Manjak , Maciej Zięba , Przemysław Spurek , Artur Kasymov

In practical application, the widespread deployment of diffusion models often necessitates substantial investment in training. As diffusion models find increasingly diverse applications, concerns about potential misuse highlight the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Jijia Yang , Sen Peng , Xiaohua Jia

Recent advances in text-to-image diffusion models have enabled the generation of diverse and high-quality images. While impressive, the images often fall short of depicting subtle details and are susceptible to errors due to ambiguity in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Idan Schwartz , Vésteinn Snæbjarnarson , Hila Chefer , Ryan Cotterell , Serge Belongie , Lior Wolf , Sagie Benaim

Autoregressive image generation has witnessed rapid advancements, with prominent models such as scale-wise visual auto-regression pushing the boundaries of visual synthesis. However, these developments also raise significant concerns…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Hongyao Yu , Yixiang Qiu , Yiheng Yang , Hao Fang , Tianqu Zhuang , Jiaxin Hong , Bin Chen , Hao Wu , Shu-Tao Xia

Detecting whether copyright holders' works were used in LLM pretraining is poised to be an important problem. This work proposes using data watermarks to enable principled detection with only black-box model access, provided that the…

Cryptography and Security · Computer Science 2024-08-20 Johnny Tian-Zheng Wei , Ryan Yixiang Wang , Robin Jia

As diffusion models become increasingly popular, the misuse of copyrighted and private images has emerged as a major concern. One promising solution to mitigate this issue is identifying the contribution of specific training samples in…

Machine Learning · Computer Science 2025-03-24 Jinxu Lin , Linwei Tao , Minjing Dong , Chang Xu

We quantitatively investigate how machine learning models leak information about the individual data records on which they were trained. We focus on the basic membership inference attack: given a data record and black-box access to a model,…

Cryptography and Security · Computer Science 2017-04-04 Reza Shokri , Marco Stronati , Congzheng Song , Vitaly Shmatikov

High-quality training data has proven crucial for developing performant large language models (LLMs). However, commercial LLM providers disclose few, if any, details about the data used for training. This lack of transparency creates…

Image generation algorithms are increasingly integral to diverse aspects of human society, driven by their practical applications. However, insufficient oversight in artificial Intelligence generated content (AIGC) can facilitate the spread…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenhao Luo , Zhangyi Shen , Ye Yao , Feng Ding , Guopu Zhu , Weizhi Meng

Large language models (LLMs) can be trained or fine-tuned on data obtained without the owner's consent. Verifying whether a specific LLM was trained on particular data instances or an entire dataset is extremely challenging. Dataset…

Computation and Language · Computer Science 2025-10-07 Eyal German , Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

In this paper, we highlight a critical threat posed by emerging neural models: data plagiarism. We demonstrate how modern neural models (e.g., diffusion models) can replicate copyrighted images, even when protected by advanced watermarking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zihang Zou , Boqing Gong , Liqiang Wang

For well over a quarter century, detection systems have been driven by models learned from input features collected from real or simulated environments. An artifact (e.g., network event, potential malware sample, suspicious email) is deemed…

Cryptography and Security · Computer Science 2018-04-03 Z. Berkay Celik , Patrick McDaniel , Rauf Izmailov , Nicolas Papernot , Ryan Sheatsley , Raquel Alvarez , Ananthram Swami