English
Related papers

Related papers: Extracting Training Data from Diffusion Models

200 papers

Diffusion models (DMs) are generative models that learn to synthesize images from Gaussian noise. DMs can be trained to do a variety of tasks such as image generation and image super-resolution. Researchers have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yung Jer Wong , Teck Khim Ng

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Differentially private diffusion models (DPDMs) harness the remarkable generative capabilities of diffusion models while enforcing differential privacy (DP) for sensitive data. However, existing DPDM training approaches often suffer from…

Cryptography and Security · Computer Science 2025-02-19 Tanqiu Jiang , Changjiang Li , Fenglong Ma , Ting Wang

Large annotated datasets are required for training deep learning models, but in medical imaging data sharing is often complicated due to ethics, anonymization and data protection legislation. Generative AI models, such as generative…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Muhammad Usman Akbar , Måns Larsson , Anders Eklund

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Generative AI has made impressive strides in enabling users to create diverse and realistic visual content such as images, videos, and audio. However, training generative models on large centralized datasets can pose challenges in terms of…

Machine Learning · Computer Science 2025-10-03 Fiona Victoria Stanley Jothiraj , Afra Mashhadi

As synthetic data becomes increasingly popular in machine learning tasks, numerous methods--without formal differential privacy guarantees--use synthetic data for training. These methods often claim, either explicitly or implicitly, to…

Cryptography and Security · Computer Science 2025-02-19 Yunpeng Zhao , Jie Zhang

Deep generative models have made rapid progress in image, text, audio, and video generation, and are increasingly being applied to structured records. For tabular data, however, generative modeling remains difficult: a dataset may contain…

Machine Learning · Computer Science 2026-05-25 Zhong Li , Qi Huang , Lincen Yang , Jiayang Shi , Zhao Yang , Niki van Stein , Thomas Bäck , Matthijs van Leeuwen

Text-to-image diffusion models have been shown to suffer from sample-level memorization, possibly reproducing near-perfect replica of images that they are trained on, which may be undesirable. To remedy this issue, we develop the first…

Diffusion models pose risks of privacy breaches and copyright disputes, primarily stemming from the potential utilization of unauthorized data during the training phase. The Training Membership Inference (TMI) task aims to determine whether…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Xiaomeng Fu , Xi Wang , Qiao Li , Jin Liu , Jiao Dai , Jizhong Han

Face recognition models are trained on large-scale datasets, which have privacy and ethical concerns. Lately, the use of synthetic data to complement or replace genuine data for the training of face recognition models has been proposed.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 David Geissbühler , Hatef Otroshi Shahreza , Sébastien Marcel

It is a known problem that deep-learning-based end-to-end (E2E) channel coding systems depend on a known and differentiable channel model, due to the learning process and based on the gradient-descent optimization methods. This places the…

Information Theory · Computer Science 2023-11-30 Muah Kim , Rick Fritschek , Rafael F. Schaefer

Generative models are used as an alternative data augmentation technique to alleviate the data scarcity problem faced in the medical imaging field. Diffusion models have gathered special attention due to their innovative generation…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Ricardo Montoya-del-Angel , Karla Sam-Millan , Joan C Vilanova , Robert Martí

Distributed devices such as mobile phones can produce and store large amounts of data that can enhance machine learning models; however, this data may contain private information specific to the data owner that prevents the release of the…

Machine Learning · Computer Science 2019-04-23 Xiao Chen , Thomas Navidi , Stefano Ermon , Ram Rajagopal

Identifying the training data samples that most influence a generated image is a critical task in understanding diffusion models (DMs), yet existing influence estimation methods are constrained to small-scale or LoRA-tuned models due to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Huawei Lin , Yingjie Lao , Weijie Zhao

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Deep neural networks have brought remarkable breakthroughs in medical image analysis. However, due to their data-hungry nature, the modest dataset sizes in medical imaging projects might be hindering their full potential. Generating…

Diffusion models surpass previous generative models in sample quality and training stability. Recent works have shown the advantages of diffusion models in improving reinforcement learning (RL) solutions. This survey aims to provide an…

Machine Learning · Computer Science 2024-02-26 Zhengbang Zhu , Hanye Zhao , Haoran He , Yichao Zhong , Shenyu Zhang , Haoquan Guo , Tingting Chen , Weinan Zhang

In this paper, we address the problem of generative dataset distillation that utilizes generative models to synthesize images. The generator may produce any number of images under a preserved evaluation time. In this work, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Junqiao Fan , Yunjiao Zhou , Min Chang Jordan Ren , Jianfei Yang

Recent image generation models such as Stable Diffusion have exhibited an impressive ability to generate fairly realistic images starting from a simple text prompt. Could such models render real images obsolete for training image prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Mert Bulent Sariyildiz , Karteek Alahari , Diane Larlus , Yannis Kalantidis