English
Related papers

Related papers: Adjusting Initial Noise to Mitigate Memorization i…

200 papers

Diffusion models generate high-quality samples but can also memorize training data, raising serious privacy concerns. Understanding the mechanisms governing when memorization versus generalization occurs remains an active area of research.…

Machine Learning · Computer Science 2026-02-23 Nick Dodson , Xinyu Gao , Qingsong Wang , Yusu Wang , Zhengchao Wan

Generative models have been shown to "memorize" certain training data, leading to verbatim or near-verbatim generating images, which may cause privacy concerns or copyright infringement. We introduce Guidance Using Attractive-Repulsive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Kairan Zhao , Eleni Triantafillou , Peter Triantafillou

In recent years, large-scale pre-trained diffusion models have demonstrated their outstanding capabilities in image and video generation tasks. However, existing models tend to produce visual objects commonly found in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Changgu Chen , Libing Yang , Xiaoyan Yang , Lianggangxu Chen , Gaoqi He , CHangbo Wang , Yang Li

Text-to-image diffusion models are capable of generating high-quality images, but suboptimal pre-trained text representations often result in these images failing to align closely with the given text prompts. Classifier-free guidance (CFG)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhenyu Zhou , Defang Chen , Can Wang , Chun Chen , Siwei Lyu

Diffusion models have achieved remarkable success in text-to-image generation tasks; however, the role of initial noise has been rarely explored. In this study, we identify specific regions within the initial noise image, termed trigger…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yuanhao Ban , Ruochen Wang , Tianyi Zhou , Boqing Gong , Cho-Jui Hsieh , Minhao Cheng

Diffusion and flow-based generative models have shown strong potential for image restoration. However, image denoising under unknown and varying noise conditions remains challenging, because the learned vector fields may become inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jigang Duan , Genwei Ma , Xu Jiang , Wenfeng Xu , Ping Yang , Xing Zhao

Diffusion models, known for their tremendous ability to generate high-quality samples, have recently raised concerns due to their data memorization behavior, which poses privacy risks. Recent methods for memory mitigation have primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xiaoliu Guan , Yu Wu , Huayang Huang , Xiao Liu , Jiaxu Miao , Yi Yang

Diffusion models have achieved impressive success in generating photorealistic images, but challenges remain in ensuring precise semantic alignment with input prompts. Optimizing the initial noisy latent offers a more efficient alternative…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Boming Miao , Chunxiao Li , Xiaoxiao Wang , Andi Zhang , Rui Sun , Zizhe Wang , Yao Zhu

Diffusion models generalize well in practice. However, an optimal diffusion model fully memorizes the training data and therefore fails to generalize, raising the question of what induces generalization in a real diffusion model. We show…

Machine Learning · Computer Science 2026-05-21 Tim Kaiser , Markus Kollmann

With the great success of diffusion models in image generation, diffusion-based image compression is attracting increasing interests. However, due to the random noise introduced in the diffusion learning, they usually produce…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Zhenyu Du , Yanbo Gao , Shuai Li , Yiyang Li , Hui Yuan , Mao Ye

Contemporary text-to-image models exhibit a surprising degree of mode collapse, as can be seen when sampling several images given the same text prompt. Previous work has attempted to address this issue by steering the model using guidance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Anne Harrington , A. Sophia Koepke , Shyamgopal Karthik , Trevor Darrell , Alexei A. Efros

Diffusion- and flow-based models usually allocate compute uniformly across space, updating all patches with the same timestep and number of function evaluations. While convenient, this ignores the heterogeneity of natural images: some…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Johannes Schusterbauer , Ming Gui , Yusong Li , Pingchuan Ma , Felix Krause , Björn Ommer

Retail photography imposes specific requirements on images. For instance, images may need uniform background colors, consistent model poses, centered products, and consistent lighting. Minor deviations from these standards impact a site's…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jeffrey Zhang , Shao-Yu Chang , Kedan Li , David Forsyth

Diffusion models (DMs) memorize training images and can reproduce near-duplicates during generation. Current detection methods identify verbatim memorization but fail to capture two critical aspects: quantifying partial memorization…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jimmy Z. Di , Yiwei Lu , Yaoliang Yu , Gautam Kamath , Adam Dziedzic , Franziska Boenisch

Machine unlearning--the ability to remove designated concepts from a pre-trained model--has advanced rapidly, particularly for text-to-image diffusion models. However, existing methods typically assume that unlearning requests arrive all at…

Machine Learning · Computer Science 2026-03-04 Justin Lee , Zheda Mai , Jinsu Yoo , Chongyu Fan , Cheng Zhang , Wei-Lun Chao

Diffusion models, known for their tremendous ability to generate novel and high-quality samples, have recently raised concerns due to their data memorization behavior, which poses privacy risks. Recent approaches for memory mitigation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiao Liu , Xiaoliu Guan , Yu Wu , Jiaxu Miao

Classifier-Free Guidance (CFG) is a widely used technique for improving conditional diffusion models by linearly combining the outputs of conditional and unconditional denoisers. While CFG enhances visual quality and improves alignment with…

Machine Learning · Computer Science 2025-05-28 Badr Moufad , Yazid Janati , Alain Durmus , Ahmed Ghorbel , Eric Moulines , Jimmy Olsson

There is growing concern over the safety of powerful diffusion models (DMs), as they are often misused to produce inappropriate, not-safe-for-work (NSFW) content or generate copyrighted material or data of individuals who wish to be…

Artificial Intelligence · Computer Science 2026-02-24 Mingyu Kim , Dongjun Kim , Amman Yusuf , Stefano Ermon , Mijung Park

Classifier-Free Guidance (CFG) is a fundamental technique in training conditional diffusion models. The common practice for CFG-based training is to use a single network to learn both conditional and unconditional noise prediction, with a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Prin Phunyaphibarn , Phillip Y. Lee , Jaihoon Kim , Minhyuk Sung

Diffusion models have demonstrated remarkable potential in generating high-quality images. However, their tendency to replicate training data raises serious privacy concerns, particularly when the training datasets contain sensitive or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jingqi Xu , Chenghao Li , Yuke Zhang , Peter A. Beerel