English
Related papers

Related papers: Localized Concept Erasure in Text-to-Image Diffusi…

200 papers

Diffusion models (DMs) are widely used for text-to-image generation, but their strong generative capabilities also raise concerns about unsafe or undesirable content. Concept erasure aims to mitigate these risks by removing specific…

Artificial Intelligence · Computer Science 2026-05-19 Mengyu Sun , Ziyuan Yang , Zunlong Zhou , Junxu Liu , Haibo Hu , Yi Zhang

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

(Renyi Qu's Master's Thesis) Recent advancements in interpretable models for vision-language tasks have achieved competitive performance; however, their interpretability often suffers due to the reliance on unstructured text outputs from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Renyi Qu , Mark Yatskar

Concept erasure serves as a vital safety mechanism for removing unwanted concepts from text-to-image (T2I) models. While extensively studied in U-Net and dual-stream architectures (e.g., Flux), this task remains under-explored in the recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nanxiang Jiang , Zhaoxin Fan , Baisen Wang , Daiheng Gao , Junhang Cheng , Jifeng Guo , Yalan Qin , Yeying Jin , Hongwei Zheng , Faguo Wu , Wenjun Wu

Text-to-image diffusion models have achieved remarkable success in generating photorealistic images. However, the inclusion of sensitive information during pre-training poses significant risks. Machine Unlearning (MU) offers a promising…

Machine Learning · Computer Science 2025-03-19 Yongliang Wu , Shiji Zhou , Mingzhuo Yang , Lianzhe Wang , Heng Chang , Wenbo Zhu , Xinting Hu , Xiao Zhou , Xu Yang

Text-to-image (TTI) diffusion models have demonstrated impressive results in generating high-resolution images of complex and imaginative scenes. Recent approaches have further extended these methods with personalization techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Tanzila Rahman , Shweta Mahajan , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Leonid Sigal

Distributed representations provide a vector space that captures meaningful relationships between data instances. The distributed nature of these representations, however, entangles together multiple attributes or concepts of data instances…

Machine Learning · Computer Science 2023-12-04 Somnath Basu Roy Chowdhury , Nicholas Monath , Avinava Dubey , Amr Ahmed , Snigdha Chaturvedi

Recent advances in large-scale diffusion models have intensified concerns about their potential misuse, particularly in generating realistic yet harmful or socially disruptive content. This challenge has spurred growing interest in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Piotr Wójcik , Maksym Petrenko , Wojciech Gromski , Przemysław Spurek , Maciej Zieba

Text-to-image (T2I) diffusion models have gained widespread application across various domains, demonstrating remarkable creative potential. However, the strong generalization capabilities of these models can inadvertently led they to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Die Chen , Zhiwen Li , Cen Chen , Xiaodan Li , Jinyan Ye

Large-scale text-to-image diffusion models can generate high-fidelity images with powerful compositional ability. However, these models are typically trained on an enormous amount of Internet data, often containing copyrighted material,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Nupur Kumari , Bingliang Zhang , Sheng-Yu Wang , Eli Shechtman , Richard Zhang , Jun-Yan Zhu

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande

Text-to-image diffusion models suffer from the risk of generating outdated, copyrighted, incorrect, and biased content. While previous methods have mitigated the issues on a small scale, it is essential to handle them simultaneously in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tianwei Xiong , Yue Wu , Enze Xie , Yue Wu , Zhenguo Li , Xihui Liu

Recent advance in text-to-image diffusion models have significantly facilitated the generation of high-quality images, but also raising concerns about the illegal creation of harmful content, such as copyrighted images. Existing concept…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Zihao Wang , Yuxiang Wei , Fan Li , Renjing Pei , Hang Xu , Wangmeng Zuo

Diffusion models have shown superior performance in image generation and manipulation, but the inherent stochasticity presents challenges in preserving and manipulating image content and identity. While previous approaches like DreamBooth…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Inhwa Han , Serin Yang , Taesung Kwon , Jong Chul Ye

Remarkable progress in text-to-image diffusion models has brought a major concern about potentially generating images on inappropriate or trademarked concepts. Concept erasing has been investigated with the goals of deleting target concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Byung Hyun Lee , Sungjin Lim , Seunggyu Lee , Dong Un Kang , Se Young Chun

Large-scale text-to-image (T2I) diffusion models have achieved remarkable generative performance about various concepts. With the limitation of privacy and safety in practice, the generative capability concerning NSFW (Not Safe For Work)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jiahang Tu , Qian Feng , Jiahua Dong , Hanbin Zhao , Chao Zhang , Nicu Sebe , Hui Qian

Concept erasure in Text-To-Image (T2I) diffusion models is vital for safe content generation, but existing inference-time methods face significant limitations. Feature-correction approaches often cause uncontrolled over-correction, while…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Qinghui Gong

Recent text-to-image diffusion models leverage cross-attention layers, which have been effectively utilized to enhance a range of visual generative tasks. However, our understanding of cross-attention layers remains somewhat limited. In…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jungwon Park , Jungmin Ko , Dongnam Byun , Jangwon Suh , Wonjong Rhee

Generating multiple new concepts remains a challenging problem in the text-to-image task. Current methods often overfit when trained on a small number of samples and struggle with attribute leakage, particularly for class-similar subjects…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Gia-Nghia Tran , Quang-Huy Che , Trong-Tai Dam Vu , Bich-Nga Pham , Vinh-Tiep Nguyen , Trung-Nghia Le , Minh-Triet Tran

Text-to-image diffusion models have shown unprecedented generative capability, but their ability to produce undesirable concepts (e.g.~pornographic content, sensitive identities, copyrighted styles) poses serious concerns for privacy,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Finn Carter