English
Related papers

Related papers: Localized Concept Erasure for Text-to-Image Diffus…

200 papers

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

Recent developments in the field of diffusion models have demonstrated an exceptional capacity to generate high-quality prompt-conditioned image edits. Nevertheless, previous approaches have primarily relied on textual prompts for image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Goirik Chakrabarty , Aditya Chandrasekar , Ramya Hebbalaguppe , Prathosh AP

Concept erasure is extensively utilized in image generation to prevent text-to-image models from generating undesired content. Existing methods can effectively erase narrow concepts that are specific and concrete, such as distinct…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yuze Cai , Jiahao Lu , Hongxiang Shi , Yichao Zhou , Hong Lu

Recent advances in text-to-image diffusion models have enabled the photorealistic generation of images from text prompts. Despite the great progress, existing models still struggle to generate compositional multi-concept images naturally,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Hazarapet Tunanyan , Dejia Xu , Shant Navasardyan , Zhangyang Wang , Humphrey Shi

Text-to-image (T2I) diffusion models often inadvertently generate unwanted concepts such as watermarks and unsafe images. These concepts, termed as the "implicit concepts", could be unintentionally learned during training and then be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Zhili Liu , Kai Chen , Yifan Zhang , Jianhua Han , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung , James Kwok

The rapid expansion of large-scale text-to-image diffusion models has raised growing concerns regarding their potential misuse in creating harmful or misleading content. In this paper, we introduce MACE, a finetuning framework for the task…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shilin Lu , Zilan Wang , Leyang Li , Yanzhu Liu , Adams Wai-Kin Kong

Text-guided diffusion models have revolutionized generative tasks by producing high-fidelity content from text descriptions. They have also enabled an editing paradigm where concepts can be replaced through text conditioning (e.g., a dog to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Chao Huang , Susan Liang , Yunlong Tang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Recent advances in generative models have demonstrated remarkable capabilities in producing high-quality images, but their reliance on large-scale unlabeled data has raised significant safety and copyright concerns. Efforts to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yang Zhang , Er Jin , Yanfei Dong , Yixuan Wu , Philip Torr , Ashkan Khakzar , Johannes Stegmaier , Kenji Kawaguchi

Concept erasure has emerged as a promising approach to mitigate undesired or unsafe content in diffusion models, yet existing methods still face significant limitations. While training-based methods are effective, their high computational…

Artificial Intelligence · Computer Science 2026-05-29 Yuhao Sun , Lingyun Yu , Haoxiang Xu , Fengyuan Miao , Zhuoer Xu , Hongtao Xie

Concept erasure, which fine-tunes diffusion models to remove undesired or harmful visual concepts, has become a mainstream approach to mitigating unsafe or illegal image generation in text-to-image models.However, existing removal methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hao Chen , Yiwei Wang , Songze Li

Diffusion models (DMs) have gained prominence due to their ability to generate high-quality varied images with recent advancements in text-to-image generation. The research focus is now shifting towards the controllability of DMs. A…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Enis Simsar , Alessio Tonioni , Yongqin Xian , Thomas Hofmann , Federico Tombari

Large-scale text-to-image diffusion models have significantly improved the state of the art in generative image modelling and allow for an intuitive and powerful user interface to drive the image generation process. Expressing spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Guillaume Couairon , Marlène Careil , Matthieu Cord , Stéphane Lathuilière , Jakob Verbeek

Text-to-image models exhibit remarkable capabilities in image generation. However, they also pose safety risks of generating harmful content. A key challenge of existing concept erasure methods is the precise removal of target concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qinqin He , Jiaqi Weng , Jialing Tao , Hui Xue

Diffusion models have achieved unprecedented success in image generation but pose increasing risks in terms of privacy, fairness, and security. A growing demand exists to \emph{erase} sensitive or harmful concepts (e.g., NSFW content,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Zixuan Fu , Yan Ren , Finn Carter , Chenyue Wen , Le Ku , Daheng Yu , Emily Davis , Bo Zhang

Large-scale text-to-image diffusion models can generate high-fidelity images with powerful compositional ability. However, these models are typically trained on an enormous amount of Internet data, often containing copyrighted material,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Nupur Kumari , Bingliang Zhang , Sheng-Yu Wang , Eli Shechtman , Richard Zhang , Jun-Yan Zhu

Machine unlearning for text-to-image diffusion models aims to selectively remove undesirable concepts from pre-trained models without costly retraining. Current unlearning methods share a common weakness: erased concepts return when the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Aljalila Aladawi , Mohammed Talha Alam , Fakhri Karray

Diffusion models have exhibited impressive prowess in the text-to-image task. Recent methods add image-level structure controls, e.g., edge and depth maps, to manipulate the generation process together with text prompts to obtain desired…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yibo Zhao , Liang Peng , Yang Yang , Zekai Luo , Hengjia Li , Yao Chen , Zheng Yang , Xiaofei He , Wei Zhao , qinglin lu , Boxi Wu , Wei Liu

While text-to-image diffusion models can generate highquality images from textual descriptions, they generally lack fine-grained control over the visual composition of the generated images. Some recent works tackle this problem by training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Denis Lukovnikov , Asja Fischer

Large-scale text-to-image diffusion models have achieved great success in synthesizing high-quality and diverse images given target text prompts. Despite the revolutionary image generation ability, current state-of-the-art models still…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Text-driven image editing enables users to flexibly modify visual content through natural language instructions, and is widely applied to tasks such as semantic object replacement, insertion, and removal. While recent inversion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Liangyang Ouyang , Jiafeng Mao