English
Related papers

Related papers: Prototype-Guided Concept Erasure in Diffusion Mode…

200 papers

Erasing specific concepts from text-to-image diffusion models is essential for avoiding the generation of copyrighted and explicit content. Closed-form concept erasure methods offer a fast alternative to backpropagation-based techniques,…

Machine Learning · Computer Science 2026-05-12 Nicola Novello , Andrea M. Tonello

The success of diffusion models has raised concerns about the generation of unsafe or harmful content, prompting concept erasure approaches that fine-tune modules to suppress specific concepts while preserving general generative…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jiahang Tu , Ye Li , Yiming Wu , Hanbin Zhao , Chao Zhang , Hui Qian

Enabling generative models to decompose visual concepts from a single image is a complex and challenging problem. In this paper, we study a new and challenging task, customized concept decomposition, wherein the objective is to leverage…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Zhi Xu , Shaozhe Hao , Kai Han

The remarkable development of text-to-image generation models has raised notable security concerns, such as the infringement of portrait rights and the generation of inappropriate content. Concept erasure has been proposed to remove the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yufan Liu , Jinyang An , Wanqian Zhang , Ming Li , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

Post-hoc unlearning has emerged as a practical mechanism for removing undesirable concepts from large text-to-image diffusion models. However, prior work primarily evaluates unlearning through erasure success; its impact on broader…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Arian Komaei Koma , Seyed Amir Kasaei , Ali Aghayari , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

Diffusion models have demonstrated remarkable image generation capabilities, but also pose risks in privacy and fairness by memorizing sensitive concepts or perpetuating biases. We propose a novel \textbf{concept erasure} method for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Zixuan Fu , Yan Ren , Finn Carter , Chenyue Wang , Ze Niu , Dacheng Yu , Emily Davis , Bo Zhang

Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attractive in this setting because they apply a single deterministic edit to the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Saemi Moon , Suhyeon Jun , Seoyeon Lee , Dongwoo Kim

Concept erasure aims to remove specified features from an embedding. It can improve fairness (e.g. preventing a classifier from using gender or race) and interpretability (e.g. removing a concept to observe changes in model behavior). We…

Machine Learning · Computer Science 2025-04-04 Nora Belrose , David Schneider-Joseph , Shauli Ravfogel , Ryan Cotterell , Edward Raff , Stella Biderman

With the rapid growth of text-to-image models, a variety of techniques have been suggested to prevent undesirable image generations. Yet, these methods often only protect against specific user prompts and have been shown to allow unsafe…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Minh Pham , Kelly O. Marshall , Chinmay Hegde , Niv Cohen

Concept erasure helps stop diffusion models (DMs) from generating harmful content; but current methods face robustness retention trade off. Robustness means the model fine-tuned by concept erasure methods resists reactivation of erased…

Machine Learning · Computer Science 2026-02-16 Fengpeng Li , Kemou Li , Qizhou Wang , Bo Han , Jiantao Zhou

Concerns about text-to-image (T2I) generative models infringing on privacy, copyright, and safety have led to the development of concept erasure techniques (CETs). The goal of an effective CET is to prohibit the generation of undesired…

Machine Learning · Computer Science 2025-09-23 Shaswati Saha , Sourajit Saha , Manas Gaur , Tejas Gokhale

Text-to-image diffusion models have demonstrated an unparalleled ability to generate high-quality, diverse images from a textual prompt. However, the internal representations learned by these models remain an enigma. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Hila Chefer , Oran Lang , Mor Geva , Volodymyr Polosukhin , Assaf Shocher , Michal Irani , Inbar Mosseri , Lior Wolf

Text-to-image diffusion models have been demonstrated with undesired generation due to unfiltered large-scale training data, such as sexual images and copyrights, necessitating the erasure of undesired concepts. Most existing methods focus…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Zheling Meng , Bo Peng , Xiaochuan Jin , Yue Jiang , Wei Wang , Jing Dong , Tieniu Tan

Text-to-image (T2I) diffusion models have shown exceptional capabilities in generating images that closely correspond to textual prompts. However, the advancement of T2I diffusion models presents significant risks, as the models could be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Jie Ren , Kangrui Chen , Yingqian Cui , Shenglai Zeng , Hui Liu , Yue Xing , Jiliang Tang , Lingjuan Lyu

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Anubhav Jain , Yuya Kobayashi , Takashi Shibuya , Yuhta Takida , Nasir Memon , Julian Togelius , Yuki Mitsufuji

Text-guided diffusion models have revolutionized generative tasks by producing high-fidelity content from text descriptions. They have also enabled an editing paradigm where concepts can be replaced through text conditioning (e.g., a dog to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Chao Huang , Susan Liang , Yunlong Tang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to…

Machine Learning · Computer Science 2023-07-25 Patrik Hammersborg , Inga Strümke

Generative image models, since introduction, have become a global phenomenon. From new arts becoming possible to new vectors of abuse, many new capabilities have become available. One of the challenging issues with generative models is…

Machine Learning · Computer Science 2024-08-29 Ali Zand , Milad Nasr

Modern neural models trained on textual data rely on pre-trained representations that emerge without direct supervision. As these representations are increasingly being used in real-world applications, the inability to \emph{control} their…

Machine Learning · Computer Science 2024-12-18 Shauli Ravfogel , Michael Twiton , Yoav Goldberg , Ryan Cotterell

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong