中文
相关论文

相关论文: When Are Concepts Erased From Diffusion Models?

200 篇论文

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for their safe deployment to prevent the creation of harmful content. This has fostered a dynamic interplay between the…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Qianlong Xiang , Miao Zhang , Haoyu Zhang , Kun Wang , Junhui Hou , Liqiang Nie

Concept erasure aims to suppress sensitive content in diffusion models, but recent studies show that erased concepts can still be reawakened, revealing vulnerabilities in erasure methods. Existing reawakening methods mainly rely on…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Mengyu Sun , Ziyuan Yang , Andrew Beng Jin Teoh , Junxu Liu , Haibo Hu , Yi Zhang

Concept unlearning in diffusion models is hampered by feature splitting, where concepts are distributed across many latent features, making their removal challenging and computationally expensive. We introduce SAEmnesia, a supervised sparse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Enrico Cassano , Riccardo Renzulli , Marco Nurisso , Mirko Zaffaroni , Alan Perotti , Marco Grangetto

Teaching text-to-image models to be creative involves using style ambiguity loss, which requires a pretrained classifier. In this work, we explore a new form of the style ambiguity training objective, used to approximate creativity, that…

计算机视觉与模式识别 · 计算机科学 2024-07-18 James Baker

Attribution methods assess the contribution of inputs to the model prediction. One way to do so is erasure: a subset of inputs is considered irrelevant if it can be removed without affecting the prediction. Though conceptually simple,…

计算与语言 · 计算机科学 2021-03-03 Nicola De Cao , Michael Schlichtkrull , Wilker Aziz , Ivan Titov

Text-to-image diffusion models have been demonstrated with undesired generation due to unfiltered large-scale training data, such as sexual images and copyrights, necessitating the erasure of undesired concepts. Most existing methods focus…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Zheling Meng , Bo Peng , Xiaochuan Jin , Yue Jiang , Wei Wang , Jing Dong , Tieniu Tan

Text-to-image (T2I) diffusion models have achieved remarkable success in generating high-quality images from textual prompts. However, their ability to store vast amounts of knowledge raises concerns in scenarios where selective forgetting…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Gen Li , Yang Xiao , Jie Ji , Kaiyuan Deng , Bo Hui , Linke Guo , Xiaolong Ma

While generative models produce high-quality images of concepts learned from a large-scale database, a user often wishes to synthesize instantiations of their own concepts (for example, their family, pets, or items). Can we teach a model to…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Nupur Kumari , Bingliang Zhang , Richard Zhang , Eli Shechtman , Jun-Yan Zhu

Concept-based explanation approach is a popular model interpertability tool because it expresses the reasons for a model's predictions in terms of concepts that are meaningful for the domain experts. In this work, we study the problem of…

机器学习 · 计算机科学 2021-05-25 Mohammad Taha Bahadori , David E. Heckerman

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However,…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Rohit Gandikota , Hadas Orgad , Yonatan Belinkov , Joanna Materzyńska , David Bau

Fine-tuning based concept erasing has demonstrated promising results in preventing generation of harmful contents from text-to-image diffusion models by removing target concepts while preserving remaining concepts. To maintain the…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Byung Hyun Lee , Sungjin Lim , Se Young Chun

In current AI era, users may request AI companies to delete their data from the training dataset due to the privacy concerns. As a model owner, retraining a model will consume significant computational resources. Therefore, machine…

机器学习 · 计算机科学 2024-05-27 Wenhan Chang , Tianqing Zhu , Heng Xu , Wenjian Liu , Wanlei Zhou

Concept explanation is a popular approach for examining how human-interpretable concepts impact the predictions of a model. However, most existing methods for concept explanations are tailored to specific models. To address this issue, this…

机器学习 · 计算机科学 2024-01-17 Zhili Feng , Michal Moshkovitz , Dotan Di Castro , J. Zico Kolter

The rapid growth of text-to-image diffusion models has raised concerns about their potential misuse in generating harmful or unauthorized contents. To address these issues, several Concept Erasure methods have been proposed. However, most…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Kien Nguyen , Anh Tran , Cuong Pham

The traditional image inpainting task aims to restore corrupted regions by referencing surrounding background and foreground. However, the object erasure task, which is in increasing demand, aims to erase objects and generate harmonious…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Fan Li , Zixiao Zhang , Yi Huang , Jianzhuang Liu , Renjing Pei , Bin Shao , Songcen Xu

Custom diffusion models (CDMs) have attracted widespread attention due to their astonishing generative ability for personalized concepts. However, most existing CDMs unreasonably assume that personalized concepts are fixed and cannot change…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Jiahua Dong , Wenqi Liang , Hongliu Li , Duzhen Zhang , Meng Cao , Henghui Ding , Salman Khan , Fahad Shahbaz Khan

Diffusion models (DMs) have achieved remarkable success in text-to-image generation, but they also pose safety risks, such as the potential generation of harmful content and copyright violations. The techniques of machine unlearning, also…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Yimeng Zhang , Xin Chen , Jinghan Jia , Yihua Zhang , Chongyu Fan , Jiancheng Liu , Mingyi Hong , Ke Ding , Sijia Liu

We call into question the recently popularized method of direct model editing as a means of correcting factual errors in LLM generations. We contrast model editing with three similar but distinct approaches that pursue better defined…

计算与语言 · 计算机科学 2023-10-19 Yuval Pinter , Michael Elhadad

Text-to-image (T2I) diffusion models have gained widespread application across various domains, demonstrating remarkable creative potential. However, the strong generalization capabilities of these models can inadvertently led they to…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Die Chen , Zhiwen Li , Cen Chen , Xiaodan Li , Jinyan Ye

The rapid proliferation of large-scale text-to-image diffusion (T2ID) models has raised serious concerns about their potential misuse in generating harmful content. Although numerous methods have been proposed for erasing undesired concepts…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Koushik Srivatsan , Fahad Shamshad , Muzammal Naseer , Vishal M. Patel , Karthik Nandakumar