中文
相关论文

相关论文: Prototype-Guided Concept Erasure in Diffusion Mode…

200 篇论文

Erasing specific concepts from text-to-image diffusion models is essential for avoiding the generation of copyrighted and explicit content. Closed-form concept erasure methods offer a fast alternative to backpropagation-based techniques,…

机器学习 · 计算机科学 2026-05-12 Nicola Novello , Andrea M. Tonello

The success of diffusion models has raised concerns about the generation of unsafe or harmful content, prompting concept erasure approaches that fine-tune modules to suppress specific concepts while preserving general generative…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Jiahang Tu , Ye Li , Yiming Wu , Hanbin Zhao , Chao Zhang , Hui Qian

Enabling generative models to decompose visual concepts from a single image is a complex and challenging problem. In this paper, we study a new and challenging task, customized concept decomposition, wherein the objective is to leverage…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Zhi Xu , Shaozhe Hao , Kai Han

The remarkable development of text-to-image generation models has raised notable security concerns, such as the infringement of portrait rights and the generation of inappropriate content. Concept erasure has been proposed to remove the…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Yufan Liu , Jinyang An , Wanqian Zhang , Ming Li , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

Post-hoc unlearning has emerged as a practical mechanism for removing undesirable concepts from large text-to-image diffusion models. However, prior work primarily evaluates unlearning through erasure success; its impact on broader…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Arian Komaei Koma , Seyed Amir Kasaei , Ali Aghayari , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

Diffusion models have demonstrated remarkable image generation capabilities, but also pose risks in privacy and fairness by memorizing sensitive concepts or perpetuating biases. We propose a novel \textbf{concept erasure} method for…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Zixuan Fu , Yan Ren , Finn Carter , Chenyue Wang , Ze Niu , Dacheng Yu , Emily Davis , Bo Zhang

Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attractive in this setting because they apply a single deterministic edit to the cross-attention…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Saemi Moon , Suhyeon Jun , Seoyeon Lee , Dongwoo Kim

Concept erasure aims to remove specified features from an embedding. It can improve fairness (e.g. preventing a classifier from using gender or race) and interpretability (e.g. removing a concept to observe changes in model behavior). We…

机器学习 · 计算机科学 2025-04-04 Nora Belrose , David Schneider-Joseph , Shauli Ravfogel , Ryan Cotterell , Edward Raff , Stella Biderman

With the rapid growth of text-to-image models, a variety of techniques have been suggested to prevent undesirable image generations. Yet, these methods often only protect against specific user prompts and have been shown to allow unsafe…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Minh Pham , Kelly O. Marshall , Chinmay Hegde , Niv Cohen

Concept erasure helps stop diffusion models (DMs) from generating harmful content; but current methods face robustness retention trade off. Robustness means the model fine-tuned by concept erasure methods resists reactivation of erased…

机器学习 · 计算机科学 2026-02-16 Fengpeng Li , Kemou Li , Qizhou Wang , Bo Han , Jiantao Zhou

Concerns about text-to-image (T2I) generative models infringing on privacy, copyright, and safety have led to the development of concept erasure techniques (CETs). The goal of an effective CET is to prohibit the generation of undesired…

机器学习 · 计算机科学 2025-09-23 Shaswati Saha , Sourajit Saha , Manas Gaur , Tejas Gokhale

Text-to-image diffusion models have demonstrated an unparalleled ability to generate high-quality, diverse images from a textual prompt. However, the internal representations learned by these models remain an enigma. In this work, we…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Hila Chefer , Oran Lang , Mor Geva , Volodymyr Polosukhin , Assaf Shocher , Michal Irani , Inbar Mosseri , Lior Wolf

Text-to-image diffusion models have been demonstrated with undesired generation due to unfiltered large-scale training data, such as sexual images and copyrights, necessitating the erasure of undesired concepts. Most existing methods focus…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Zheling Meng , Bo Peng , Xiaochuan Jin , Yue Jiang , Wei Wang , Jing Dong , Tieniu Tan

Text-to-image (T2I) diffusion models have shown exceptional capabilities in generating images that closely correspond to textual prompts. However, the advancement of T2I diffusion models presents significant risks, as the models could be…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Jie Ren , Kangrui Chen , Yingqian Cui , Shenglai Zeng , Hui Liu , Yue Xing , Jiliang Tang , Lingjuan Lyu

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Anubhav Jain , Yuya Kobayashi , Takashi Shibuya , Yuhta Takida , Nasir Memon , Julian Togelius , Yuki Mitsufuji

Text-guided diffusion models have revolutionized generative tasks by producing high-fidelity content from text descriptions. They have also enabled an editing paradigm where concepts can be replaced through text conditioning (e.g., a dog to…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Chao Huang , Susan Liang , Yunlong Tang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to…

机器学习 · 计算机科学 2023-07-25 Patrik Hammersborg , Inga Strümke

Generative image models, since introduction, have become a global phenomenon. From new arts becoming possible to new vectors of abuse, many new capabilities have become available. One of the challenging issues with generative models is…

机器学习 · 计算机科学 2024-08-29 Ali Zand , Milad Nasr

Modern neural models trained on textual data rely on pre-trained representations that emerge without direct supervision. As these representations are increasingly being used in real-world applications, the inability to \emph{control} their…

机器学习 · 计算机科学 2024-12-18 Shauli Ravfogel , Michael Twiton , Yoav Goldberg , Ryan Cotterell

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong