中文
相关论文

相关论文: Erasing Concepts from Diffusion Models

200 篇论文

Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Jiwoo Chung , Sangeek Hyun , Jae-Pil Heo

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for their safe deployment to prevent the creation of harmful content. This has fostered a dynamic interplay between the…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Qianlong Xiang , Miao Zhang , Haoyu Zhang , Kun Wang , Junhui Hou , Liqiang Nie

Neural Style Transfer (NST) is the field of study applying neural techniques to modify the artistic appearance of a content image to match the style of a reference style image. Traditionally, NST methods have focused on texture-based image…

计算机视觉与模式识别 · 计算机科学 2023-07-12 Dan Ruta , Gemma Canet Tarrés , Andrew Gilbert , Eli Shechtman , Nicholas Kolkin , John Collomosse

Motivated by ethical and legal concerns, the scientific community is actively developing methods to limit the misuse of Text-to-Image diffusion models for reproducing copyrighted, violent, explicit, or personal information in the generated…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Vitali Petsiuk , Kate Saenko

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Diffusion models have transformed image generation, yet controlling their outputs to reliably erase undesired concepts remains challenging. Existing approaches usually require task-specific training and struggle to generalize across both…

As text-to-image diffusion models gain widespread commercial applications, there are increasing concerns about unethical or harmful use, including the unauthorized generation of copyrighted or sensitive content. Concept unlearning has…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Saemi Moon , Minjong Lee , Sangdon Park , Dongwoo Kim

Diffusion-based models have gained significant popularity for text-to-image generation due to their exceptional image-generation capabilities. A risk with these models is the potential generation of inappropriate content, such as biased or…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Hang Li , Chengzhi Shen , Philip Torr , Volker Tresp , Jindong Gu

Denoising diffusion models have emerged as a dominant approach for image generation, however they still suffer from slow convergence in training and color shift issues in sampling. In this paper, we identify that these obstacles can be…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Hu Yu , Li Shen , Jie Huang , Hongsheng Li , Feng Zhao

Diffusion models, while powerful, can inadvertently generate harmful or undesirable content, raising significant ethical and safety concerns. Recent machine unlearning approaches offer potential solutions but often lack transparency, making…

机器学习 · 计算机科学 2025-05-23 Bartosz Cywiński , Kamil Deja

The remarkable image generation capabilities of state-of-the-art diffusion models, such as Stable Diffusion, can also be misused to spread misinformation and plagiarize copyrighted materials. To mitigate the potential risks associated with…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Qiuyu Tang , Bonor Ayambem , Mooi Choo Chuah , Aparna Bharati

Pruning-based unlearning has recently emerged as a fast, training-free, and data-independent approach to remove undesired concepts from diffusion models. It promises high efficiency and robustness, offering an attractive alternative to…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Ci Zhang , Zhaojun Ding , Chence Yang , Jun Liu , Xiaoming Zhai , Shaoyi Huang , Beiwen Li , Xiaolong Ma , Jin Lu , Geng Yuan

The powerful generative capabilities of diffusion models have raised growing privacy and safety concerns regarding generating sensitive or undesired content. In response, machine unlearning (MU) -- commonly referred to as concept erasure…

机器学习 · 计算机科学 2026-03-03 Xinwen Cheng , Jingyuan Zhang , Zhehao Huang , Yingwen Wu , Xiaolin Huang

Large-scale text-to-image diffusion models have achieved great success in synthesizing high-quality and diverse images given target text prompts. Despite the revolutionary image generation ability, current state-of-the-art models still…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

多媒体 · 计算机科学 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Erase inpainting, or object removal, aims to precisely remove target objects within masked regions while preserving the overall consistency of the surrounding content. Despite diffusion-based methods have made significant strides in the…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Yi Liu , Hao Zhou , Wenxiang Shang , Ran Lin , Benlei Cui

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Namhyuk Ahn , Wonhyuk Ahn , KiYoon Yoo , Daesik Kim , Seung-Hun Nam

Diffusion models (DMs) have achieved significant progress in text-to-image generation. However, the inevitable inclusion of sensitive information during pre-training poses safety risks, such as unsafe content generation and copyright…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Hongguang Zhu , Yunchao Wei , Mengyu Wang , Siyu Jiao , Yan Fang , Jiannan Huang , Yao Zhao

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Siyuan Yang , Lu Zhang , Liqian Ma , Yu Liu , JingJing Fu , You He

Concept erasure in text-to-image diffusion models seeks to remove undesired concepts while preserving overall generative capability. Localized erasure methods aim to restrict edits to the spatial region occupied by the target concept.…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Zhuan Shi , Alireza Dehghanpour Farashah , Rik de Vries , Golnoosh Farnadi