English
Related papers

Related papers: Erasing Concepts from Diffusion Models

200 papers

Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiwoo Chung , Sangeek Hyun , Jae-Pil Heo

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for their safe deployment to prevent the creation of harmful content. This has fostered a dynamic interplay between the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Qianlong Xiang , Miao Zhang , Haoyu Zhang , Kun Wang , Junhui Hou , Liqiang Nie

Neural Style Transfer (NST) is the field of study applying neural techniques to modify the artistic appearance of a content image to match the style of a reference style image. Traditionally, NST methods have focused on texture-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Dan Ruta , Gemma Canet Tarrés , Andrew Gilbert , Eli Shechtman , Nicholas Kolkin , John Collomosse

Motivated by ethical and legal concerns, the scientific community is actively developing methods to limit the misuse of Text-to-Image diffusion models for reproducing copyrighted, violent, explicit, or personal information in the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Vitali Petsiuk , Kate Saenko

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Diffusion models have transformed image generation, yet controlling their outputs to reliably erase undesired concepts remains challenging. Existing approaches usually require task-specific training and struggle to generalize across both…

As text-to-image diffusion models gain widespread commercial applications, there are increasing concerns about unethical or harmful use, including the unauthorized generation of copyrighted or sensitive content. Concept unlearning has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Saemi Moon , Minjong Lee , Sangdon Park , Dongwoo Kim

Diffusion-based models have gained significant popularity for text-to-image generation due to their exceptional image-generation capabilities. A risk with these models is the potential generation of inappropriate content, such as biased or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hang Li , Chengzhi Shen , Philip Torr , Volker Tresp , Jindong Gu

Denoising diffusion models have emerged as a dominant approach for image generation, however they still suffer from slow convergence in training and color shift issues in sampling. In this paper, we identify that these obstacles can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hu Yu , Li Shen , Jie Huang , Hongsheng Li , Feng Zhao

Diffusion models, while powerful, can inadvertently generate harmful or undesirable content, raising significant ethical and safety concerns. Recent machine unlearning approaches offer potential solutions but often lack transparency, making…

Machine Learning · Computer Science 2025-05-23 Bartosz Cywiński , Kamil Deja

The remarkable image generation capabilities of state-of-the-art diffusion models, such as Stable Diffusion, can also be misused to spread misinformation and plagiarize copyrighted materials. To mitigate the potential risks associated with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Qiuyu Tang , Bonor Ayambem , Mooi Choo Chuah , Aparna Bharati

Pruning-based unlearning has recently emerged as a fast, training-free, and data-independent approach to remove undesired concepts from diffusion models. It promises high efficiency and robustness, offering an attractive alternative to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ci Zhang , Zhaojun Ding , Chence Yang , Jun Liu , Xiaoming Zhai , Shaoyi Huang , Beiwen Li , Xiaolong Ma , Jin Lu , Geng Yuan

The powerful generative capabilities of diffusion models have raised growing privacy and safety concerns regarding generating sensitive or undesired content. In response, machine unlearning (MU) -- commonly referred to as concept erasure…

Machine Learning · Computer Science 2026-03-03 Xinwen Cheng , Jingyuan Zhang , Zhehao Huang , Yingwen Wu , Xiaolin Huang

Large-scale text-to-image diffusion models have achieved great success in synthesizing high-quality and diverse images given target text prompts. Despite the revolutionary image generation ability, current state-of-the-art models still…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

Multimedia · Computer Science 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Erase inpainting, or object removal, aims to precisely remove target objects within masked regions while preserving the overall consistency of the surrounding content. Despite diffusion-based methods have made significant strides in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yi Liu , Hao Zhou , Wenxiang Shang , Ran Lin , Benlei Cui

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Namhyuk Ahn , Wonhyuk Ahn , KiYoon Yoo , Daesik Kim , Seung-Hun Nam

Diffusion models (DMs) have achieved significant progress in text-to-image generation. However, the inevitable inclusion of sensitive information during pre-training poses safety risks, such as unsafe content generation and copyright…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Hongguang Zhu , Yunchao Wei , Mengyu Wang , Siyu Jiao , Yan Fang , Jiannan Huang , Yao Zhao

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Siyuan Yang , Lu Zhang , Liqian Ma , Yu Liu , JingJing Fu , You He

Concept erasure in text-to-image diffusion models seeks to remove undesired concepts while preserving overall generative capability. Localized erasure methods aim to restrict edits to the spatial region occupied by the target concept.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zhuan Shi , Alireza Dehghanpour Farashah , Rik de Vries , Golnoosh Farnadi