English
Related papers

Related papers: Side Effects of Erasing Concepts from Diffusion Mo…

200 papers

Text-to-image (T2I) diffusion models enable high-quality image generation conditioned on textual prompts. However, fine-tuning these pre-trained models for personalization raises concerns about unauthorized dataset usage. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Kuofeng Gao , Yufei Zhu , Yiming Li , Jiawang Bai , Yong Yang , Zhifeng Li , Shu-Tao Xia

Text-to-image diffusion models have shown an impressive ability to generate high-quality images from input textual descriptions. However, concerns have been raised about the potential for these models to create content that infringes on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tingxu Han , Weisong Sun , Yanrong Hu , Chunrong Fang , Yonglong Zhang , Shiqing Ma , Tao Zheng , Zhenyu Chen , Zhenting Wang

Motivated by ethical and legal concerns, the scientific community is actively developing methods to limit the misuse of Text-to-Image diffusion models for reproducing copyrighted, violent, explicit, or personal information in the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Vitali Petsiuk , Kate Saenko

Generating images from text has become easier because of the scaling of diffusion models and advancements in the field of vision and language. These models are trained using vast amounts of data from the Internet. Hence, they often contain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Masane Fuchi , Tomohiro Takagi

Concept-based Models aim to improve interpretability by predicting high-level intermediate concepts, representing a promising approach for deployment in high-risk scenarios. However, they are known to suffer from information leakage,…

Machine Learning · Computer Science 2026-03-25 Enrico Parisini , Tapabrata Chakraborti , Chris Harbron , Ben D. MacArthur , Christopher R. S. Banerji

Motivated by recent advancements in text-to-image diffusion, we study erasure of specific concepts from the model's weights. While Stable Diffusion has shown promise in producing explicit or realistic artwork, it has raised concerns…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Rohit Gandikota , Joanna Materzynska , Jaden Fiotto-Kaufman , David Bau

In the evolving landscape of text-to-image (T2I) diffusion models, the remarkable capability to generate high-quality images from textual descriptions faces challenges with the potential misuse of reproducing sensitive content. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Changhoon Kim , Kyle Min , Yezhou Yang

Erasing specific concepts from text-to-image diffusion models is essential for avoiding the generation of copyrighted and explicit content. Closed-form concept erasure methods offer a fast alternative to backpropagation-based techniques,…

Machine Learning · Computer Science 2026-05-12 Nicola Novello , Andrea M. Tonello

The expansion of large-scale text-to-image diffusion models has raised growing concerns about their potential to generate undesirable or harmful content, ranging from fabricated depictions of public figures to sexually explicit images. To…

Cryptography and Security · Computer Science 2025-05-01 Jonas Henry Grebe , Tobias Braun , Marcus Rohrbach , Anna Rohrbach

Despite the impressive capabilities of generating images, text-to-image diffusion models are susceptible to producing undesirable outputs such as NSFW content and copyrighted artworks. To address this issue, recent studies have focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Tianyun Yang , Juan Cao , Chang Xu

As text-to-image diffusion models grow increasingly prevalent, the ability to remove specific concepts-mostly explicit content and many copyrighted characters or styles-has become essential for safety and compliance. Existing unlearning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Junyeong Ahn , Seojin Yoon , Sungyong Baik

Text-to-image diffusion models allow seamless generation of personalized images from scant reference photos. Yet, these tools, in the wrong hands, can fabricate misleading or harmful content, endangering individuals. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yixin Liu , Chenrui Fan , Yutong Dai , Xun Chen , Pan Zhou , Lichao Sun

Robust concept removal for text-to-image (T2I) and text-to-video (T2V) models is essential for their safe deployment. Existing methods, however, suffer from costly retraining, inference overhead, or vulnerability to adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shristi Das Biswas , Arani Roy , Kaushik Roy

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Anubhav Jain , Yuya Kobayashi , Takashi Shibuya , Yuhta Takida , Nasir Memon , Julian Togelius , Yuki Mitsufuji

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Rohit Gandikota , Hadas Orgad , Yonatan Belinkov , Joanna Materzyńska , David Bau

Personalized text-to-image (T2I) generation has emerged as a key application for creating user-specific concepts from a few reference images. The core challenge is concept disentanglement: separating the target concept from irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

Concept erasure, which fine-tunes diffusion models to remove undesired or harmful visual concepts, has become a mainstream approach to mitigating unsafe or illegal image generation in text-to-image models.However, existing removal methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hao Chen , Yiwei Wang , Songze Li

Recent advances in text-to-image diffusion models have enabled the photorealistic generation of images from text prompts. Despite the great progress, existing models still struggle to generate compositional multi-concept images naturally,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Hazarapet Tunanyan , Dejia Xu , Shant Navasardyan , Zhangyang Wang , Humphrey Shi

Recently, autoregressive image generation models have wowed audiences with their remarkable capability in creating surprisingly realistic images. Models such as GPT-4o and LlamaGen can not only produce images that faithfully mimic renowned…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Chao Gong , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

While modern generative models such as diffusion-based architectures have enabled impressive creative capabilities, they also raise important safety and ethical risks. These concerns have led to growing interest in concept erasure, the…

Machine Learning · Computer Science 2026-04-14 Chi Zhang , Jingpu Cheng , Zhixian Wang , Ping Liu