English
Related papers

Related papers: Ablating Concepts in Text-to-Image Diffusion Model…

200 papers

Recent advancements in text-to-image diffusion models have demonstrated their remarkable capability to generate high-quality images from textual prompts. However, increasing research indicates that these models memorize and replicate images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jie Ren , Yaxin Li , Shenglai Zeng , Han Xu , Lingjuan Lyu , Yue Xing , Jiliang Tang

Text-to-image diffusion models have attracted considerable interest due to their wide applicability across diverse fields. However, challenges persist in creating controllable models for personalized object generation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Yuheng Li , Haotian Liu , Yangming Wen , Yong Jae Lee

As text-to-image diffusion models grow increasingly prevalent, the ability to remove specific concepts-mostly explicit content and many copyrighted characters or styles-has become essential for safety and compliance. Existing unlearning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Junyeong Ahn , Seojin Yoon , Sungyong Baik

Security concerns surrounding text-to-image diffusion models have driven researchers to unlearn inappropriate concepts through fine-tuning. Recent fine-tuning methods typically align the prediction distributions of unsafe prompts with those…

Machine Learning · Computer Science 2025-01-03 Mengnan Zhao , Lihe Zhang , Xingyi Yang , Tianhang Zheng , Baocai Yin

Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such models using multiple, fine-grained concepts in a sequential…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 James Seale Smith , Yen-Chang Hsu , Lingyu Zhang , Ting Hua , Zsolt Kira , Yilin Shen , Hongxia Jin

Diffusion model based language-guided image editing has achieved great success recently. However, existing state-of-the-art diffusion models struggle with rendering correct text and text style during generation. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Haoxing Chen , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Xing Zheng , Yaohui Li , Changhua Meng , Huijia Zhu , Weiqiang Wang

Diffusion models have shown great promise in text-guided image style transfer, but there is a trade-off between style transformation and content preservation due to their stochastic nature. Existing methods require computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Serin Yang , Hyunmin Hwang , Jong Chul Ye

Machine unlearning for text-to-image diffusion models aims to selectively remove undesirable concepts from pre-trained models without costly retraining. Current unlearning methods share a common weakness: erased concepts return when the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Aljalila Aladawi , Mohammed Talha Alam , Fakhri Karray

The proliferation of text-to-image diffusion models has raised significant privacy and security concerns, particularly regarding the generation of copyrighted or harmful images. In response, concept erasure (defense) methods have been…

Machine Learning · Computer Science 2025-10-06 Alex D. Richardson , Kaicheng Zhang , Lucas Beerens , Dongdong Chen

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Younghyun Kim , Geunmin Hwang , Junyu Zhang , Eunbyung Park

Text-to-Image (T2I) models have demonstrated impressive capabilities in generating high-quality and diverse visual content from natural language prompts. However, uncontrolled reproduction of sensitive, copyrighted, or harmful imagery poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yiwei Xie , Ping Liu , Zheng Zhang

Concept erasure techniques have recently gained significant attention for their potential to remove unwanted concepts from text-to-image models. While these methods often demonstrate promising results in controlled settings, their…

The recent proliferation of large-scale text-to-image models has led to growing concerns that such models may be misused to generate harmful, misleading, and inappropriate content. Motivated by this issue, we derive a technique inspired by…

Machine Learning · Computer Science 2023-10-18 Alvin Heng , Harold Soh

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Recently, text-to-image diffusion models have been widely used for style mimicry and personalized customization through methods such as DreamBooth and Textual Inversion. This has raised concerns about intellectual property protection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yanjie Li , Wenxuan Zhang , Xinqi Lyu , Yihao Liu , Bin Xiao

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attractive in this setting because they apply a single deterministic edit to the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Saemi Moon , Suhyeon Jun , Seoyeon Lee , Dongwoo Kim

In today's age of social media and marketing, copyright issues can be a major roadblock to the free sharing of images. Generative AI models have made it possible to create high-quality images, but concerns about copyright infringement are a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Mazharul Islam Rakib , Showrin Rahman , Joyanta Jyoti Mondal , Xi Xiao , David Lewis , Alessandra Mileo , Meem Arafat Manab

Large text-to-image models have revolutionized the ability to generate imagery using natural language. However, particularly unique or personal visual concepts, such as pets and furniture, will not be captured by the original model. This…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xingzhe He , Zhiwen Cao , Nicholas Kolkin , Lantao Yu , Kun Wan , Helge Rhodin , Ratheesh Kalarot

Generative image models, since introduction, have become a global phenomenon. From new arts becoming possible to new vectors of abuse, many new capabilities have become available. One of the challenging issues with generative models is…

Machine Learning · Computer Science 2024-08-29 Ali Zand , Milad Nasr