中文
相关论文

相关论文: Localized Concept Erasure for Text-to-Image Diffus…

200 篇论文

Despite the tremendous success in text-to-image generative models, localized text-to-image generation (that is, generating objects or features at specific locations in an image while maintaining a consistent overall generation) still…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Yutong He , Ruslan Salakhutdinov , J. Zico Kolter

In addition to the unprecedented ability in imaginary creation, large text-to-image models are expected to take customized concepts in image generation. Existing works generally learn such concepts in an optimization-based manner, yet…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Yuxiang Wei , Yabo Zhang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Erasing harmful or proprietary concepts from powerful text to image generators is an emerging safety requirement, yet current "concept erasure" techniques either collapse image quality, rely on brittle adversarial losses, or demand…

机器学习 · 计算机科学 2025-11-11 Abhiram Kusumba , Maitreya Patel , Kyle Min , Changhoon Kim , Chitta Baral , Yezhou Yang

To what extent does concept erasure eliminate generative capacity in diffusion models? While prior evaluations have primarily focused on measuring concept suppression under specific textual prompts, we explore a complementary and…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Ping Liu , Chi Zhang

In concept erasure, a model is modified to selectively prevent it from generating a target concept. Despite the rapid development of new methods, it remains unclear how thoroughly these approaches remove the target concept from the model.…

机器学习 · 计算机科学 2025-11-10 Kevin Lu , Nicky Kriplani , Rohit Gandikota , Minh Pham , David Bau , Chinmay Hegde , Niv Cohen

Removing undesired concepts from large-scale text-to-image (T2I) and text-to-video (T2V) diffusion models while preserving overall generative quality remains a major challenge, particularly as modern models such as Stable Diffusion v3,…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Zhaoxin Fan , Nanxiang Jiang , Daiheng Gao , Shiji Zhou , Wenjun Wu

Recent breakthroughs in text-to-image diffusion models have significantly advanced the generation of high-fidelity, photo-realistic images from textual descriptions. Yet, these models often struggle with interpreting spatial arrangements…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jiaqi Liu , Tao Huang , Chang Xu

Text-to-image diffusion models have demonstrated remarkable capabilities in generating high-quality images, yet their tendency to reproduce undesirable concepts, such as NSFW content, copyrighted styles, or specific objects, poses growing…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zhiqi Zhang , Xinhao Zhong , Yi Sun , Shuoyang Sun , Bin Chen , Shu-Tao Xia , Xuan Wang

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Anubhav Jain , Yuya Kobayashi , Takashi Shibuya , Yuhta Takida , Nasir Memon , Julian Togelius , Yuki Mitsufuji

Robust concept removal for text-to-image (T2I) and text-to-video (T2V) models is essential for their safe deployment. Existing methods, however, suffer from costly retraining, inference overhead, or vulnerability to adversarial attacks.…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Shristi Das Biswas , Arani Roy , Kaushik Roy

Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such models using multiple, fine-grained concepts in a sequential…

计算机视觉与模式识别 · 计算机科学 2024-05-03 James Seale Smith , Yen-Chang Hsu , Lingyu Zhang , Ting Hua , Zsolt Kira , Yilin Shen , Hongxia Jin

The success of diffusion models has raised concerns about the generation of unsafe or harmful content, prompting concept erasure approaches that fine-tune modules to suppress specific concepts while preserving general generative…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Jiahang Tu , Ye Li , Yiming Wu , Hanbin Zhao , Chao Zhang , Hui Qian

Text-to-image diffusion models may generate harmful or copyrighted content, motivating research on concept erasure. However, existing approaches primarily focus on erasing concepts from text prompts, overlooking other input modalities that…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Ju-Hsuan Weng , Jia-Wei Liao , Cheng-Fu Chou , Jun-Cheng Chen

Recent diffusion-based image editing methods commonly rely on text or high-level instructions to guide the generation process, offering intuitive but coarse control. In contrast, we focus on explicit, prompt-free editing, where the user…

图形学 · 计算机科学 2026-04-24 Etai Sella , Yoav Baron , Hadar Averbuch-Elor , Daniel Cohen-Or , Or Patashnik

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Layout-to-image generation refers to the task of synthesizing photo-realistic images based on semantic layouts. In this paper, we propose LayoutDiffuse that adapts a foundational diffusion model pretrained on large-scale image or text-image…

计算机视觉与模式识别 · 计算机科学 2023-02-20 Jiaxin Cheng , Xiao Liang , Xingjian Shi , Tong He , Tianjun Xiao , Mu Li

Diffusion models (DMs) have achieved significant progress in text-to-image generation. However, the inevitable inclusion of sensitive information during pre-training poses safety risks, such as unsafe content generation and copyright…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Hongguang Zhu , Yunchao Wei , Mengyu Wang , Siyu Jiao , Yan Fang , Jiannan Huang , Yao Zhao

Text-to-image diffusion has attracted vast attention due to its impressive image-generation capabilities. However, when it comes to human-centric text-to-image generation, particularly in the context of faces and hands, the results often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jie Zhu , Yixiong Chen , Mingyu Ding , Ping Luo , Leye Wang , Jingdong Wang

Concept-based models can map black-box representations to human-understandable concepts, which makes the decision-making process more transparent and then allows users to understand the reason behind predictions. However, domain-specific…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Zequn Zeng , Yudi Su , Jianqiao Sun , Tiansheng Wen , Hao Zhang , Zhengjue Wang , Bo Chen , Hongwei Liu , Jiawei Ma