中文
相关论文

相关论文: Editing Massive Concepts in Text-to-Image Diffusio…

200 篇论文

Concept erasure, which fine-tunes diffusion models to remove undesired or harmful visual concepts, has become a mainstream approach to mitigating unsafe or illegal image generation in text-to-image models.However, existing removal methods…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Hao Chen , Yiwei Wang , Songze Li

Scene text editing is a challenging task that involves modifying or inserting specified texts in an image while maintaining its natural and realistic appearance. Most previous approaches to this task rely on style-transfer models that crop…

计算机视觉与模式识别 · 计算机科学 2023-04-13 Jiabao Ji , Guanhua Zhang , Zhaowen Wang , Bairu Hou , Zhifei Zhang , Brian Price , Shiyu Chang

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

密码学与安全 · 计算机科学 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

Recent thrilling progress in large-scale text-to-image (T2I) models has unlocked unprecedented synthesis quality of AI-generated content (AIGC) including image generation, 3D and video composition. Further, personalized techniques enable…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Yanbing Zhang , Mengping Yang , Qin Zhou , Zhe Wang

Diffusion models have shown superior performance in image generation and manipulation, but the inherent stochasticity presents challenges in preserving and manipulating image content and identity. While previous approaches like DreamBooth…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Inhwa Han , Serin Yang , Taesung Kwon , Jong Chul Ye

A plethora of text-guided image editing methods have recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models such as Imagen and Stable Diffusion. A standardized evaluation protocol,…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Samyadeep Basu , Mehrdad Saberi , Shweta Bhardwaj , Atoosa Malemir Chegini , Daniela Massiceti , Maziar Sanjabi , Shell Xu Hu , Soheil Feizi

Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignment, under which…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yiwei Xie , Ping Liu , Zheng Zhang

Text-to-image generative models can produce diverse high-quality images of concepts with a text prompt, which have demonstrated excellent ability in image generation, image translation, etc. We in this work study the problem of synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-09-11 Gan Sun , Wenqi Liang , Jiahua Dong , Jun Li , Zhengming Ding , Yang Cong

Integrating multiple personalized concepts into a single image has recently gained attention in text-to-image (T2I) generation. However, existing methods often suffer from performance degradation in complex scenes due to distortions in…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Young Beom Woo , Sun Eung Kim , Seong-Whan Lee

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

Text-guided image manipulation with diffusion models enables flexible and precise editing based on prompts, but raises ethical and copyright concerns due to potential unauthorized modifications. To address this, we propose SecureT2I, a…

密码学与安全 · 计算机科学 2025-07-08 Xiaodong Wu , Xiangman Li , Qi Li , Jianbing Ni , Rongxing Lu

Text-to-image personalization aims to teach a pre-trained diffusion model to reason about novel, user provided concepts, embedding them into new scenes guided by natural language prompts. However, current personalization approaches struggle…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Rinon Gal , Moab Arar , Yuval Atzmon , Amit H. Bermano , Gal Chechik , Daniel Cohen-Or

Concept erasure in Text-To-Image (T2I) diffusion models is vital for safe content generation, but existing inference-time methods face significant limitations. Feature-correction approaches often cause uncontrolled over-correction, while…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Qinghui Gong

In addition to the unprecedented ability in imaginary creation, large text-to-image models are expected to take customized concepts in image generation. Existing works generally learn such concepts in an optimization-based manner, yet…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Yuxiang Wei , Yabo Zhang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

Diffusion models have gained attention for image editing yielding impressive results in text-to-image tasks. On the downside, one might notice that generated images of stable diffusion models suffer from deteriorated details. This pitfall…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Joshua Santoso , Christian Simon , Williem

Diffusion models have demonstrated a remarkable ability in Text-to-Image (T2I) generation applications. Despite the advanced generation output, they suffer from heavy computation overhead, especially for large models that contain tens of…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Desen Sun , Jason Hon , Jintao Zhang , Sihang Liu

Text-to-image diffusion models rely on text embeddings from a pre-trained text encoder, but these embeddings remain fixed across all diffusion timesteps, limiting their adaptability to the generative process. We propose Diffusion Adaptive…

机器学习 · 计算机科学 2025-10-29 Byeonghu Na , Minsang Park , Gyuwon Sim , Donghyeok Shin , HeeSun Bae , Mina Kang , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

In concept erasure, a model is modified to selectively prevent it from generating a target concept. Despite the rapid development of new methods, it remains unclear how thoroughly these approaches remove the target concept from the model.…

机器学习 · 计算机科学 2025-11-10 Kevin Lu , Nicky Kriplani , Rohit Gandikota , Minh Pham , David Bau , Chinmay Hegde , Niv Cohen