English
Related papers

Related papers: Safe and Reliable Diffusion Models via Subspace Pr…

200 papers

In concept erasure, a model is modified to selectively prevent it from generating a target concept. Despite the rapid development of new methods, it remains unclear how thoroughly these approaches remove the target concept from the model.…

Machine Learning · Computer Science 2025-11-10 Kevin Lu , Nicky Kriplani , Rohit Gandikota , Minh Pham , David Bau , Chinmay Hegde , Niv Cohen

Diffusion models excel in many generative modeling tasks, notably in creating images from text prompts, a task referred to as text-to-image (T2I) generation. Despite the ability to generate high-quality images, these models often replicate…

Multimedia · Computer Science 2024-02-20 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Haonan Wang , Kenji Kawaguchi

Large-scale Text-to-Image (T2I) diffusion models demonstrate significant generation capabilities based on textual prompts. Based on the T2I diffusion models, text-guided image editing research aims to empower users to manipulate generated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Chuanming Tang , Kai Wang , Fei Yang , Joost van de Weijer

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

Concept erasure serves as a vital safety mechanism for removing unwanted concepts from text-to-image (T2I) models. While extensively studied in U-Net and dual-stream architectures (e.g., Flux), this task remains under-explored in the recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nanxiang Jiang , Zhaoxin Fan , Baisen Wang , Daiheng Gao , Junhang Cheng , Jifeng Guo , Yalan Qin , Yeying Jin , Hongwei Zheng , Faguo Wu , Wenjun Wu

Although recent personalization methods have democratized high-resolution image synthesis by enabling swift concept acquisition with minimal examples and lightweight computation, they also present an exploitable avenue for high accessible…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yihao Huang , Felix Juefei-Xu , Qing Guo , Jie Zhang , Yutong Wu , Ming Hu , Tianlin Li , Geguang Pu , Yang Liu

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Modern Text-to-Image (T2I) Diffusion models have revolutionized image editing by enabling the generation of high-quality photorealistic images. While the de facto method for performing edits with T2I models is through text instructions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ashutosh Srivastava , Tarun Ram Menta , Abhinav Java , Avadhoot Jadhav , Silky Singh , Surgan Jandial , Balaji Krishnamurthy

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

We propose EditCrafter, a high-resolution image editing method that operates without tuning, leveraging pretrained text-to-image (T2I) diffusion models to process images at resolutions significantly exceeding those used during training.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Kunho Kim , Sumin Seo , Yongjun Cho , Hyungjin Chung

Despite the remarkable progress in text-to-image generative models, they are prone to adversarial attacks and inadvertently generate unsafe, unethical content. Existing approaches often rely on fine-tuning models to remove specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Dahye Kim , Deepti Ghadiyaram

Concept erasure has emerged as a promising technique for mitigating the risk of harmful content generation in diffusion models by selectively unlearning undesirable concepts. The common principle of previous works to remove a specific…

Machine Learning · Computer Science 2025-05-26 Anh Bui , Trang Vu , Long Vuong , Trung Le , Paul Montague , Tamas Abraham , Junae Kim , Dinh Phung

Concept unlearning has emerged as a promising direction for reducing the risks of harmful content generation in text-to-image diffusion models by selectively erasing undesirable concepts from a model's parameters. Existing approaches…

Artificial Intelligence · Computer Science 2026-03-20 Duc Hao Pham , Van Duy Truong , Duy Khanh Dinh , Tien Cuong Nguyen , Dien Hy Ngo , Tuan Anh Bui

The objective of image super-resolution is to generate clean and high-resolution images from degraded versions. Recent advancements in diffusion modeling have led to the emergence of various image super-resolution techniques that leverage…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Haolan Chen , Jinhua Hao , Kai Zhao , Kun Yuan , Ming Sun , Chao Zhou , Wei Hu

Text-to-image (T2I) models can effectively capture the content or style of reference images to perform high-quality customization. A representative technique for this is fine-tuning using low-rank adaptations (LoRA), which enables efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Geonhui Jang , Jin-Hwa Kim , Yong-Hyun Park , Junho Kim , Gayoung Lee , Yonghyun Jeong

The inherent ambiguity in defining visual concepts poses significant challenges for modern generative models, such as the diffusion-based Text-to-Image (T2I) models, in accurately learning concepts from a single image. Existing methods lack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fernando Julio Cendra , Kai Han

In-context diffusion models allow users to modify images with remarkable ease and realism. However, the same power raises serious privacy concerns: personal images can be easily manipulated for identity impersonation, misinformation, or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Linghui Shen , Mingyue Cui , Xingyi Yang

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ruichen Wang , Zekang Chen , Chen Chen , Jian Ma , Haonan Lu , Xiaodong Lin

The widespread deployment of text-to-image diffusion models is significantly challenged by the generation of visually harmful content, such as sexually explicit content, violence, and horror imagery. Common safety interventions, ranging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Lingyun Zhang , Yu Xie , Zhongli Fang , Yu Liu , Ping Chen

Diffusion models are a new class of generative models, and have dramatically promoted image generation with unprecedented quality and diversity. Existing diffusion models mainly try to reconstruct input image from a corrupted one with a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Jingwei Liu , Shenda Hong , Zhilong Zhang , Zhilin Huang , Zheming Cai , Wentao Zhang , Bin Cui