English
Related papers

Related papers: Infusion: Preventing Customized Text-to-Image Diff…

200 papers

Image-to-image translation aims to learn a mapping between a source and a target domain, enabling tasks such as style transfer, appearance transformation, and domain adaptation. In this work, we explore a diffusion-based framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qiang Zhu , Kuan Lu , Menghao Huo , Yuxiao Li

Recent advances in text-to-image models have enabled high-quality personalized image synthesis of user-provided concepts with flexible textual control. In this work, we analyze the limitations of two primary techniques in text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Lianyu Pang , Jian Yin , Baoquan Zhao , Feize Wu , Fu Lee Wang , Qing Li , Xudong Mao

Lifelong few-shot customization for text-to-image diffusion aims to continually generalize existing models for new tasks with minimal data while preserving old knowledge. Current customization diffusion models excel in few-shot tasks but…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Nan Song , Xiaofeng Yang , Ze Yang , Guosheng Lin

This paper addresses the societal concerns arising from large-scale text-to-image diffusion models for generating potentially harmful or copyrighted content. Existing models rely heavily on internet-crawled data, wherein problematic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Sanghyun Kim , Seohyeon Jung , Balhae Kim , Moonseok Choi , Jinwoo Shin , Juho Lee

This paper analyzes the impact of causal manner in the text encoder of text-to-image (T2I) diffusion models, which can lead to information bias and loss. Previous works have focused on addressing the issues through the denoising process.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chieh-Yun Chen , Chiang Tseng , Li-Wu Tsao , Hong-Han Shuai

The most advanced text-to-image (T2I) models require significant training costs (e.g., millions of GPU hours), seriously hindering the fundamental innovation for the AIGC community while increasing CO2 emissions. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junsong Chen , Jincheng Yu , Chongjian Ge , Lewei Yao , Enze Xie , Yue Wu , Zhongdao Wang , James Kwok , Ping Luo , Huchuan Lu , Zhenguo Li

Text-to-Image (T2I) diffusion models have shown impressive results in generating visually compelling images following user prompts. Building on this, various methods further fine-tune the pre-trained T2I model for specific tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tsu-Jui Fu , Yusu Qian , Chen Chen , Wenze Hu , Zhe Gan , Yinfei Yang

The text-to-image (T2I) personalization diffusion model can generate images of the novel concept based on the user input text caption. However, existing T2I personalized methods either require test-time fine-tuning or fail to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Xiao Guo , Manh Tran , Jiaxin Cheng , Xiaoming Liu

Recent advancements in text-to-image diffusion models have significantly transformed visual content generation, yet their application in specialized fields such as interior design remains underexplored. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Zhaowei Wang , Ying Hao , Hao Wei , Qing Xiao , Lulu Chen , Yulong Li , Yue Yang , Tianyi Li

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsupervised trackers often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhengbo Zhang , Zhigang Tu , Junsong Yuan , De Wen Soh , Bo Du

Creating editable videos that depict complex interactions between multiple objects in various artistic styles has long been a challenging task in filmmaking. Progress is often hampered by the scarcity of data sets that contain paired text…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Anisha Jain

Removing unwanted concepts from large-scale text-to-image (T2I) diffusion models while maintaining their overall generative quality remains an open challenge. This difficulty is especially pronounced in emerging paradigms, such as Stable…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Daiheng Gao , Shilin Lu , Shaw Walters , Wenbo Zhou , Jiaming Chu , Jie Zhang , Bang Zhang , Mengxi Jia , Jian Zhao , Zhaoxin Fan , Weiming Zhang

Text-to-image diffusion models have made significant progress in image generation, allowing for effortless customized generation. However, existing image editing methods still face certain limitations when dealing with personalized image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yuhong Zhang , Han Wang , Yiwen Wang , Rong Xie , Li Song

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Text-guided image editing using Text-to-Image (T2I) models often fails to yield satisfactory results, frequently introducing unintended modifications, such as the loss of local detail and color changes. In this paper, we analyze these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yufan Ren , Zicong Jiang , Tong Zhang , Søren Forchhammer , Sabine Süsstrunk

Text-to-image diffusion models have achieved remarkable progress in generating diverse and realistic images from textual descriptions. However, they still struggle with personalization, which requires adapting a pretrained model to depict…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Seoyun Yang , Gihoon Kim , Taesup Kim

Text-to-image diffusion models can generate diverse content with flexible prompts, which makes them well-suited for customization through fine-tuning with a small amount of user-provided data. However, controllable fine-tuning that prevents…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ziyao Zeng , Jingcheng Ni , Ruyi Liu , Alex Wong

Personalized text-to-image generation models enable users to create images that depict their individual possessions in diverse scenes, finding applications in various domains. To achieve the personalization capability, existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yu Zeng , Vishal M. Patel , Haochen Wang , Xun Huang , Ting-Chun Wang , Ming-Yu Liu , Yogesh Balaji

The proliferation of text-to-image diffusion models (T2I DMs) has led to an increased presence of AI-generated images in daily life. However, biased T2I models can generate content with specific tendencies, potentially influencing people's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Huayang Huang , Xiangye Jin , Jiaxu Miao , Yu Wu

Optical illusion hidden picture is an interesting visual perceptual phenomenon where an image is cleverly integrated into another picture in a way that is not immediately obvious to the viewer. Established on the off-the-shelf text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Xiang Gao , Shuai Yang , Jiaying Liu