中文
相关论文

相关论文: Infusion: Preventing Customized Text-to-Image Diff…

200 篇论文

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

Text-to-image (T2I) models can effectively capture the content or style of reference images to perform high-quality customization. A representative technique for this is fine-tuning using low-rank adaptations (LoRA), which enables efficient…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Geonhui Jang , Jin-Hwa Kim , Yong-Hyun Park , Junho Kim , Gayoung Lee , Yonghyun Jeong

Despite significant advancements in customizing text-to-image and video generation models, generating images and videos that effectively integrate multiple personalized concepts remains a challenging task. To address this, we present…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Gihyun Kwon , Jong Chul Ye

This work addresses the challenge of quantifying originality in text-to-image (T2I) generative diffusion models, with a focus on copyright originality. We begin by evaluating T2I models' ability to innovate and generalize through controlled…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Adi Haviv , Shahar Sarfaty , Uri Hacohen , Niva Elkin-Koren , Roi Livni , Amit H Bermano

Model customization introduces new concepts to existing text-to-image models, enabling the generation of these new concepts/objects in novel contexts. However, such methods lack accurate camera view control with respect to the new object,…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Nupur Kumari , Grace Su , Richard Zhang , Taesung Park , Eli Shechtman , Jun-Yan Zhu

Recent advances in text-to-image diffusion models have substantially improved the quality of image customization, enabling the synthesis of highly realistic images. Despite this progress, achieving fast and efficient personalization remains…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Aniket Roy , Maitreya Suin , Rama Chellappa

Recent advances in diffusion transformers have shown remarkable generalization in visual synthesis, yet most dense perception methods still rely on text-to-image (T2I) generators designed for stochastic generation. We revisit this paradigm…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yiqing Shi , Yiren Song , Mike Zheng Shou

Modern Text-to-Image (T2I) Diffusion models have revolutionized image editing by enabling the generation of high-quality photorealistic images. While the de facto method for performing edits with T2I models is through text instructions,…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Ashutosh Srivastava , Tarun Ram Menta , Abhinav Java , Avadhoot Jadhav , Silky Singh , Surgan Jandial , Balaji Krishnamurthy

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Large-scale, pre-trained Text-to-Image (T2I) diffusion models have gained significant popularity in image generation tasks and have shown unexpected potential in image Super-Resolution (SR). However, most existing T2I diffusion models are…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Brian B. Moser , Stanislav Frolov , Tobias C. Nauen , Federico Raue , Andreas Dengel

Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M Patel

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Ahmad Süleyman , Göksel Biricik

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shipeng Cao , Biao Qian , Haipeng Liu , Yang Wang , Meng Wang

As recent advances in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Geonung Kim , Beomsu Kim , Eunhyeok Park , Sunghyun Cho

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Scaling up model and data size has been quite successful for the evolution of LLMs. However, the scaling law for the diffusion based text-to-image (T2I) models is not fully explored. It is also unclear how to efficiently scale the model for…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Hao Li , Yang Zou , Ying Wang , Orchid Majumder , Yusheng Xie , R. Manmatha , Ashwin Swaminathan , Zhuowen Tu , Stefano Ermon , Stefano Soatto

Diffusion models have achieved remarkable success in text-to-image generation, enabling the creation of high-quality images from text prompts or other modalities. However, existing methods for customizing these models are limited by…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Ligong Han , Yinxiao Li , Han Zhang , Peyman Milanfar , Dimitris Metaxas , Feng Yang

Inversion methods, such as Textual Inversion, generate personalized images by incorporating concepts of interest provided by user images. However, existing methods often suffer from overfitting issues, where the dominant presence of…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Xulu Zhang , Xiao-Yong Wei , Jinlin Wu , Tianyi Zhang , Zhaoxiang Zhang , Zhen Lei , Qing Li

Zero-shot object counting aims to count instances of arbitrary object categories specified by text descriptions. Existing methods typically rely on vision-language models like CLIP, but often exhibit limited sensitivity to text prompts. We…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Yifei Qian , Zhongliang Guo , Bowen Deng , Chun Tong Lei , Shuai Zhao , Chun Pong Lau , Xiaopeng Hong , Michael P. Pound