English
Related papers

Related papers: On the Scalability of Diffusion-based Text-to-Imag…

200 papers

Text-to-image (T2I) customization aims to create images that embody specific visual concepts delineated in textual descriptions. However, existing works still face a main challenge, concept overfitting. To tackle this challenge, we first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Weili Zeng , Yichao Yan , Qi Zhu , Zhuo Chen , Pengzhi Chu , Weiming Zhao , Xiaokang Yang

Text-to-Image (T2I) diffusion models have shown impressive results in generating visually compelling images following user prompts. Building on this, various methods further fine-tune the pre-trained T2I model for specific tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tsu-Jui Fu , Yusu Qian , Chen Chen , Wenze Hu , Zhe Gan , Yinfei Yang

Extensive pre-training with large data is indispensable for downstream geometry and semantic visual perception tasks. Thanks to large-scale text-to-image (T2I) pretraining, recent works show promising results by simply fine-tuning T2I…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Guangkai Xu , Yongtao Ge , Mingyu Liu , Chengxiang Fan , Kangyang Xie , Zhiyue Zhao , Hao Chen , Chunhua Shen

We study the scaling properties of latent diffusion models (LDMs) with an emphasis on their sampling efficiency. While improved network architecture and inference algorithms have shown to effectively boost sampling efficiency of diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Kangfu Mei , Zhengzhong Tu , Mauricio Delbracio , Hossein Talebi , Vishal M. Patel , Peyman Milanfar

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

Computation and Language · Computer Science 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ahmad Süleyman , Göksel Biricik

Text-to-image (T2I) models are well known for their ability to produce highly realistic images, while multimodal large language models (MLLMs) are renowned for their proficiency in understanding and integrating multiple modalities. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jian Ma , Qirong Peng , Xu Guo , Chen Chen , Haonan Lu , Zhenyu Yang

Recent breakthroughs of transformer-based diffusion models, particularly with Multimodal Diffusion Transformers (MMDiT) driven models like FLUX and Qwen Image, have facilitated thrilling experiences in text-to-image generation and editing.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

Tokenizing images into compact visual representations is a key step in learning efficient and high-quality image generative models. We present a simple diffusion tokenizer (DiTo) that learns compact visual representations for image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Yinbo Chen , Rohit Girdhar , Xiaolong Wang , Sai Saketh Rambhatla , Ishan Misra

Recently, diffusion models have been proven to perform remarkably well in text-to-image synthesis tasks in a number of studies, immediately presenting new study opportunities for image generation. Google's Imagen follows this research trend…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Ruijun Li , Weihua Li , Yi Yang , Hanyu Wei , Jianhua Jiang , Quan Bai

Existing text-to-image (T2I) diffusion models face several limitations, including large model sizes, slow runtime, and low-quality generation on mobile devices. This paper aims to address all of these challenges by developing an extremely…

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

Achieving optimal performance of video diffusion transformers within given data and compute budget is crucial due to their high training costs. This necessitates precisely determining the optimal model size and training hyperparameters…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yuanyang Yin , Yaqi Zhao , Mingwu Zheng , Ke Lin , Jiarong Ou , Rui Chen , Victor Shea-Jay Huang , Jiahao Wang , Xin Tao , Pengfei Wan , Di Zhang , Baoqun Yin , Wentao Zhang , Kun Gai

This paper does not describe a new method; instead, it provides a thorough exploration of an important yet understudied design space related to recent advances in text-to-image synthesis -- specifically, the deep fusion of large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Bingda Tang , Boyang Zheng , Xichen Pan , Sayak Paul , Saining Xie

Text-to-image (T2I) diffusion models (DMs) have shown promise in generating high-quality images from textual descriptions. The real-world applications of these models require particular attention to their safety and fidelity, but this has…

Cryptography and Security · Computer Science 2023-06-26 Hongcheng Gao , Hao Zhang , Yinpeng Dong , Zhijie Deng

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Applying diffusion models to image-to-image translation (I2I) has recently received increasing attention due to its practical applications. Previous attempts inject information from the source image into each denoising step for an iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mengfei Xia , Yu Zhou , Ran Yi , Yong-Jin Liu , Wenping Wang

Text-to-image generation (TTI) refers to the usage of models that could process text input and generate high fidelity images based on text descriptions. Text-to-image generation using neural networks could be traced back to the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Fengxiang Bie , Yibo Yang , Zhongzhu Zhou , Adam Ghanem , Minjia Zhang , Zhewei Yao , Xiaoxia Wu , Connor Holmes , Pareesa Golnari , David A. Clifton , Yuxiong He , Dacheng Tao , Shuaiwen Leon Song

While recent advancements in generative modeling have significantly improved text-image alignment, some residual misalignment between text and image representations still remains. Some approaches address this issue by fine-tuning models in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jaa-Yeon Lee , Byunghee Cha , Jeongsol Kim , Jong Chul Ye