English
Related papers

Related papers: FlexEControl: Flexible and Efficient Multimodal Co…

200 papers

Diffusion models have attracted significant attention due to the remarkable ability to create content and generate data for tasks like image classification. However, the usage of diffusion models to generate the high-quality object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kai Chen , Enze Xie , Zhe Chen , Yibo Wang , Lanqing Hong , Zhenguo Li , Dit-Yan Yeung

Text-to-image (T2I) systems enable rapid generation of high-fidelity imagery but are misaligned with how visual ideas develop. T2I systems generate outputs that make implicit visual decisions on behalf of the user, often introduce…

Human-Computer Interaction · Computer Science 2026-04-16 Zoe De Simone , Angie Boggust , Fredo Durand , Ashia Wilson , Arvind Satyanarayan

Representation Autoencoders (RAEs) have shown distinct advantages in diffusion modeling on ImageNet by training in high-dimensional semantic latent spaces. In this work, we investigate whether this framework can scale to large-scale,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shengbang Tong , Boyang Zheng , Ziteng Wang , Bingda Tang , Nanye Ma , Ellis Brown , Jihan Yang , Rob Fergus , Yann LeCun , Saining Xie

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Unified generative models have shown remarkable performance in text and image generation. For image synthesis tasks, they adopt straightforward text-to-image (T2I) generation. However, direct T2I generation limits the models in handling…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yi Wang , Mushui Liu , Wanggui He , Hanyang Yuan , Longxiang Zhang , Ziwei Huang , Guanghao Zhang , Wenkai Fang , Haoze Jiang , Shengxuming Zhang , Dong She , Jinlong Liu , Weilong Dai , Mingli Song , Hao Jiang , Jie Song

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Unified multimodal models have recently shown remarkable gains in both capability and versatility, yet most leading systems are still trained from scratch and require substantial computational resources. In this paper, we show that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeyu Wang , Zilong Chen , Chenhui Gou , Feng Li , Chaorui Deng , Deyao Zhu , Kunchang Li , Weihao Yu , Haoqin Tu , Haoqi Fan , Cihang Xie

Diffusion distillation has dramatically accelerated class-conditional image synthesis, but its applicability to open-ended text-to-image (T2I) generation is still unclear. We present the first systematic study that adapts and compares…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yifan Pu , Yizeng Han , Zhiwei Tang , Jiasheng Tang , Fan Wang , Bohan Zhuang , Gao Huang

A significant ``modality gap" exists between the abundance of text-only data and the increasing power of multimodal models. This work systematically investigates whether images generated on-the-fly by Text-to-Image (T2I) models can serve as…

Multimedia · Computer Science 2026-03-04 Yuesheng Huang , Peng Zhang , Xiaoxin Wu , Riliang Liu , Jiaqi Liang

Recently, many text-to-image diffusion models have excelled at generating high-resolution images from text but struggle with precise control over spatial composition and object counting. To address these challenges, prior works have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Huancheng Chen , Jingtao Li , Weiming Zhuang , Haris Vikalo , Lingjuan Lyu

The rapid advancement of diffusion models has enabled high-fidelity and semantically rich text-to-image generation; however, ensuring fairness and safety remains an open challenge. Existing methods typically improve fairness and safety at…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Silpa Vadakkeeveetil Sreelatha , Sauradip Nag , Muhammad Awais , Serge Belongie , Anjan Dutta

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

With the rapid advancement of 2D generative models, preserving subject identity while enabling diverse editing has emerged as a critical research focus. Existing methods typically face inherent trade-offs between identity preservation and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Linyan Huang , Haonan Lin , Yanning Zhou , Kaiwen Xiao

Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Hui Li , Xi Li , Zhangyong Tang , Josef Kittler

With the rapid development of diffusion models, text-to-image(T2I) models have made significant progress, showcasing impressive abilities in prompt following and image generation. Recently launched models such as FLUX.1 and Ideogram2.0,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jiayi Lei , Renrui Zhang , Xiangfei Hu , Weifeng Lin , Zhen Li , Wenjian Sun , Ruoyi Du , Le Zhuo , Zhongyu Li , Xinyue Li , Shitian Zhao , Ziyu Guo , Yiting Lu , Peng Gao , Hongsheng Li

Text-driven diffusion models have unlocked unprecedented abilities in image generation, whereas their video counterpart still lags behind due to the excessive training cost of temporal modeling. Besides the training burden, the generated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yabo Zhang , Yuxiang Wei , Dongsheng Jiang , Xiaopeng Zhang , Wangmeng Zuo , Qi Tian

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

In human-centric content generation, the pre-trained text-to-image models struggle to produce user-wanted portrait images, which retain the identity of individuals while exhibiting diverse expressions. This paper introduces our efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Renshuai Liu , Bowen Ma , Wei Zhang , Zhipeng Hu , Changjie Fan , Tangjie Lv , Yu Ding , Xuan Cheng

To enhance the controllability of text-to-image diffusion models, existing efforts like ControlNet incorporated image-based conditional controls. In this paper, we reveal that existing methods still face significant challenges in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Li , Taojiannan Yang , Huafeng Kuang , Jie Wu , Zhaoning Wang , Xuefeng Xiao , Chen Chen

With the rapid advancement of intelligent transportation systems, text-driven image generation and editing techniques have demonstrated significant potential in providing rich, controllable visual scene data for applications such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Feng Lv , Haoxuan Feng , Zilu Zhang , Chunlong Xia , Yanfeng Li