English
Related papers

Related papers: DivCon: Divide and Conquer for Complex Numerical a…

200 papers

This paper does not describe a new method; instead, it provides a thorough exploration of an important yet understudied design space related to recent advances in text-to-image synthesis -- specifically, the deep fusion of large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Bingda Tang , Boyang Zheng , Xichen Pan , Sayak Paul , Saining Xie

Layout generation is a foundation task of graphic design, which requires the integration of visual aesthetics and harmonious expression of content delivery. However, existing methods still face challenges in generating precise and visually…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yu Li , Yifan Chen , Gongye Liu , Fei Yin , Qingyan Bai , Jie Wu , Hongfa Wang , Ruihang Chu , Yujiu Yang

Recently, diffusion models have achieved great success in image synthesis. However, when it comes to the layout-to-image generation where an image often has a complex scene of multiple objects, how to make strong control over both the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Guangcong Zheng , Xianpan Zhou , Xuewei Li , Zhongang Qi , Ying Shan , Xi Li

Large-scale, pre-trained Text-to-Image (T2I) diffusion models have gained significant popularity in image generation tasks and have shown unexpected potential in image Super-Resolution (SR). However, most existing T2I diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Brian B. Moser , Stanislav Frolov , Tobias C. Nauen , Federico Raue , Andreas Dengel

Large-scale diffusion models have achieved state-of-the-art results on text-to-image synthesis (T2I) tasks. Despite their ability to generate high-quality yet creative images, we observe that attribution-binding and compositional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Weixi Feng , Xuehai He , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , Xin Eric Wang , William Yang Wang

Diffusion models have exhibit exceptional performance in text-to-image generation and editing. However, existing methods often face challenges when handling complex text prompts that involve multiple objects with multiple attributes and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Zhaochen Yu , Chenlin Meng , Minkai Xu , Stefano Ermon , Bin Cui

The crux of text-to-image synthesis stems from the difficulty of preserving the cross-modality semantic consistency between the input text and the synthesized image. Typical methods, which seek to model the text-to-image mapping directly,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Jiadong Liang , Wenjie Pei , Feng Lu

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

3D scene generation conditioned on text prompts has significantly progressed due to the development of 2D diffusion generation models. However, the textual description of 3D scenes is inherently inaccurate and lacks fine-grained control…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Minglin Chen , Longguang Wang , Sheng Ao , Ye Zhang , Kai Xu , Yulan Guo

Recent breakthroughs in text-to-image diffusion models have significantly advanced the generation of high-fidelity, photo-realistic images from textual descriptions. Yet, these models often struggle with interpreting spatial arrangements…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jiaqi Liu , Tao Huang , Chang Xu

Despite significant progress in Text-to-Image (T2I) generative models, even lengthy and complex text descriptions still struggle to convey detailed controls. In contrast, Layout-to-Image (L2I) generation, aiming to generate realistic and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Chengyou Jia , Minnan Luo , Zhuohang Dang , Guang Dai , Xiaojun Chang , Mengmeng Wang , Jingdong Wang

Text-to-image (T2I) diffusion models are effective at producing semantically aligned images, but their reliance on training data distributions limits their ability to synthesize truly novel, out-of-distribution concepts. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Fu Feng , Yucheng Xie , Xu Yang , Jing Wang , Xin Geng

While diffusion-based text-to-image (T2I) models provide a simple and powerful way to generate images, guiding this generation remains a challenge. For concepts that are difficult to describe through language, users may struggle to create…

Human-Computer Interaction · Computer Science 2023-08-11 John Joon Young Chung , Eytan Adar

Text-and-Image-To-Image (TI2I), an extension of Text-To-Image (T2I), integrates image inputs with textual instructions to enhance image generation. Existing methods often partially utilize image inputs, focusing on specific elements like…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Teng-Fang Hsiao , Bo-Kai Ruan , Yi-Lun Wu , Tzu-Ling Lin , Hong-Han Shuai

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

Despite astonishing progress, generating realistic images of complex scenes remains a challenging problem. Recently, layout-to-image synthesis approaches have attracted much interest by conditioning the generator on a list of bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Stanislav Frolov , Prateek Bansal , Jörn Hees , Andreas Dengel

Text-to-Image (T2I) generation has made significant advancements with diffusion models, yet challenges persist in handling complex instructions, ensuring fine-grained content control, and maintaining deep semantic consistency. Existing T2I…

Machine Learning · Computer Science 2025-08-08 Xiaoqi Dong , Xiangyu Zhou , Nicholas Evans , Yujia Lin