English
Related papers

Related papers: ReCo: Region-Controlled Text-to-Image Generation

200 papers

Text-to-image diffusion models achieved a remarkable leap in capabilities over the last few years, enabling high-quality and diverse synthesis of images from a textual prompt. However, even the most advanced models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Eyal Segalis , Dani Valevski , Danny Lumen , Yossi Matias , Yaniv Leviathan

The rich textual information of large vision-language models (VLMs) combined with the powerful generative prior of pre-trained text-to-image (T2I) diffusion models has achieved impressive performance in single-image super-resolution (SISR).…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Haodong He , Yancheng Bai , Rui Lan , Xu Duan , Lei Sun , Xiangxiang Chu , Gui-Song Xia

Understanding spatial relations is a crucial cognitive ability for both humans and AI. While current research has predominantly focused on the benchmarking of text-to-image (T2I) models, we propose a more comprehensive evaluation that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Shang Hong Sim , Clarence Lee , Alvin Tan , Cheston Tan

Text-to-image (T2I) generative models are largely used in AI-powered real-world applications and value creation. However, their strategic deployment raises critical concerns for responsible AI management, particularly regarding the…

Machine Learning · Computer Science 2025-11-18 Abu Sufian , Cosimo Distante , Marco Leo , Hanan Salam

Text-to-image (T2I) models have achieved remarkable success in generating high-fidelity images, but they often fail in handling complex spatial relationships, e.g., spatial perception, reasoning, or interaction. These critical aspects are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zengbin Wang , Xuecai Hu , Yong Wang , Feng Xiong , Man Zhang , Xiangxiang Chu

The progress in the generation of synthetic images has made it crucial to assess their quality. While several metrics have been proposed to assess the rendering of images, it is crucial for Text-to-Image (T2I) models, which generate images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Paul Grimal , Hervé Le Borgne , Olivier Ferret , Julien Tourille

Text-to-image generative models often reflect the biases of the training data, leading to unequal representations of underrepresented groups. This study investigates inclusive text-to-image generative models that generate images based on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Cheng Zhang , Xuanbai Chen , Siqi Chai , Chen Henry Wu , Dmitry Lagun , Thabo Beeler , Fernando De la Torre

Recent advances in generative AI have enabled visual content creation through text-to-image (T2I) generation. However, despite their creative potential, T2I models often replicate and amplify societal stereotypes -- particularly those…

Human-Computer Interaction · Computer Science 2025-05-28 Saharsh Barve , Andy Mao , Jiayue Melissa Shi , Prerna Juneja , Koustuv Saha

Text-to-Image generation has evolved from basic image synthesis into a frequently used core capability in professional creative workflows, where simple text-image alignment can no longer satisfy users' pressing demands for faithful…

This paper presents a community-centered study of cultural limitations of text-to-image (T2I) models in the South Asian context. We theorize these failures using scholarship on dominant media regimes of representations and locate them…

Computers and Society · Computer Science 2024-03-14 Rida Qadri , Renee Shelby , Cynthia L. Bennett , Remi Denton

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Huanlei Guo , Hongxin Wei , Bingyi Jing

Text-guided image editing involves modifying a source image based on a language instruction and, typically, requires changes to only small local regions. However, existing approaches generate the entire target image rather than selectively…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Huimin Wu , Xiaojian Ma , Haozhe Zhao , Yanpeng Zhao , Qing Li

Despite remarkable progress in Text-to-Image models, many real-world applications require generating coherent image sets with diverse consistency requirements. Existing consistent methods often focus on a specific domain with specific…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Chengyou Jia , Xin Shen , Zhuohang Dang , Zhuohang Dang , Changliang Xia , Weijia Wu , Xinyu Zhang , Hangwei Qian , Ivor W. Tsang , Minnan Luo

Text-to-image synthesis has achieved high-quality results with recent advances in diffusion models. However, text input alone has high spatial ambiguity and limited user controllability. Most existing methods allow spatial control through…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuki Endo

We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understanding. Imagen builds on the power of large transformer language models in understanding text and hinges on…

Compositionality is a critical capability in Text-to-Image (T2I) models, as it reflects their ability to understand and combine multiple concepts from text descriptions. Existing evaluations of compositional capability rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xindi Wu , Dingli Yu , Yangsibo Huang , Olga Russakovsky , Sanjeev Arora

Text-to-Image (TTI) generative models have shown great progress in the past few years in terms of their ability to generate complex and high-quality imagery. At the same time, these models have been shown to suffer from harmful biases,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Aditya Chinchure , Pushkar Shukla , Gaurav Bhatt , Kiri Salij , Kartik Hosanagar , Leonid Sigal , Matthew Turk

Large-scale text-to-image diffusion models have been a revolutionary milestone in the evolution of generative AI and multimodal technology, allowing wonderful image generation with natural-language text prompt. However, the issue of lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xiang Gao , Jiaying Liu

Unified generative models have shown remarkable performance in text and image generation. For image synthesis tasks, they adopt straightforward text-to-image (T2I) generation. However, direct T2I generation limits the models in handling…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yi Wang , Mushui Liu , Wanggui He , Hanyang Yuan , Longxiang Zhang , Ziwei Huang , Guanghao Zhang , Wenkai Fang , Haoze Jiang , Shengxuming Zhang , Dong She , Jinlong Liu , Weilong Dai , Mingli Song , Hao Jiang , Jie Song

Text-to-image (T2I) models often suffer from text-image misalignment in complex scenes involving multiple objects and attributes. Semantic binding has attempted to associate the generated attributes and objects with their corresponding noun…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hoigi Seo , Junseo Bang , Haechang Lee , Joohoon Lee , Byung Hyun Lee , Se Young Chun