English
Related papers

Related papers: Everything in Its Place: Benchmarking Spatial Inte…

200 papers

Text-to-image (T2I) diffusion models generate high-quality images but often fail to capture the spatial relations specified in text prompts. This limitation can be traced to two factors: lack of fine-grained spatial supervision in training…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Sarah Rastegar , Violeta Chatalbasheva , Sieger Falkena , Anuj Singh , Yanbo Wang , Tejas Gokhale , Hamid Palangi , Hadi Jamali-Rad

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sashuai Zhou , Qiang Zhou , Junpeng Ma , Yue Cao , Ruofan Hu , Ziang Zhang , Xiaoda Yang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Zhou Zhao

User prompts for generative AI models are often underspecified, leading to a misalignment between the user intent and models' understanding. As a result, users commonly have to painstakingly refine their prompts. We study this alignment…

Artificial Intelligence · Computer Science 2025-10-27 Meera Hahn , Wenjun Zeng , Nithish Kannen , Rich Galt , Kartikeya Badola , Been Kim , Zi Wang

Text-to-image (T2I) generation has advanced rapidly, yet faithfully capturing spatial relationships described in natural language prompts remains a major challenge. Prior efforts have addressed this issue through prompt optimization,…

Artificial Intelligence · Computer Science 2025-09-22 Sander Schildermans , Chang Tian , Ying Jiao , Marie-Francine Moens

Text-to-image (T2I) generative models are largely used in AI-powered real-world applications and value creation. However, their strategic deployment raises critical concerns for responsible AI management, particularly regarding the…

Machine Learning · Computer Science 2025-11-18 Abu Sufian , Cosimo Distante , Marco Leo , Hanan Salam

Text-to-Image (T2I) synthesis has made significant advancements in recent years, driving applications such as generating datasets automatically. However, precise control over object localization in generated images remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Biao Liu , Yuanzhi Liang

Recent advancements in text-to-image (T2I) diffusion models have demonstrated remarkable capabilities in generating high-fidelity images. However, these models often struggle to faithfully render complex user prompts, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Linqing Wang , Ximing Xing , Yiji Cheng , Zhiyuan Zhao , Donghao Li , Tiankai Hang , Jiale Tao , Qixun Wang , Ruihuang Li , Comi Chen , Xin Li , Mingrui Wu , Xinchi Deng , Shuyang Gu , Chunyu Wang , Qinglin Lu

Layout-guided text-to-image models offer greater control over the generation process by explicitly conditioning image synthesis on the spatial arrangement of elements. As a result, their adoption has increased in many computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Elena Izzo , Luca Parolari , Davide Vezzaro , Lamberto Ballan

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Mingrui Wu , Lu Wang , Pu Zhao , Fangkai Yang , Jianjin Zhang , Jianfeng Liu , Yuefeng Zhan , Weihao Han , Hao Sun , Jiayi Ji , Xiaoshuai Sun , Qingwei Lin , Weiwei Deng , Dongmei Zhang , Feng Sun , Qi Zhang , Rongrong Ji

Current text-to-image (T2I) generation models achieve promising results, but they fail on the scenarios where the knowledge implied in the text prompt is uncertain. For example, a T2I model released in February would struggle to generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Chuanhao Li , Jianwen Sun , Yukang Feng , Mingliang Zhai , Yifan Chang , Kaipeng Zhang

Recent text-to-image (T2I) models have had great success, and many benchmarks have been proposed to evaluate their performance and safety. However, they only consider explicit prompts while neglecting implicit prompts (hint at a target…

Computers and Society · Computer Science 2024-05-29 Yue Yang , Yuqi Lin , Hong Liu , Wenqi Shao , Runjian Chen , Hailong Shang , Yu Wang , Yu Qiao , Kaipeng Zhang , Ping Luo

State-of-the-art T2I models are capable of generating high-resolution images given textual prompts. However, they still struggle with accurately depicting compositional scenes that specify multiple objects, attributes, and spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yixin Wan , Kai-Wei Chang

The progress in the generation of synthetic images has made it crucial to assess their quality. While several metrics have been proposed to assess the rendering of images, it is crucial for Text-to-Image (T2I) models, which generate images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Paul Grimal , Hervé Le Borgne , Olivier Ferret , Julien Tourille

Text-to-Image (T2I) generation is enabling new applications that support creators, designers, and general end users of productivity software by generating illustrative content with high photorealism starting from a given descriptive text as…

Computers and Society · Computer Science 2023-04-14 Ranjita Naik , Besmira Nushi

High-quality and open datasets remain a major bottleneck for text-to-image (T2I) fine-tuning. Despite rapid progress in model architectures and training pipelines, most publicly available fine-tuning datasets suffer from low resolution,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Xu Ma , Yitian Zhang , Qihua Dong , Yun Fu

Text-to-image (T2I) generation has made remarkable progress in producing high-quality images, but a fundamental challenge remains: creating backgrounds that naturally accommodate text placement without compromising image quality. This…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Tianyi Liang , Jiangqi Liu , Yifei Huang , Shiqi Jiang , Jianshen Shi , Changbo Wang , Chenhui Li

Despite remarkable progress in Text-to-Image models, many real-world applications require generating coherent image sets with diverse consistency requirements. Existing consistent methods often focus on a specific domain with specific…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Chengyou Jia , Xin Shen , Zhuohang Dang , Zhuohang Dang , Changliang Xia , Weijia Wu , Xinyu Zhang , Hangwei Qian , Ivor W. Tsang , Minnan Luo

Text-to-image (T2I) models are capable of generating visually impressive images, yet they often fail to accurately capture specific attributes in user prompts, such as the correct number of objects with the specified colors. The diversity…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kevin David Hayes , Micah Goldblum , Vikash Sehwag , Gowthami Somepalli , Ashwinee Panda , Tom Goldstein

Spatial intelligence is crucial for vision--language models (VLMs) in the physical world, yet many benchmarks evaluate largely unconstrained scenes where models can exploit 2D shortcuts. We introduce SSI-Bench, a VQA benchmark for spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Chen Yang , Guanxin Lin , Youquan He , Peiyao Chen , Guanghe Liu , Yufan Mo , Zhouyuan Xu , Linhao Wang , Guohui Zhang , Zihang Zhang , Shenxiang Zeng , Chen Wang , Jiansheng Fan