English
Related papers

Related papers: GenEval 2: Addressing Benchmark Drift in Text-to-I…

200 papers

In recent years, there has been significant progress in the development of text-to-image generative models. Evaluating the quality of the generative models is one essential step in the development process. Unfortunately, the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Lin Zhao , Tianchen Zhao , Zinan Lin , Xuefei Ning , Guohao Dai , Huazhong Yang , Yu Wang

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian

Text-to-image (T2I) synthesis has recently achieved significant advancements. However, challenges remain in the model's compositionality, which is the ability to create new combinations from known components. We introduce Winoground-T2I, a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xiangru Zhu , Penglei Sun , Chengyu Wang , Jingping Liu , Zhixu Li , Yanghua Xiao , Jun Huang

Comprehensive and constructive evaluation protocols play an important role in the development of sophisticated text-to-video (T2V) generation models. Existing evaluation protocols primarily focus on temporal consistency and content…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Mingxiang Liao , Hannan Lu , Xinyu Zhang , Fang Wan , Tianyu Wang , Yuzhong Zhao , Wangmeng Zuo , Qixiang Ye , Jingdong Wang

Text-to-Image (T2I) models have made significant advancements in recent years, but they still struggle to accurately capture intricate details specified in complex compositional prompts. While fine-tuning T2I models with reward objectives…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Luca Eyring , Shyamgopal Karthik , Karsten Roth , Alexey Dosovitskiy , Zeynep Akata

The rapid advancement of General Purpose AI (GPAI) models necessitates robust evaluation frameworks, especially with emerging regulations like the EU AI Act and its associated Code of Practice (CoP). Current AI evaluation practices depend…

Artificial Intelligence · Computer Science 2025-08-11 Matteo Prandi , Vincenzo Suriani , Federico Pierucci , Marcello Galisai , Daniele Nardi , Piercosma Bisconti

Existing text-to-image (T2I) diffusion models usually struggle in interpreting complex prompts, especially those with quantity, object-attribute binding, and multi-subject descriptions. In this work, we introduce a semantic panel as the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yutong Feng , Biao Gong , Di Chen , Yujun Shen , Yu Liu , Jingren Zhou

Recent text-to-image (T2I) models have demonstrated impressive capabilities in photorealistic synthesis and instruction following. However, their reliability in knowledge-intensive settings remains largely unexplored. Unlike natural image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Ran Zhao , Sheng Jin , Size Wu , Kang Liao , Zerui Gong , Zujin Guo , Yang Xiao , Wei Li

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bowen Qu , Shangkun Sun , Xiaoyu Liang , Wei Gao

Text-to-video (T2V) generation technology holds potential to transform multiple domains such as education, marketing, entertainment, and assistive technologies for individuals with visual or reading comprehension challenges, by creating…

Graphics · Computer Science 2025-10-07 Nilay Kumar , Priyansh Bhandari , G. Maragatham

Scaling up autoregressive models in vision has not proven as beneficial as in large language models. In this work, we investigate this scaling problem in the context of text-to-image generation, focusing on two critical factors: whether…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Lijie Fan , Tianhong Li , Siyang Qin , Yuanzhen Li , Chen Sun , Michael Rubinstein , Deqing Sun , Kaiming He , Yonglong Tian

Evaluating the general abilities of foundation models to tackle human-level tasks is a vital aspect of their development and application in the pursuit of Artificial General Intelligence (AGI). Traditional benchmarks, which rely on…

Computation and Language · Computer Science 2023-09-19 Wanjun Zhong , Ruixiang Cui , Yiduo Guo , Yaobo Liang , Shuai Lu , Yanlin Wang , Amin Saied , Weizhu Chen , Nan Duan

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nonghai Zhang , Hao Tang

Text-to-Image (T2I) models have made significant strides in visual realism and semantic consistency, yet they often perpetuate and amplify societal biases. Existing evaluation methods typically address only single-dimensional biases,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruyi Chen , Lu Zhou , Xiaogang Xu , Chiyu Zhang , Jiafei Wu , Liming Fang

Text-to-Image (T2I) models have demonstrated impressive capabilities in generating high-quality and diverse visual content from natural language prompts. However, uncontrolled reproduction of sensitive, copyrighted, or harmful imagery poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yiwei Xie , Ping Liu , Zheng Zhang

Generating images with embedded text is crucial for the automatic production of visual and multimodal documents, such as educational materials and advertisements. However, existing diffusion-based text-to-image models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Forouzan Fallah , Maitreya Patel , Agneet Chatterjee , Vlad I. Morariu , Chitta Baral , Yezhou Yang

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

Recently, large vision-language models (LVLMs) have emerged as the preferred tools for judging text-image alignment, yet their robustness along the visual modality remains underexplored. This work is the first study to address a key…

Computation and Language · Computer Science 2025-11-18 Yerin Hwang , Dongryeol Lee , Kyungmin Min , Taegwan Kang , Yong-il Kim , Kyomin Jung

With the rapid advancement of large multimodal models (LMMs), recent text-to-image (T2I) models can generate high-quality images and demonstrate great alignment to short prompts. However, they still struggle to effectively understand and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Juntong Wang , Huiyu Duan , Jiarui Wang , Ziheng Jia , Guangtao Zhai , Xiongkuo Min

Recent developments in text-conditioned image generative models have revolutionized the production of realistic results. Unfortunately, this has also led to an increase in privacy violations and the spread of false information, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 An-An Liu , Guokai Zhang , Yuting Su , Ning Xu , Yongdong Zhang , Lanjun Wang