English
Related papers

Related papers: Holistic Evaluation for Interleaved Text-and-Image…

200 papers

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

Existing vision-language understanding benchmarks largely consist of images of objects in their usual contexts. As a consequence, recent multimodal large language models can perform well with only a shallow visual understanding by relying…

Beyond conventional paradigms of translating speech and text, recently, there has been interest in automated transcreation of images to facilitate localization of visual content across different cultures. Attempts to define this as a formal…

Computation and Language · Computer Science 2025-03-24 Simran Khanuja , Vivek Iyer , Claire He , Graham Neubig

The vision and language generative models have been overgrown in recent years. For video generation, various open-sourced models and public-available services have been developed to generate high-quality videos. However, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yaofang Liu , Xiaodong Cun , Xuebo Liu , Xintao Wang , Yong Zhang , Haoxin Chen , Yang Liu , Tieyong Zeng , Raymond Chan , Ying Shan

Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input or treated as an answer endpoint rather than part of an interleaved search trajectory. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bohan Hou , Jiuning Gu , Jiayan Guo , Ronghao Dang , Sicong Leng , Xin Li , Xuemeng Song , Jianfei Yang

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

In recent years, image editing models have made significant progress, enabling users to manipulate visual content in a flexible and interactive manner through natural language instructions. However, an important yet underexplored research…

Conventional, classification-based AI-generated image detection methods cannot explain why an image is considered real or AI-generated in a way a human expert would, which reduces the trustworthiness and persuasiveness of these detection…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Michael Yang , Shijian Deng , William T. Doan , Kai Wang , Tianyu Yang , Harsh Singh , Yapeng Tian

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

Evaluating image editing models remains challenging due to the coarse granularity and limited interpretability of traditional metrics, which often fail to capture aspects important to human perception and intent. Such metrics frequently…

The evaluation of generative models for natural image tasks has been extensively studied. Similar protocols and metrics are used in cases with unique particularities, such as Handwriting Generation, even if they might not be completely…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Konstantina Nikolaidou , George Retsinas , Giorgos Sfikas , Marcus Liwicki

We propose LLM-Interleaved (LLM-I), a flexible and dynamic framework that reframes interleaved image-text generation as a tool-use problem. LLM-I is designed to overcome the "one-tool" bottleneck of current unified models, which are limited…

Machine Learning · Computer Science 2025-09-18 Zirun Guo , Feng Zhang , Kai Jia , Tao Jin

Text-to-video generative models have made significant strides in recent years, producing high-quality videos that excel in both aesthetic appeal and accurate instruction following, and have become central to digital art creation and user…

Machine Learning · Computer Science 2025-05-02 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

How humans can effectively and efficiently acquire images has always been a perennial question. A classic solution is text-to-image retrieval from an existing database; however, the limited database typically lacks creativity. By contrast,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Leigang Qu , Haochuan Li , Tan Wang , Wenjie Wang , Yongqi Li , Liqiang Nie , Tat-Seng Chua

Text-to-3D generation has achieved remarkable progress in recent years, yet evaluating these methods remains challenging for two reasons: i) Existing benchmarks lack fine-grained evaluation on different prompt categories and evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yujie Zhang , Bingyang Cui , Qi Yang , Zhu Li , Yiling Xu

The emergence of unified multimodal understanding and generation models is rapidly attracting attention because of their ability to enhance instruction-following capabilities while minimizing model redundancy. However, there is a lack of a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yi Li , Haonan Wang , Qixiang Zhang , Boyu Xiao , Chenchang Hu , Hualiang Wang , Xiaomeng Li

Despite remarkable progress in Text-to-Image models, many real-world applications require generating coherent image sets with diverse consistency requirements. Existing consistent methods often focus on a specific domain with specific…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Chengyou Jia , Xin Shen , Zhuohang Dang , Zhuohang Dang , Changliang Xia , Weijia Wu , Xinyu Zhang , Hangwei Qian , Ivor W. Tsang , Minnan Luo

Recent advances in text-to-image generation have improved the quality of synthesized images, but evaluations mainly focus on aesthetics or alignment with text prompts. Thus, it remains unclear whether these models can accurately represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hsin-Ping Huang , Xinyi Wang , Yonatan Bitton , Hagai Taitelbaum , Gaurav Singh Tomar , Ming-Wei Chang , Xuhui Jia , Kelvin C. K. Chan , Hexiang Hu , Yu-Chuan Su , Ming-Hsuan Yang

The landscape of image generation has rapidly evolved, from early GAN-based approaches to diffusion models and, most recently, to unified generative architectures that seek to bridge understanding and generation tasks. Recent advances,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Sixiang Chen , Jinbin Bai , Zhuoran Zhao , Tian Ye , Qingyu Shi , Donghao Zhou , Wenhao Chai , Xin Lin , Jianzong Wu , Chao Tang , Shilin Xu , Tao Zhang , Haobo Yuan , Yikang Zhou , Wei Chow , Linfeng Li , Xiangtai Li , Lei Zhu , Lu Qi

Benchmarks are the de facto standard for tracking progress in large language models (LLMs), yet static test sets can rapidly saturate, become vulnerable to contamination, and are costly to refresh. Scalable evaluation of open-ended items…

Computation and Language · Computer Science 2026-03-24 Yandan Zheng , Haoran Luo , Zhenghong Lin , Wenjin Liu , Luu Anh Tuan