English
Related papers

Related papers: IW-Bench: Evaluating Large Multimodal Models for C…

200 papers

Although recent large multimodal models (LMMs) demonstrate impressive progress on vision language tasks, their alignment with human centered (HC) principles, such as fairness, ethics, inclusivity, empathy, and robustness; remains poorly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Shaina Raza , Aravind Narayanan , Vahid Reza Khazaie , Ashmal Vayani , Ahmed Y. Radwan , Mukund S. Chettiar , Amandeep Singh , Mubarak Shah , Deval Pandya

Image-text retrieval, as a fundamental and important branch of information retrieval, has attracted extensive research attentions. The main challenge of this task is cross-modal semantic understanding and matching. Some recent works focus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Weijing Chen , Linli Yao , Qin Jin

Significant progress has been made in the field of Instruction-based Image Editing (IIE). However, evaluating these models poses a significant challenge. A crucial requirement in this field is the establishment of a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Yiwei Ma , Jiayi Ji , Ke Ye , Weihuang Lin , Zhibin Wang , Yonghan Zheng , Qiang Zhou , Xiaoshuai Sun , Rongrong Ji

End-to-end In-Image Machine Translation (IIMT) aims to convert text embedded within an image into a target language while preserving the original visual context, layout, and rendering style. However, existing IIMT benchmarks are largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiahao Lyu , Pei Fu , Zhenhang Li , Weichao Zeng , Shaojie Zhang , Jiahui Yang , Can Ma , Yu Zhou , Zhenbo Luo , Jian Luan

Understanding documents with rich layouts and multi-modal components is a long-standing and practical task. Recent Large Vision-Language Models (LVLMs) have made remarkable strides in various tasks, particularly in single-page document…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yubo Ma , Yuhang Zang , Liangyu Chen , Meiqi Chen , Yizhu Jiao , Xinze Li , Xinyuan Lu , Ziyu Liu , Yan Ma , Xiaoyi Dong , Pan Zhang , Liangming Pan , Yu-Gang Jiang , Jiaqi Wang , Yixin Cao , Aixin Sun

The growing prevalence of visually rich documents, such as webpages and scanned/digital-born documents (images, PDFs, etc.), has led to increased interest in automatic document understanding and information extraction across academia and…

Computation and Language · Computer Science 2024-02-29 Hongshen Xu , Lu Chen , Zihan Zhao , Da Ma , Ruisheng Cao , Zichen Zhu , Kai Yu

Large multimodal models (LMMs) have demonstrated impressive capabilities in understanding various types of image, including text-rich images. Most existing text-rich image benchmarks are simple extraction-based question answering, and many…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jian Chen , Ruiyi Zhang , Yufan Zhou , Ryan Rossi , Jiuxiang Gu , Changyou Chen

Identifying high-quality webpages is fundamental for real-world search engines, which can fulfil users' information need with the less cognitive burden. Early studies of \emph{webpage quality assessment} usually design hand-crafted features…

Information Retrieval · Computer Science 2023-02-07 Anfeng Cheng , Yiding Liu , Weibin Li , Qian Dong , Shuaiqiang Wang , Zhengjie Huang , Shikun Feng , Zhicong Cheng , Dawei Yin

Recent multimodal image generators such as GPT-4o, Gemini 2.0 Flash, and Gemini 2.5 Pro excel at following complex instructions, editing images and maintaining concept consistency. However, they are still evaluated by disjoint toolkits:…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Hang Hua , Ziyun Zeng , Yizhi Song , Yunlong Tang , Liu He , Daniel Aliaga , Wei Xiong , Jiebo Luo

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

The popularity of multimodal large language models (MLLMs) has triggered a recent surge in research efforts dedicated to evaluating these models. Nevertheless, existing evaluation studies of MLLMs primarily focus on the comprehension and…

Computation and Language · Computer Science 2023-10-16 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

Multi-page websites dominate modern web development. However, existing design-to-code methods rely on simplified assumptions, limiting to single-page, self-contained webpages without external resource connection. To address this gap, we…

Software Engineering · Computer Science 2024-12-23 Yuxuan Wan , Yi Dong , Jingyu Xiao , Yintong Huo , Wenxuan Wang , Michael R. Lyu

In most real-world image-to-image (I2I) scenarios, existing evaluations primarily focus on instruction following and the perceptual quality or aesthetics of the generated images. However, they largely fail to assess whether the output image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiayang Li , Shuo Cao , Xiaohui Li , Zhizhen Zhang , Kaiwen Zhu , Yule Duan , Yu Qiao , Jian Zhang , Yihao Liu

Large Multimodal Models (LMMs) are increasingly applied to scientific research, yet it remains unclear whether they can reliably understand and reason over the multimodal complexity of papers. A central challenge lies in detecting and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lukas Selch , Yufang Hou , M. Jehanzeb Mirza , Sivan Doveh , James Glass , Rogerio Feris , Wei Lin

Multimodal Large Language Models (MLLMs) increasingly support dynamic image resolutions. However, current evaluation paradigms primarily assess semantic performance, overlooking the critical question of resolution robustness - whether…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Chenxu Li , Zhicai Wang , Yuan Sheng , Xingyu Zhu , Yanbin Hao , Xiang Wang

Automated building facade inspection is a critical component of urban resilience and smart city maintenance. Traditionally, this field has relied on specialized discriminative models (e.g., YOLO, Mask R-CNN) that excel at pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Hui Zhong , Yichun Gao , Luyan Liu , Hai Yang , Wang Wang , Haowei Zhang , Xinhu Zheng

We present Omni-I2C, a comprehensive benchmark designed to evaluate the capability of Large Multimodal Models (LMMs) in converting complex, structured digital graphics into executable code. We argue that this task represents a non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiawei Zhou , Chi Zhang , Xiang Feng , Qiming Zhang , Haibo Qiu , Lihuo He , Dengpan Ye , Xinbo Gao , Jing Zhang

Over the past decade, U-Net has been the dominant architecture in medical image segmentation, leading to the development of thousands of U-shaped variants. Despite its widespread adoption, there is still no comprehensive benchmark to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Fenghe Tang , Chengqi Dong , Wenxin Ma , Zikang Xu , Heqin Zhu , Zihang Jiang , Rongsheng Wang , Yuhao Wang , Chenxu Wu , Shaohua Kevin Zhou

The outstanding performance of Large Multimodal Models (LMMs) has made them widely applied in vision-related tasks. However, various corruptions in the real world mean that images will not be as ideal as in simulations, presenting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Chunyi Li , Jianbo Zhang , Zicheng Zhang , Haoning Wu , Yuan Tian , Wei Sun , Guo Lu , Xiaohong Liu , Xiongkuo Min , Weisi Lin , Guangtao Zhai

Image Difference Captioning (IDC) generates natural language descriptions that precisely identify differences between two images, serving as a key benchmark for fine-grained change perception, cross-modal reasoning, and image editing data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yuancheng Wei , Haojie Zhang , Linli Yao , Lei Li , Jiali Chen , Tao Huang , Yiting Lu , Duojun Huang , Xin Li , Zhao Zhong