English
Related papers

Related papers: MMTIT-Bench: A Multilingual and Multi-Scenario Ben…

200 papers

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Recent advances in Video Large Language Models (Video-LLMs) have demonstrated their great potential in general-purpose video understanding. To verify the significance of these models, a number of benchmarks have been proposed to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ye Liu , Zongyang Ma , Zhongang Qi , Yang Wu , Ying Shan , Chang Wen Chen

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled complex reasoning. However, existing remote sensing (RS) benchmarks remain heavily biased toward perception tasks, such as object recognition and scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhiming Luo , Di Wang , Haonan Guo , Jing Zhang , Bo Du

The rapid advancement of large vision-language models (LVLMs) has significantly propelled applications in document understanding, particularly in optical character recognition (OCR) and multilingual translation. However, current evaluations…

Machine Learning · Computer Science 2025-05-20 Zhanglin Wu , Tengfei Song , Ning Xie , Mengli Zhu , Weidong Zhang , Shuang Wu , Pengfei Li , Chong Li , Junhao Zhu , Hao Yang , Shiliang Sun

Existing medical reasoning benchmarks for vision-language models primarily focus on analyzing a patient's condition based on an image from a single visit. However, this setting deviates significantly from real-world clinical practice, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Junyi Zhang , Jia-Chen Gu , Wenbo Hu , Yu Zhou , Robinson Piramuthu , Nanyun Peng

The frontier of visual reasoning is shifting toward models like OpenAI o3, which can intelligently create and operate tools to transform images for problem-solving, also known as thinking-\textit{with}-images in chain-of-thought. Yet…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ming Li , Jike Zhong , Shitian Zhao , Haoquan Zhang , Shaoheng Lin , Yuxiang Lai , Chen Wei , Konstantinos Psounis , Kaipeng Zhang

The rapid extension of context windows in large vision-language models has given rise to long-context vision-language models (LCVLMs), which are capable of handling hundreds of images with interleaved text tokens in a single forward pass.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zhaowei Wang , Wenhao Yu , Xiyu Ren , Jipeng Zhang , Yu Zhao , Rohit Saxena , Liang Cheng , Ginny Wong , Simon See , Pasquale Minervini , Yangqiu Song , Mark Steedman

With the continuous advancement of large language models (LLMs), it is essential to create new benchmarks to effectively evaluate their expanding capabilities and identify areas for improvement. This work focuses on multi-image reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mehran Kazemi , Nishanth Dikkala , Ankit Anand , Petar Devic , Ishita Dasgupta , Fangyu Liu , Bahare Fatemi , Pranjal Awasthi , Dee Guo , Sreenivas Gollapudi , Ahmed Qureshi

Vision-Language Models (VLMs) have revolutionized artificial intelligence and robotics due to their commonsense reasoning capabilities. In robotic manipulation, VLMs are used primarily as high-level planners, but recent work has also…

Spatial reasoning from monocular images is essential for autonomous driving, yet current Vision-Language Models (VLMs) still struggle with fine-grained geometric perception, particularly under large scale variation and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanchun Cheng , Rundong Wang , Xulei Yang , Alok Prakash , Daniela Rus , Marcelo H Ang , ShiJie Li

Recent advances in vision-language models (VLMs) have achieved remarkable performance on standard medical benchmarks, yet their true clinical reasoning ability remains unclear. Existing datasets predominantly emphasize classification…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Miao Jing , Mengting Jia , Junling Lin , Zhongxia Shen , Huan Gao , Mingkun Xu , Shangyang Li

Process-supervised reward models serve as a fine-grained function that provides detailed step-wise feedback to model responses, facilitating effective selection of reasoning trajectories for complex tasks. Despite its advantages, evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Haoqin Tu , Weitao Feng , Hardy Chen , Hui Liu , Xianfeng Tang , Cihang Xie

Large vision-language models (LVLMs) have significantly improved multimodal reasoning tasks, such as visual question answering and image captioning. These models embed multimodal facts within their parameters, rather than relying on…

Computation and Language · Computer Science 2025-02-18 Shengkang Wang , Hongzhan Lin , Ziyang Luo , Zhen Ye , Guang Chen , Jing Ma

Recent advancements in Large Vision-Language Models (VLMs), have greatly enhanced their capability to jointly process text and images. However, despite extensive benchmarks evaluating visual comprehension (e.g., diagrams, color schemes, OCR…

Computation and Language · Computer Science 2025-05-27 Benjamin Clavié , Florian Brand

Scoring the Optical Character Recognition (OCR) capabilities of Large Multimodal Models (LMMs) has witnessed growing interest. Existing benchmarks have highlighted the impressive performance of LMMs in text recognition; however, their…

Recent advances in multimodal large language models (MLLMs) have demonstrated substantial potential in video understanding. However, existing benchmarks fail to comprehensively evaluate synergistic reasoning capabilities across audio and…

Multimodal large language models (MLLMs) have demonstrated promising results in a variety of tasks that combine vision and language. As these models become more integral to research and applications, conducting comprehensive evaluations of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Fuwen Luo , Chi Chen , Zihao Wan , Zhaolu Kang , Qidong Yan , Yingjie Li , Xiaolong Wang , Siyu Wang , Ziyue Wang , Xiaoyue Mi , Peng Li , Ning Ma , Maosong Sun , Yang Liu

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

Large Language Models (LLMs) have demonstrated effectiveness not only in language tasks but also in video reasoning. This paper introduces a novel dataset, Tropes in Movies (TiM), designed as a testbed for exploring two critical yet…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Hung-Ting Su , Chun-Tong Chao , Ya-Ching Hsu , Xudong Lin , Yulei Niu , Hung-Yi Lee , Winston H. Hsu