English
Related papers

Related papers: OddGridBench: Exposing the Lack of Fine-Grained Vi…

200 papers

Large Vision-Language Models (LVLMs) struggle with puzzles, which require precise perception, rule comprehension, and logical reasoning. Assessing and enhancing their performance in this domain is crucial, as it reflects their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yufan Ren , Konstantinos Tertikas , Shalini Maiti , Junlin Han , Tong Zhang , Sabine Süsstrunk , Filippos Kokkinos

Large vision-language models (VLMs) have recently achieved remarkable progress, exhibiting impressive multimodal perception and reasoning abilities. However, effectively evaluating these large VLMs remains a major challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Yuan Liu , Haodong Duan , Yuanhan Zhang , Bo Li , Songyang Zhang , Wangbo Zhao , Yike Yuan , Jiaqi Wang , Conghui He , Ziwei Liu , Kai Chen , Dahua Lin

Multimodal Large Language Models (MLLMs) have shown significant potential in medical image analysis. However, their capabilities in interpreting fundus images, a critical skill for ophthalmology, remain under-evaluated. Existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Qijie Wei , Kaiheng Qian , Xirong Li

In recent years, vision language models (VLMs) have made significant advancements in video understanding. However, a crucial capability - fine-grained motion comprehension - remains under-explored in current benchmarks. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wenyi Hong , Yean Cheng , Zhuoyi Yang , Weihan Wang , Lefan Wang , Xiaotao Gu , Shiyu Huang , Yuxiao Dong , Jie Tang

Multimodal large language models (MLLMs) have made significant progress in integrating visual and linguistic understanding. Existing benchmarks typically focus on high-level semantic capabilities, such as scene understanding and visual…

Computation and Language · Computer Science 2025-02-18 Shangyu Xing , Changhao Xiang , Yuteng Han , Yifan Yue , Zhen Wu , Xinyu Liu , Zhangtai Wu , Fei Zhao , Xinyu Dai

Multimodal Large Language Models (MLLMs) have achieved remarkable success in vision-language tasks but their remote sensing (RS) counterpart are relatively under explored. Unlike natural images, RS imagery presents unique challenges that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Abduljaleel Adejumo , Faegheh Yeganli , Clifford Broni-bediako , Aoran Xiao , Naoto Yokoya , Mennatullah Siam

Multimodal Large Language Models (MLLMs) combine the linguistic strengths of LLMs with the ability to process multimodal data, enbaling them to address a broader range of visual tasks. Because MLLMs aim at more general, human-like…

Computation and Language · Computer Science 2026-04-02 Hengwei Ye , Yuanting Guan , Yuxuan Ge , Tianying Zhu , Zhenhan Guan , Yijia Zhong , Yijing Zhang , Han Zhang , Yingna Wu , Zheng Tian

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ekta Gavas , Sudipta Banerjee , Chinmay Hegde , Nasir Memon

Multi-modal large language models (MLLMs) have achieved remarkable performance on objective multimodal perception tasks, but their ability to interpret subjective, emotionally nuanced multimodal content remains largely unexplored. Thus, it…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Qu Yang , Mang Ye , Bo Du

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Recent strides in multimodal large language models (MLLMs) have significantly advanced their performance in many reasoning tasks. However, Abstract Visual Reasoning (AVR) remains a critical challenge, primarily due to limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hao Yan , Xingchen Liu , Hao Wang , Zhenbiao Cao , Handong Zheng , Liang Yin , Xinxing Su , Zihao Chen , Jihao Wu , Minghui Liao , Chao Weng , Wei Chen , Yuliang Liu , Xiang Bai

Large models have recently played a dominant role in natural language processing and multimodal vision-language learning. However, their effectiveness in text-related visual tasks remains relatively unexplored. In this paper, we conducted a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuliang Liu , Zhang Li , Mingxin Huang , Biao Yang , Wenwen Yu , Chunyuan Li , Xucheng Yin , Cheng-lin Liu , Lianwen Jin , Xiang Bai

Vision-Language Models (VLMs), exemplified by CLIP, have emerged as foundational for multimodal intelligence. However, their capacity for logical understanding remains significantly underexplored, resulting in critical ''logical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yuchen Zhou , Jiayu Tang , Shuo Yang , Xiaoyan Xiao , Yuqin Dai , Wenhao Yang , Chao Gou , Xiaobo Xia , Tat-Seng Chua

Recent Multimodal Large Language Models (MLLMs) demonstrate strong high-level visual reasoning on tasks such as visual question answering and image captioning. Yet existing benchmarks largely overlook their ability to capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Rynaa Grover , Jayant Sravan Tamarapalli , Sahiti Yerramilli , Nilay Pande

Evaluating the alignment capabilities of large Vision-Language Models (VLMs) is essential for determining their effectiveness as helpful assistants. However, existing benchmarks primarily focus on basic abilities using nonverbal methods,…

Computation and Language · Computer Science 2025-06-05 Yuhang Wu , Wenmeng Yu , Yean Cheng , Yan Wang , Xiaohan Zhang , Jiazheng Xu , Ming Ding , Yuxiao Dong

Existing multimodal retrieval benchmarks primarily focus on evaluating whether models can retrieve and utilize external textual knowledge for question answering. However, there are scenarios where retrieving visual information is either…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Wenbo Hu , Jia-Chen Gu , Zi-Yi Dou , Mohsen Fayyaz , Pan Lu , Kai-Wei Chang , Nanyun Peng

Large Multimodal Models (LMMs) have demonstrated impressive capabilities across a wide range of multimodal tasks, achieving ever-increasing performance on various evaluation benchmarks. However, existing benchmarks are typically static and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Zeyu Zhang , Zijian Chen , Zicheng Zhang , Yuze Sun , Yuan Tian , Ziheng Jia , Chunyi Li , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

Vision-language models (VLMs) have demonstrated impressive generalization across multimodal tasks, yet most evaluation benchmarks remain Western-centric, leaving open questions about their performance in culturally diverse and multilingual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Ali Faraz , Akash , Shaharukh Khan , Raja Kolla , Akshat Patidar , Suranjan Goswami , Abhinav Ravi , Chandra Khatri , Shubham Agarwal

While Multimodal Large Language Models (MLLMs) excel at many vision tasks, it is unknown if they exhibit human-like perceptual behaviors. To evaluate this, we introduce HVSBench, the first large-scale benchmark with over 85,000 samples…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Jiaying Lin , Shuquan Ye , Dan Xu , Wanli Ouyang , Rynson W. H. Lau

Although large Vision-Language Models (VLMs) have demonstrated remarkable performance in a wide range of multimodal tasks, their true reasoning capabilities on human IQ tests remain underexplored. To advance research on the fluid…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Tan-Hanh Pham , Phu-Vinh Nguyen , Dang The Hung , Bui Trong Duong , Vu Nguyen Thanh , Chris Ngo , Tri Quang Truong , Truong-Son Hy