English
Related papers

Related papers: MVU-Eval: Towards Multi-Video Understanding Evalua…

200 papers

The rapid development of Multimodal Large Language Models (MLLMs) has expanded their capabilities from image comprehension to video understanding. However, most of these MLLMs focus primarily on offline video comprehension, necessitating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Junming Lin , Zheng Fang , Chi Chen , Zihao Wan , Fuwen Luo , Peng Li , Yang Liu , Maosong Sun

Metaphorical videos are prevalent across various real-world scenarios to convey complex ideas, and understanding them typically requires high-order cognitive capabilities. The lack of systematic studies on metaphorical video understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhuoqun Li , Boxi Cao , Guiping Jiang , Fangrui Lv , Ruotong Pan , Jianan Wang , Xiangyu Wu , Hongyu Lin , Yaojie Lu , Yong Du , Ruyin Jia , Liyan , Tingting Gao , Han Li , Xianpei Han , Le Sun

Understanding videos inherently requires reasoning over both visual and auditory information. To properly evaluate Omni-Large Language Models (Omni-LLMs), which are capable of processing multi-modal information including vision and audio,…

Multimedia · Computer Science 2026-05-15 Jianghan Chao , Jianzhang Gao , Wenhui Tan , Yuchong Sun , Ruihua Song , Liyun Ru

Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Weihan Wang , Zehai He , Wenyi Hong , Yean Cheng , Xiaohan Zhang , Ji Qi , Xiaotao Gu , Shiyu Huang , Bin Xu , Yuxiao Dong , Ming Ding , Jie Tang

Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Nilay Yilmaz , Maitreya Patel , Yiran Lawrence Luo , Tejas Gokhale , Chitta Baral , Suren Jayasuriya , Yezhou Yang

While Multimodal Large Language Models (MLLMs) excel at generic video understanding, their ability to support specialized, rule-grounded decision-making remains insufficiently explored. In this paper, we introduce RefereeBench, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Yichen Xu , Yuanhang Liu , Chuhan Wang , Zihan Zhao , jinghan luo , Jianzhe Ma , Wenxuan Wang , Qin Jin

With the increasing integration of visual and textual content in Social Networking Services (SNS), evaluating the multimodal capabilities of Large Language Models (LLMs) is crucial for enhancing user experience, content understanding, and…

Computation and Language · Computer Science 2025-12-16 Hongcheng Guo , Zheyong Xie , Shaosheng Cao , Boyang Wang , Weiting Liu , Anjie Le , Lei Li , Zhoujun Li

Multimodal large language models have become a popular topic in deep visual understanding due to many promising real-world applications. However, hour-long video understanding, spanning over one hour and containing tens of thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Heqing Zou , Tianze Luo , Guiyang Xie , Victor Xiao Jie Zhang , Fengmao Lv , Guangcong Wang , Junyang Chen , Zhuochen Wang , Hansheng Zhang , Huaijian Zhang

Large vision-language models (VLMs) have recently achieved remarkable progress, exhibiting impressive multimodal perception and reasoning abilities. However, effectively evaluating these large VLMs remains a major challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Yuan Liu , Haodong Duan , Yuanhan Zhang , Bo Li , Songyang Zhang , Wangbo Zhao , Yike Yuan , Jiaqi Wang , Conghui He , Ziwei Liu , Kai Chen , Dahua Lin

Humans acquire knowledge through three cognitive stages: perceiving information, comprehending knowledge, and adapting knowledge to solve novel problems. Videos serve as an effective medium for this learning process, facilitating a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Kairui Hu , Penghao Wu , Fanyi Pu , Wang Xiao , Yuanhan Zhang , Xiang Yue , Bo Li , Ziwei Liu

MM-Vet, with open-ended vision-language questions targeting at evaluating integrated capabilities, has become one of the most popular benchmarks for large multimodal model evaluation. MM-Vet assesses six core vision-language (VL)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Weihao Yu , Zhengyuan Yang , Lingfeng Ren , Linjie Li , Jianfeng Wang , Kevin Lin , Chung-Ching Lin , Zicheng Liu , Lijuan Wang , Xinchao Wang

Multilingual capability is an essential aspect for large multimodal models, since they are usually deployed across various countries and languages. However, most existing benchmarks for multilingual multimodal reasoning struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Hongyu Wang , Jiayu Xu , Senwei Xie , Ruiping Wang , Jialin Li , Zhaojie Xie , Bin Zhang , Chuyan Xiong , Xilin Chen

Recent advances in multi-modal large language models (MLLMs) have demonstrated strong performance across various domains; however, their ability to comprehend driving scenes remains less proven. The complexity of driving scenarios, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sung-Yeon Park , Can Cui , Yunsheng Ma , Ahmadreza Moradipari , Rohit Gupta , Kyungtae Han , Ziran Wang

The emergence of multimodal large language models (MLLMs) has triggered extensive research in model evaluation. While existing evaluation studies primarily focus on unimodal (vision-only) comprehension and reasoning capabilities, they…

Multimedia · Computer Science 2025-04-24 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

Recent advancements have enhanced the capability of Multimodal Large Language Models (MLLMs) to comprehend multi-image information. However, existing benchmarks primarily evaluate answer correctness, overlooking whether models genuinely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Pengfei Wang , Guohai Xu , Weinong Wang , Junjie Yang , Jie Lou , Yunhua Xue

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Comprehending text-rich visual content is paramount for the practical application of Multimodal Large Language Models (MLLMs), since text-rich scenarios are ubiquitous in the real world, which are characterized by the presence of extensive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Bohao Li , Yuying Ge , Yi Chen , Yixiao Ge , Ruimao Zhang , Ying Shan

Recent advancements in Large Language Models (LLMs) have led to the development of Video Large Multi-modal Models (Video-LMMs) that can handle a wide range of video understanding tasks. These models have the potential to be deployed in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Muhammad Uzair Khattak , Muhammad Ferjad Naeem , Jameel Hassan , Muzammal Naseer , Federico Tombari , Fahad Shahbaz Khan , Salman Khan

Large multimodal models (LMMs) have demonstrated outstanding capabilities in various visual perception tasks, which has in turn made the evaluation of LMMs significant. However, the capability of video aesthetic quality assessment, which is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yunhao Li , Sijing Wu , Zhilin Gao , Zicheng Zhang , Qi Jia , Huiyu Duan , Xiongkuo Min , Guangtao Zhai

Deeply understanding sports requires an intricate blend of fine-grained visual perception and rule-based reasoning - a challenge that pushes the limits of current multimodal models. To succeed, models must master three critical…