English
Related papers

Related papers: Video-Holmes: Can MLLM Think Like Holmes for Compl…

200 papers

Recent studies have shown that long chain-of-thought (CoT) reasoning can significantly enhance the performance of large language models (LLMs) on complex tasks. However, this benefit is yet to be demonstrated in the domain of video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yuanxin Liu , Kun Ouyang , Haoning Wu , Yi Liu , Lin Sui , Xinhao Li , Yan Zhong , Y. Charles , Xinyu Zhou , Xu Sun

Human intelligence requires correctness and robustness, with the former being foundational for the latter. In video understanding, correctness ensures the accurate interpretation of visual content, and robustness maintains consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yuanhan Zhang , Yunice Chew , Yuhao Dong , Aria Leo , Bo Hu , Ziwei Liu

Existing video benchmarks often resemble image-based benchmarks, with question types like "What actions does the person perform throughout the video?" or "What color is the woman's dress in the video?" For these, models can often answer by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yiyang Zhou , Linjie Li , Shi Qiu , Zhengyuan Yang , Yuyang Zhao , Siwei Han , Yangfan He , Kangqi Li , Haonian Ji , Zihao Zhao , Haibo Tong , Lijuan Wang , Huaxiu Yao

Video-based large language models (Video-LLMs) have been recently introduced, targeting both fundamental improvements in perception and comprehension, and a diverse range of user inquiries. In pursuit of the ultimate goal of achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Munan Ning , Bin Zhu , Yujia Xie , Bin Lin , Jiaxi Cui , Lu Yuan , Dongdong Chen , Li Yuan

Multimodal Large Language Models (MLLMs) have demonstrated significant advances in visual understanding tasks involving both images and videos. However, their capacity to comprehend human-centric video data remains underexplored, primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxuan Cai , Jiangning Zhang , Zhenye Gan , Qingdong He , Xiaobin Hu , Junwei Zhu , Yabiao Wang , Chengjie Wang , Zhucun Xue , Chaoyou Fu , Xinwei He , Xiang Bai

We introduce PerceptionComp, a manually annotated benchmark for complex, long-horizon, perception-centric video reasoning. PerceptionComp is designed so that no single moment is sufficient: answering each question requires multiple…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shaoxuan Li , Zhixuan Zhao , Hanze Deng , Zirun Ma , Shulin Tian , Zuyan Liu , Yushi Hu , Haoning Wu , Yuhao Dong , Benlin Liu , Ziwei Liu , Ranjay Krishna

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

With the rapid advancement of video understanding, existing benchmarks are becoming increasingly saturated, exposing a critical discrepancy between inflated leaderboard scores and real-world model capabilities. To address this widening gap,…

Recent advancements in Large Language Models (LLMs) have led to the development of Video Large Multi-modal Models (Video-LMMs) that can handle a wide range of video understanding tasks. These models have the potential to be deployed in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Muhammad Uzair Khattak , Muhammad Ferjad Naeem , Jameel Hassan , Muzammal Naseer , Federico Tombari , Fahad Shahbaz Khan , Salman Khan

In the quest for artificial general intelligence, Multi-modal Large Language Models (MLLMs) have emerged as a focal point in recent advancements. However, the predominant focus remains on developing their capabilities in static image…

Spatial understanding over continuous visual input is crucial for MLLMs to evolve into general-purpose assistants in physical environments. Yet there is still no comprehensive benchmark that holistically assesses the progress toward this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jingli Lin , Runsen Xu , Shaohao Zhu , Sihan Yang , Peizhou Cao , Yunlong Ran , Miao Hu , Chenming Zhu , Yiman Xie , Yilin Long , Wenbo Hu , Dahua Lin , Tai Wang , Jiangmiao Pang

Video-based numerical reasoning provides a premier arena for testing whether Vision-Language Models (VLMs) truly "understand" real-world dynamics, as accurate numerical deduction necessitates a profound grasp of temporal events, object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Shaoyang Cui , Lingbei Meng

Multimodal Large Language Models (MLLMs) have demonstrated proficiency in handling a variety of visual-language tasks. However, current MLLM benchmarks are predominantly designed to evaluate reasoning based on static information about a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Xiyao Wang , Yuhang Zhou , Xiaoyu Liu , Hongjin Lu , Yuancheng Xu , Feihong He , Jaehong Yoon , Taixi Lu , Gedas Bertasius , Mohit Bansal , Huaxiu Yao , Furong Huang

Cross-Video Reasoning (CVR) presents a significant challenge in video understanding, which requires simultaneous understanding of multiple videos to aggregate and compare information across groups of videos. Most existing video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jingyao Li , Jingyun Wang , Molin Tan , Haochen Wang , Cilin Yan , Likun Shi , Jiayin Cai , Xiaolong Jiang , Yao Hu

Despite significant breakthroughs in video analysis driven by the rapid development of large multimodal models (LMMs), there remains a lack of a versatile evaluation benchmark to comprehensively assess these models' performance in video…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunxin Li , Xinyu Chen , Baotian Hu , Longyue Wang , Haoyuan Shi , Min Zhang

The advancement of Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs) and large vision-language models (LVLMs). However, a rigorous evaluation framework for video CoT reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yukun Qi , Yiming Zhao , Yu Zeng , Xikun Bao , Wenxuan Huang , Lin Chen , Zehui Chen , Jie Zhao , Zhongang Qi , Feng Zhao

Multimodal Large Language Models (MLLMs) have made rapid progress in perception, understanding, and reasoning, yet existing benchmarks fall short in evaluating these abilities under continuous and dynamic real-world video streams. Such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Shuhang Xun , Sicheng Tao , Jungang Li , Yibo Shi , Zhixin Lin , Zhanhui Zhu , Yibo Yan , Hanqian Li , Linghao Zhang , Shikang Wang , Yixin Liu , Hanbo Zhang , Ying Ma , Xuming Hu

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

Existing evaluation frameworks for Multimodal Large Language Models (MLLMs) primarily focus on image reasoning or general video understanding tasks, largely overlooking the significant role of image context in video comprehension. To bridge…

Large Multimodal Models (LMMs) have achieved remarkable progress across various capabilities; however, complex video reasoning in the scientific domain remains a significant and challenging frontier. Current video benchmarks predominantly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Andong Deng , Taojiannan Yang , Shoubin Yu , Lincoln Spencer , Mohit Bansal , Chen Chen , Serena Yeung-Levy , Xiaohan Wang
‹ Prev 1 2 3 10 Next ›