English
Related papers

Related papers: FCMBench-Video: Benchmarking Document Video Intell…

200 papers

What does it mean for two videos to be similar? Videos may appear similar when judged by the actions they depict, yet entirely different if evaluated based on the locations where they were filmed. While humans naturally compare videos by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Benedetta Liberatori , Alessandro Conti , Lorenzo Vaquero , Yiming Wang , Elisa Ricci , Paolo Rota

Recent studies have shown that long chain-of-thought (CoT) reasoning can significantly enhance the performance of large language models (LLMs) on complex tasks. However, this benefit is yet to be demonstrated in the domain of video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yuanxin Liu , Kun Ouyang , Haoning Wu , Yi Liu , Lin Sui , Xinhao Li , Yan Zhong , Y. Charles , Xinyu Zhou , Xu Sun

With the rapid development of video Multimodal Large Language Models (MLLMs), numerous benchmarks have been proposed to assess their video understanding capability. However, due to the lack of rich events in the videos, these datasets may…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yifan Du , Kun Zhou , Yuqi Huo , Yifan Li , Wayne Xin Zhao , Haoyu Lu , Zijia Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen

Humans acquire knowledge through three cognitive stages: perceiving information, comprehending knowledge, and adapting knowledge to solve novel problems. Videos serve as an effective medium for this learning process, facilitating a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Kairui Hu , Penghao Wu , Fanyi Pu , Wang Xiao , Yuanhan Zhang , Xiang Yue , Bo Li , Ziwei Liu

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

Despite significant breakthroughs in video analysis driven by the rapid development of large multimodal models (LMMs), there remains a lack of a versatile evaluation benchmark to comprehensively assess these models' performance in video…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunxin Li , Xinyu Chen , Baotian Hu , Longyue Wang , Haoyuan Shi , Min Zhang

Multimodal Large Language Models (MLLMs) have significantly progressed in offline video understanding. However, applying these models to real-world scenarios, such as autonomous driving and human-computer interaction, presents unique…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Zhenpeng Huang , Xinhao Li , Jiaqi Li , Jing Wang , Xiangyu Zeng , Cheng Liang , Tao Wu , Xi Chen , Liang Li , Limin Wang

Large Multimodal Models (LMMs) have achieved remarkable progress across various capabilities; however, complex video reasoning in the scientific domain remains a significant and challenging frontier. Current video benchmarks predominantly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Andong Deng , Taojiannan Yang , Shoubin Yu , Lincoln Spencer , Mohit Bansal , Chen Chen , Serena Yeung-Levy , Xiaohan Wang

The rapid development of Large Language Models (LLMs) has catalyzed significant advancements in video understanding technologies. This survey provides a comprehensive analysis of benchmarks and evaluation methodologies specifically designed…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yogesh Kumar

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Video large language models have achieved remarkable performance in tasks such as video question answering, however, their temporal understanding remains suboptimal. To address this limitation, we curate a dedicated instruction fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yunxiao Wang , Meng Liu , Wenqi Liu , Xuemeng Song , Bin Wen , Fan Yang , Tingting Gao , Di Zhang , Guorui Zhou , Liqiang Nie

Multi-modal large language models (MLLMs) have demonstrated considerable potential across various downstream tasks that require cross-domain knowledge. MLLMs capable of processing videos, known as Video-MLLMs, have attracted broad interest…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiajun Fei , Dian Li , Zhidong Deng , Zekun Wang , Gang Liu , Hui Wang

Recent advancements in language multimodal models (LMMs) for video have demonstrated their potential for understanding video content, yet the task of comprehending multi-discipline lectures remains largely unexplored. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Enxin Song , Wenhao Chai , Weili Xu , Jianwen Xie , Yuxuan Liu , Gaoang Wang

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong

In recent years, vision language models (VLMs) have made significant advancements in video understanding. However, a crucial capability - fine-grained motion comprehension - remains under-explored in current benchmarks. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wenyi Hong , Yean Cheng , Zhuoyi Yang , Weihan Wang , Lefan Wang , Xiaotao Gu , Shiyu Huang , Yuxiao Dong , Jie Tang

We introduce CameraBench, a large-scale dataset and benchmark designed to assess and improve camera motion understanding. CameraBench consists of ~3,000 diverse internet videos, annotated by experts through a rigorous multi-stage quality…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhiqiu Lin , Siyuan Cen , Daniel Jiang , Jay Karhade , Hewei Wang , Chancharik Mitra , Tiffany Ling , Yuhan Huang , Sifan Liu , Mingyu Chen , Rushikesh Zawar , Xue Bai , Yilun Du , Chuang Gan , Deva Ramanan

Mathematical reasoning in real-world video settings presents a fundamentally different challenge than in static images or text. It requires interpreting fine-grained visual information, accurately reading handwritten or digital text, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Hanoona Rasheed , Abdelrahman Shaker , Anqi Tang , Muhammad Maaz , Ming-Hsuan Yang , Salman Khan , Fahad Shahbaz Khan

Cinematography is a cornerstone of film production and appreciation, shaping mood, emotion, and narrative through visual elements such as camera movement, shot composition, and lighting. Despite recent progress in multimodal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xinran Wang , Songyu Xu , Xiangxuan Shan , Yuxuan Zhang , Muxi Diao , Xueyan Duan , Yanhua Huang , Kongming Liang , Zhanyu Ma

While existing video benchmarks largely consider specialized downstream tasks like retrieval or question-answering (QA), contemporary multimodal AI systems must be capable of well-rounded common-sense reasoning akin to human visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Kate Sanders , Benjamin Van Durme

The advancement of Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs) and large vision-language models (LVLMs). However, a rigorous evaluation framework for video CoT reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yukun Qi , Yiming Zhao , Yu Zeng , Xikun Bao , Wenxuan Huang , Lin Chen , Zehui Chen , Jie Zhao , Zhongang Qi , Feng Zhao