English
Related papers

Related papers: EC-Bench: Enumeration and Counting Benchmark for U…

200 papers

Recent advancements in omnimodal large language models (OmniLLMs) have significantly improved the comprehension of audio and video inputs. However, current evaluations primarily focus on short audio and video clips ranging from 10 seconds…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Keda Tao , Yuhua Zheng , Jia Xu , Wenjie Du , Kele Shao , Hesong Wang , Xueyi Chen , Xin Jin , Junhan Zhu , Bohan Yu , Weiqiang Wang , Jian Liu , Can Qin , Yulun Zhang , Ming-Hsuan Yang , Huan Wang

We introduce Neptune, a benchmark for long video understanding that requires reasoning over long time horizons and across different modalities. Many existing video datasets and models are focused on short clips (10s-30s). While some long…

Mathematical reasoning in real-world video settings presents a fundamentally different challenge than in static images or text. It requires interpreting fine-grained visual information, accurately reading handwritten or digital text, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Hanoona Rasheed , Abdelrahman Shaker , Anqi Tang , Muhammad Maaz , Ming-Hsuan Yang , Salman Khan , Fahad Shahbaz Khan

While large vision-language models (VLMs) are increasingly adopted as the perceptual backbone for embodied agents, existing benchmarks often rely on question-answering or multiple-choice formats. These protocols allow models to exploit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haozhe Shan , Xiancong Ren , Han Dong , Haoyuan Shi , Yingji Zhang , Jiayu Hu , Yi Zhang , Yong Dai , Bin Shen , Lizhen Qu , Zenglin Xu , Xiaozhu Ju

Recent advances in multimodal large language models (MLLMs) have significantly enhanced video understanding capabilities, opening new possibilities for practical applications. Yet current video benchmarks focus largely on indoor scenes or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hao Wang , Eiki Murata , Lingfang Zhang , Ayako Sato , So Fukuda , Ziqi Yin , Wentao Hu , Keisuke Nakao , Yusuke Nakamura , Sebastian Zwirner , Yi-Chia Chen , Hiroyuki Otomo , Hiroki Ouchi , Daisuke Kawahara

The growing interest in embodied agents increases the demand for spatiotemporal video understanding, yet existing benchmarks largely emphasize extractive reasoning, where answers can be explicitly presented within spatiotemporal events. It…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Seunghwan Bang , Hwanjun Song

We introduce DebateBench, a novel dataset consisting of an extensive collection of transcripts and metadata from some of the world's most prestigious competitive debates. The dataset consists of British Parliamentary debates from…

Computation and Language · Computer Science 2025-02-11 Utkarsh Tiwari , Aryan Seth , Adi Mukherjee , Kaavya Mer , Kavish , Dhruv Kumar

Recent advances in video large language models (VideoLLMs) call for new evaluation protocols and benchmarks for complex temporal reasoning in video-language understanding. Inspired by the needle in a haystack test widely used by LLMs, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zi-Yuan Hu , Shuo Liang , Duo Zheng , Yanyang Li , Yeyao Tao , Shijia Huang , Wei Feng , Jia Qin , Jianguang Yu , Jing Huang , Meng Fang , Yin Li , Liwei Wang

While recent video world models can generate highly realistic videos, their ability to perform semantic reasoning and planning remains unclear and unquantified. We introduce Target-Bench, the first benchmark that enables comprehensive…

Recent progress in multi-modal large language models (MLLMs) has significantly advanced video understanding. However, their performance on long-form videos remains limited by computational constraints and suboptimal frame selection. We…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Wenhui Tan , Ruihua Song , Jiaze Li , Jianzhong Ju , Zhenbo Luo

Video large language models (Video-LLMs) can temporally ground language queries and retrieve video moments. Yet, such temporal comprehension capabilities are neither well-studied nor understood. So we conduct a study on prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Minjoon Jung , Junbin Xiao , Byoung-Tak Zhang , Angela Yao

Cross-Video Reasoning (CVR) presents a significant challenge in video understanding, which requires simultaneous understanding of multiple videos to aggregate and compare information across groups of videos. Most existing video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jingyao Li , Jingyun Wang , Molin Tan , Haochen Wang , Cilin Yan , Likun Shi , Jiayin Cai , Xiaolong Jiang , Yao Hu

With the rise of multimodal large language models, accurately extracting and understanding textual information from video content, referred to as video based optical character recognition (Video OCR), has become a crucial capability. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yulin Fei , Yuhui Gao , Xingyuan Xian , Xiaojin Zhang , Tao Wu , Wei Chen

Recent advances in large language models (LLMs) have improved reasoning in text and image domains, yet achieving robust video reasoning remains a significant challenge. Existing video benchmarks mainly assess shallow understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuchen Li , Xuzhao Li , Shiyu Hu , Kaiqi Huang , Wentao Zhang

Despite significant breakthroughs in video analysis driven by the rapid development of large multimodal models (LMMs), there remains a lack of a versatile evaluation benchmark to comprehensively assess these models' performance in video…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunxin Li , Xinyu Chen , Baotian Hu , Longyue Wang , Haoyuan Shi , Min Zhang

Entity state tracking is a necessary component of world modeling that requires maintaining coherent representations of entities over time. Previous work has benchmarked entity tracking performance in purely text-based tasks. We introduce…

Computation and Language · Computer Science 2026-02-10 Vanya Cohen , Raymond Mooney

Multi-modal Large language models (MLLMs) show remarkable ability in video understanding. Nevertheless, understanding long videos remains challenging as the models can only process a finite number of frames in a single inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yucheng Suo , Fan Ma , Linchao Zhu , Tianyi Wang , Fengyun Rao , Yi Yang

With the rapid advancement of video understanding, existing benchmarks are becoming increasingly saturated, exposing a critical discrepancy between inflated leaderboard scores and real-world model capabilities. To address this widening gap,…

As large language models (LLMs) become integral to code-related tasks, a central question emerges: Do LLMs truly understand program semantics? We introduce EquiBench, a new benchmark for evaluating LLMs through equivalence checking, i.e.,…

Machine Learning · Computer Science 2025-09-23 Anjiang Wei , Jiannan Cao , Ran Li , Hongyu Chen , Yuhui Zhang , Ziheng Wang , Yuan Liu , Thiago S. F. X. Teixeira , Diyi Yang , Ke Wang , Alex Aiken

Research on Large Language Models (LLMs) has recently witnessed an increasing interest in extending the models' context size to better capture dependencies within long documents. While benchmarks have been proposed to assess long-range…

Computation and Language · Computer Science 2025-01-20 Thibaut Thonet , Jos Rozen , Laurent Besacier