English
Related papers

Related papers: VideoSTF: Stress-Testing Output Repetition in Vide…

200 papers

Video Large Language Models (VideoLLMs) have recently demonstrated remarkable progress in general video understanding. However, existing models primarily focus on high-level comprehension and are limited to text-only responses, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Haochen Wang , Qirui Chen , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Yao Hu , Weidi Xie , Stratis Gavves

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

Long video understanding poses a significant challenge for current Multi-modal Large Language Models (MLLMs). Notably, the MLLMs are constrained by their limited context lengths and the substantial costs while processing long videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yan Shu , Zheng Liu , Peitian Zhang , Minghao Qin , Junjie Zhou , Zhengyang Liang , Tiejun Huang , Bo Zhao

Large language models have demonstrated impressive performance when integrated with vision models even enabling video understanding. However, evaluating video models presents its own unique challenges, for which several benchmarks have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Daniel Cores , Michael Dorkenwald , Manuel Mucientes , Cees G. M. Snoek , Yuki M. Asano

We present CycliST, a novel benchmark dataset designed to evaluate Video Language Models (VLM) on their ability for textual reasoning over cyclical state transitions. CycliST captures fundamental aspects of real-world processes by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Simon Kohaut , Daniel Ochs , Shun Zhang , Benedict Flade , Julian Eggert , Kristian Kersting , Devendra Singh Dhami

Multimodal Large Language Models (MLLMs) have made rapid progress in perception, understanding, and reasoning, yet existing benchmarks fall short in evaluating these abilities under continuous and dynamic real-world video streams. Such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Shuhang Xun , Sicheng Tao , Jungang Li , Yibo Shi , Zhixin Lin , Zhanhui Zhu , Yibo Yan , Hanqian Li , Linghao Zhang , Shikang Wang , Yixin Liu , Hanbo Zhang , Ying Ma , Xuming Hu

Large language models (LLMs) are increasingly deployed in multilingual, real-world applications with user inputs -- naturally introducing \emph{typographical errors} (typos). Yet most benchmarks assume clean input, leaving the robustness of…

Computation and Language · Computer Science 2026-04-21 Raoyuan Zhao , Yihong Liu , Lena Altinger , Hinrich Schütze , Michael A. Hedderich

MLLMs have been widely studied for video question answering recently. However, most existing assessments focus on natural videos, overlooking synthetic videos, such as AI-generated content (AIGC). Meanwhile, some works in video generation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tingyu Song , Tongyan Hu , Guo Gan , Yilun Zhao

As multimodal large language models (MLLMs) frequently exhibit errors in complex video reasoning scenarios, correcting these errors is critical for uncovering their weaknesses and improving performance. However, existing benchmarks lack…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xusen Hei , Jiali Chen , Jinyu Yang , Mengchen Zhao , Yi Cai

Multimodal Large Language Models (MLLMs) show impressive vision-language benchmark performance, yet growing concerns about data contamination (test set exposure during training) risk masking true generalization. This concern extends to…

Artificial Intelligence · Computer Science 2025-06-10 Ming Liu , Wensheng Zhang

Video-based large language models (Video-LLMs) have been recently introduced, targeting both fundamental improvements in perception and comprehension, and a diverse range of user inquiries. In pursuit of the ultimate goal of achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Munan Ning , Bin Zhu , Yujia Xie , Bin Lin , Jiaxi Cui , Lu Yuan , Dongdong Chen , Li Yuan

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding. However, seemingly plausible outputs often suffer from poor visual and temporal grounding: a model may fabricate object existence, assign…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yihao Quan , Zeru Shi , Jinman Zhao , Ruixiang Tang

Large language models (LLMs) have shown remarkable text understanding capabilities, which have been extended as Video LLMs to handle video data for comprehending visual details. However, existing Video LLMs can only provide a coarse…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Bin Huang , Xin Wang , Hong Chen , Zihan Song , Wenwu Zhu

Video language continual learning involves continuously adapting to information from video and text inputs, enhancing a model's ability to handle new tasks while retaining prior knowledge. This field is a relatively under-explored area, and…

Artificial Intelligence · Computer Science 2024-12-17 Tianqi Tang , Shohreh Deldari , Hao Xue , Celso De Melo , Flora D. Salim

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Recently, rapid advancements have been made in multimodal large language models (MLLMs), especially in video understanding tasks. However, current research focuses on simple video scenarios, failing to reflect the complex and diverse nature…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Lu Zhu , Tiantian Geng , Yangye Chen , Teng Wang , Ping Lu , Feng Zheng

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilities of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Ce Zhang , Yan-Bo Lin , Ziyang Wang , Mohit Bansal , Gedas Bertasius

Video Large Language Models (Video-LLMs) have demonstrated remarkable capabilities in coarse-grained video understanding, however, they struggle with fine-grained temporal grounding. In this paper, we introduce Grounded-VideoLLM, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Haibo Wang , Zhiyang Xu , Yu Cheng , Shizhe Diao , Yufan Zhou , Yixin Cao , Qifan Wang , Weifeng Ge , Lifu Huang

Understanding abnormal events in videos is a vital and challenging task that has garnered significant attention in a wide range of applications. Although current video understanding Multi-modal Large Language Models (MLLMs) are capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yingxian Chen , Jiahui Liu , Ruidi Fan , Yanwei Li , Chirui Chang , Shizhen Zhao , Wilton W. T. Fok , Xiaojuan Qi , Yik-Chung Wu

The explosive growth of videos on streaming media platforms has underscored the urgent need for effective video quality assessment (VQA) algorithms to monitor and perceptually optimize the quality of streaming videos. However, VQA remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qihang Ge , Wei Sun , Yu Zhang , Yunhao Li , Zhongpeng Ji , Fengyu Sun , Shangling Jui , Xiongkuo Min , Guangtao Zhai