English
Related papers

Related papers: Building Scalable Video Understanding Benchmarks t…

200 papers

Extending language models to video introduces two challenges: representation, where existing methods rely on lossy approximations, and long-context, where caption- or agent-based pipelines collapse video into text and lose visual fidelity.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Mohamed Eltahir , Ali Habibullah , Yazan Alshoibi , Lama Ayash , Tanveer Hussain , Naeemullah Khan

With the rapid development of video Multimodal Large Language Models (MLLMs), numerous benchmarks have been proposed to assess their video understanding capability. However, due to the lack of rich events in the videos, these datasets may…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yifan Du , Kun Zhou , Yuqi Huo , Yifan Li , Wayne Xin Zhao , Haoyu Lu , Zijia Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen

Video understanding, including video captioning and retrieval, is still a great challenge for video-language models (VLMs). The existing video retrieval and caption benchmarks only include short descriptions, limits their ability of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yifan Xu , Xinhao Li , Yichun Yang , Desen Meng , Rui Huang , Limin Wang

To help the visually impaired enjoy movies, automatic movie narrating systems are expected to narrate accurate, coherent, and role-aware plots when there are no speaking lines of actors. Existing works benchmark this challenge as a normal…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Zihao Yue , Qi Zhang , Anwen Hu , Liang Zhang , Ziheng Wang , Qin Jin

Multi-modal large language models (MLLMs) have demonstrated considerable potential across various downstream tasks that require cross-domain knowledge. MLLMs capable of processing videos, known as Video-MLLMs, have attracted broad interest…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiajun Fei , Dian Li , Zhidong Deng , Zekun Wang , Gang Liu , Hui Wang

We present BASKET, a large-scale basketball video dataset for fine-grained skill estimation. BASKET contains 4,477 hours of video capturing 32,232 basketball players from all over the world. Compared to prior skill estimation datasets, our…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yulu Pan , Ce Zhang , Gedas Bertasius

Detecting transitions between intro/credits and main content in videos is a crucial task for content segmentation, indexing, and recommendation systems. Manual annotation of such transitions is labor-intensive and error-prone, while…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Vasilii Korolkov , Andrey Yanchenko

Audio-visual generation is rapidly advancing from short clips to minute-long content, while existing evaluation protocols remain largely confined to short-form settings. Existing benchmarks primarily focus on 5--10 second text-conditioned…

Although recent traffic benchmarks have advanced multimodal data analysis, they generally lack systematic evaluation aligned with official safety standards. To fill this gap, we introduce RoadSafe365, a large-scale vision-language benchmark…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xinyu Liu , Darryl C. Jacob , Yuxin Liu , Xinsong Du , Muchao Ye , Bolei Zhou , Pan He

We present a general approach to video understanding, inspired by semantic transfer techniques that have been successfully used for 2D image analysis. Our method considers a video to be a 1D sequence of clips, each one associated with its…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Dotan Kaufman , Gil Levi , Tal Hassner , Lior Wolf

While the shortage of explicit action data limits Vision-Language-Action (VLA) models, human action videos offer a scalable yet unlabeled data source. A critical challenge in utilizing large-scale human video datasets lies in transforming…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dujun Nie , Fengjiao Chen , Qi Lv , Jun Kuang , Xiaoyu Li , Xuezhi Cao , Xunliang Cai

Automatic video summarization is still an unsolved problem due to several challenges. The currently available datasets either have very short videos or have few long videos of only a particular type. We introduce a new benchmarking video…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Vishal Kaushal , Suraj Kothawade , Anshul Tomar , Rishabh Iyer , Ganesh Ramakrishnan

Audio-visual video parsing focuses on classifying videos through weak labels while identifying events as either visible, audible, or both, alongside their respective temporal boundaries. Many methods ignore that different modalities often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Langyu Wang , Bingke Zhu , Yingying Chen , Jinqiao Wang

What makes a video task uniquely suited for videos, beyond what can be understood from a single image? Building on recent progress in self-supervised image-language models, we revisit this question in the context of video and language…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Shyamal Buch , Cristóbal Eyzaguirre , Adrien Gaidon , Jiajun Wu , Li Fei-Fei , Juan Carlos Niebles

Annotating a large-scale in-the-wild person re-identification dataset especially of marathon runners is a challenging task. The variations in the scenarios such as camera viewpoints, resolution, occlusion, and illumination make the problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Pranjal Singh Rajput , Yeshwanth Napolean , Jan van Gemert

Streaming video models should respond the moment an event unfolds, not after the moment has passed. Yet existing online VideoQA benchmarks remain largely retrospective. They pause the video at fixed timestamps, pose questions about current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Dibyadip Chatterjee , Zhanzhong Pang , Fadime Sener , Yale Song , Angela Yao

Multimodal video summarization requires visual features that align semantically with language generation. Traditional approaches rely on CNN features trained for object classification, which represent visual concepts as discrete categories…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Maham Nazir , Muhammad Aqeel , Richong Zhang , Francesco Setti

Vision-language models (VLMs) have recently shown strong potential in soccer video understanding. However, given the high complexity of soccer videos due to large viewpoint variations, rapid shot transitions, and cluttered scenes, it…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ismael Elsharkawi , Ahmed Sait , Silvio Giancola , Bernard Ghanem , Hossam Sharara , Abdelrahman Eldesokey

Multi-modal Large Language Models (MLLMs) capable of video understanding are advancing rapidly. To effectively assess their video comprehension capabilities, long video understanding benchmarks, such as Video-MME and MLVU, are proposed.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Xichen Tan , Yunfan Ye , Yuanjing Luo , Qian Wan , Fang Liu , Zhiping Cai

Surveillance videos are able to capture a variety of realistic anomalies. In this paper, we propose to learn anomalies by exploiting both normal and anomalous videos. To avoid annotating the anomalous segments or clips in training videos,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Waqas Sultani , Chen Chen , Mubarak Shah