English
Related papers

Related papers: VideoVista: A Versatile Benchmark for Video Unders…

200 papers

Large multimodal models (LMMs) have demonstrated outstanding capabilities in various visual perception tasks, which has in turn made the evaluation of LMMs significant. However, the capability of video aesthetic quality assessment, which is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yunhao Li , Sijing Wu , Zhilin Gao , Zicheng Zhang , Qi Jia , Huiyu Duan , Xiongkuo Min , Guangtao Zhai

Recent progress in multimodal large language models (MLLMs) has led to a surge of benchmarks for long-video reasoning. However, most existing benchmarks rely on localized cues and fail to capture narrative reasoning, the ability to track…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Rahul Jain , Keval Doshi , Burak Uzkent , Garin Kessler

Video Large Language Models (Video-LLMs) are improving rapidly, yet current Video Question Answering (VideoQA) benchmarks often admit single-cue shortcuts, under-testing reasoning that must integrate evidence across time. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Dan Ben-Ami , Gabriele Serussi , Kobi Cohen , Chaim Baskin

Recently, significant advances have been made in Video Large Language Models (Video LLMs) in both academia and industry. However, methods to evaluate and benchmark the performance of different Video LLMs, especially their fine-grained,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Kuangzhi Ge , Lingjun Chen , Kevin Zhang , Yulin Luo , Tianyu Shi , Liaoyuan Fan , Xiang Li , Guanqun Wang , Shanghang Zhang

Existing video understanding benchmarks often conflate knowledge-based and purely image-based questions, rather than clearly isolating a model's temporal reasoning ability, which is the key aspect that distinguishes video understanding from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Bo Feng , Zhengfeng Lai , Shiyu Li , Zizhen Wang , Simon Wang , Ping Huang , Meng Cao

Chart understanding presents a unique challenge for large vision-language models (LVLMs), as it requires the integration of sophisticated textual and visual reasoning capabilities. However, current LVLMs exhibit a notable imbalance between…

We introduce MAIA (Multimodal AI Assessment), a native-Italian benchmark designed for fine-grained investigation of the reasoning abilities of visual language models on videos. MAIA differs from other available video benchmarks for its…

With the rapid advancement of video generation models such as Sora, video quality assessment (VQA) is becoming increasingly crucial for selecting high-quality videos from large-scale datasets used in pre-training. Traditional VQA methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yanyun Pu , Kehan Li , Zeyi Huang , Zhijie Zhong , Kaixiang Yang

Video summarization aims to create short, accurate, and cohesive summaries of longer videos. Despite the existence of various video summarization datasets, a notable limitation is their limited amount of source videos, which hampers the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Hang Hua , Yolo Yunlong Tang , Chenliang Xu , Jiebo Luo

Video behavior recognition and scene understanding are fundamental tasks in multimodal intelligence, serving as critical building blocks for numerous real-world applications. Through large multimodal models (LMMs) have achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xingjian Zhang , Xi Weng , Yihao Yue , Zhaoxin Fan , Wenjun Wu , Lei Huang

Most of the existing methods for video understanding primarily focus on videos only lasting tens of seconds, with limited exploration of techniques for handling long videos. The increased number of frames in long videos poses two main…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Ziyu Ma , Chenhui Gou , Hengcan Shi , Bin Sun , Shutao Li , Hamid Rezatofighi , Jianfei Cai

Long videos contain a vast amount of information, making video-text retrieval an essential and challenging task in multimodal learning. However, existing benchmarks suffer from limited video duration, low-quality captions, and coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Qifeng Cai , Hao Liang , Zhaoyang Han , Hejun Dong , Meiyi Qiang , Ruichuan An , Quanqing Xu , Bin Cui , Wentao Zhang

With the rapid development of video Multimodal Large Language Models (MLLMs), numerous benchmarks have been proposed to assess their video understanding capability. However, due to the lack of rich events in the videos, these datasets may…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yifan Du , Kun Zhou , Yuqi Huo , Yifan Li , Wayne Xin Zhao , Haoyu Lu , Zijia Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen

Multi-modal large language models (MLLMs) have demonstrated considerable potential across various downstream tasks that require cross-domain knowledge. MLLMs capable of processing videos, known as Video-MLLMs, have attracted broad interest…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiajun Fei , Dian Li , Zhidong Deng , Zekun Wang , Gang Liu , Hui Wang

Streaming video question answering (Streaming Video QA) poses distinct challenges for multimodal large language models (MLLMs), as video frames arrive sequentially and user queries can be issued at arbitrary time points. Existing solutions…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Haocheng Lu , Nan Zhang , Wei Tao , Xiaoyang Qu , Guokuan Li , Jiguang Wan , Jianzong Wang

Visual texts embedded in videos carry rich semantic information, which is crucial for both holistic video understanding and fine-grained reasoning about local human actions. However, existing video understanding benchmarks largely overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Zhoufaran Yang , Yan Shu , Jing Wang , Zhifei Yang , Yan Zhang , Yu Li , Keyang Lu , Gangyan Zeng , Shaohui Liu , Yu Zhou , Nicu Sebe

Long video summarization presents significant challenges for current multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and producing summaries that are both semantically and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Alkesh Patel , Melis Ozyildirim , Ying-Chang Cheng , Ganesh Nagarajan

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

Computation and Language · Computer Science 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Weihan Wang , Zehai He , Wenyi Hong , Yean Cheng , Xiaohan Zhang , Ji Qi , Xiaotao Gu , Shiyu Huang , Bin Xu , Yuxiao Dong , Ming Ding , Jie Tang

Video-based quality assurance (QA) for long-form gameplay video is labor-intensive and error-prone, yet valuable for assessing game stability and visual correctness over extended play sessions. Vision language models (VLMs) promise…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wentao Lu , Alexander Senchenko , Alan Sayle , Abram Hindle , Cor-Paul Bezemer
‹ Prev 1 4 5 6 7 8 10 Next ›