English
Related papers

Related papers: VMBench: A Benchmark for Perception-Aligned Video …

200 papers

Large Video Models (LVMs) build on the semantic capabilities of Large Language Models (LLMs) and vision modules by integrating temporal information to better understand dynamic video content. Despite their progress, LVMs are prone to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Garry Yang , Zizhe Chen , Man Hon Wong , Haoyu Lei , Yongqiang Chen , Zhenguo Li , Kaiwen Zhou , James Cheng

Vision-language models are integral to computer vision research, yet many high-performing models remain closed-source, obscuring their data, design and training recipe. The research community has responded by using distillation from…

We introduce \textbf{LongInsightBench}, the first benchmark designed to assess models' ability to understand long videos, with a focus on human language, viewpoints, actions, and other contextual elements, while integrating \textbf{visual,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 ZhaoYang Han , Qihan Lin , Hao Liang , Bowen Chen , Zhou Liu , Wentao Zhang

Long video understanding (LVU) remains a core challenge in multimodal learning. Although recent vision-language models (VLMs) have made notable progress, existing benchmarks mainly focus on either fine-grained perception or coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Seng Nam Chen , Hao Chen , Chenglam Ho , Xinyu Mao , Jinping Wang , Yu Zhang , Chao Li

The rapid advancement of large multimodal models (LMMs) has led to the rapid expansion of artificial intelligence generated videos (AIGVs), which highlights the pressing need for effective video quality assessment (VQA) models designed…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiarui Wang , Huiyu Duan , Guangtao Zhai , Juntong Wang , Xiongkuo Min

Streaming vision-language models (VLMs) continuously generate responses given an instruction prompt and an online stream of input frames. This is a core mechanism for real-time visual assistants. Existing VLM frameworks predominantly assess…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Pavan Kumar Anasosalu Vasu , Cem Koc , Fartash Faghri , Chun-Liang Li , Bo Feng , Zhengfeng Lai , Meng Cao , Oncel Tuzel , Hadi Pouransari

The alignment of large language models (LLMs) with human values is critical for their safe and effective deployment across diverse user populations. However, existing benchmarks often neglect cultural and demographic diversity, leading to…

Computation and Language · Computer Science 2025-09-17 Yao Liang , Dongcheng Zhao , Feifei Zhao , Guobin Shen , Yuwei Wang , Dongqi Liang , Yi Zeng

World Generation Models are emerging as a cornerstone of next-generation multimodal intelligence systems. Unlike traditional 2D visual generation, World Models aim to construct realistic, dynamic, and physically consistent 3D/4D worlds from…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yiting Lu , Wei Luo , Peiyan Tu , Haoran Li , Hanxin Zhu , Zihao Yu , Xingrui Wang , Xinyi Chen , Xinge Peng , Xin Li , Zhibo Chen

While text-to-visual models now produce photo-realistic images and videos, they struggle with compositional text prompts involving attributes, relationships, and higher-order reasoning such as logic and comparison. In this work, we conduct…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Baiqi Li , Zhiqiu Lin , Deepak Pathak , Jiayao Li , Yixin Fei , Kewen Wu , Tiffany Ling , Xide Xia , Pengchuan Zhang , Graham Neubig , Deva Ramanan

The real world is dynamic, yet most image fusion methods process static frames independently, ignoring temporal correlations in videos and leading to flickering and temporal inconsistency. To address this, we propose Unified Video Fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Zixiang Zhao , Haowen Bai , Bingxin Ke , Yukun Cui , Lilun Deng , Yulun Zhang , Kai Zhang , Konrad Schindler

Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Substantial progress has been made recently in motion data collection technologies and generation methods, laying…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wentao Zhu , Xiaoxuan Ma , Dongwoo Ro , Hai Ci , Jinlu Zhang , Jiaxin Shi , Feng Gao , Qi Tian , Yizhou Wang

Real-time human perception is crucial for effective human-robot interaction (HRI). Large vision-language models (VLMs) offer promising generalizable perceptual capabilities but often suffer from high latency, which negatively impacts user…

Building on the advances of language models, Large Multimodal Models (LMMs) have contributed significant improvements in video understanding. While the current video LMMs utilize advanced Large Language Models (LLMs), they rely on either…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Khan

Understanding the quality of a performance evaluation metric is crucial for ensuring that model outputs align with human preferences. However, it remains unclear how well each metric captures the diverse aspects of these preferences, as…

Computation and Language · Computer Science 2025-03-04 Genta Indra Winata , David Anugraha , Lucky Susanto , Garry Kuwanto , Derry Tanti Wijaya

Current deep learning results on video generation are limited while there are only a few first results on video prediction and no relevant significant results on video completion. This is due to the severe ill-posedness inherent in these…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Haoye Cai , Chunyan Bai , Yu-Wing Tai , Chi-Keung Tang

With the rapid advancement of video understanding, existing benchmarks are becoming increasingly saturated, exposing a critical discrepancy between inflated leaderboard scores and real-world model capabilities. To address this widening gap,…

Camera motion is a fundamental geometric signal that shapes visual perception and cinematic style, yet current video-capable vision-language models (VideoLLMs) rarely represent it explicitly and often fail on fine-grained motion primitives.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Haoan Feng , Sri Harsha Musunuri , Guan-Ming Su

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Current video benchmarks for multimodal large language models (MLLMs) focus on event recognition, temporal ordering, and long-context recall, but overlook a harder capability required for expert procedural judgment: tracking how ongoing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xiyang Huang , Jiawei Lin , Keying Wu , Jiaxin Huang , Kailai Yang , Renxiong Wei , Cheng zeng , Jiayi Xiang , Ziyan Kuang , Min Peng , Qianqian Xie , Sophia Ananiadou

With the rapid development of video Multimodal Large Language Models (MLLMs), numerous benchmarks have been proposed to assess their video understanding capability. However, due to the lack of rich events in the videos, these datasets may…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yifan Du , Kun Zhou , Yuqi Huo , Yifan Li , Wayne Xin Zhao , Haoyu Lu , Zijia Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen