English
Related papers

Related papers: VMBench: A Benchmark for Perception-Aligned Video …

200 papers

Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Ziqi Huang , Yinan He , Jiashuo Yu , Fan Zhang , Chenyang Si , Yuming Jiang , Yuanhan Zhang , Tianxing Wu , Qingyang Jin , Nattapol Chanpaisit , Yaohui Wang , Xinyuan Chen , Limin Wang , Dahua Lin , Yu Qiao , Ziwei Liu

Video generation assessment is essential for ensuring that generative models produce visually realistic, high-quality videos while aligning with human expectations. Current video generation benchmarks fall into two main categories:…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Hui Han , Siyuan Li , Jiaqi Chen , Yiwen Yuan , Yuling Wu , Chak Tou Leong , Hanwen Du , Junchen Fu , Youhua Li , Jie Zhang , Chi Zhang , Li-jia Li , Yongxin Ni

Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ziqi Huang , Fan Zhang , Xiaojie Xu , Yinan He , Jiashuo Yu , Ziyue Dong , Qianli Ma , Nattapol Chanpaisit , Chenyang Si , Yuming Jiang , Yaohui Wang , Xinyuan Chen , Ying-Cong Chen , Limin Wang , Dahua Lin , Yu Qiao , Ziwei Liu

In recent years, vision language models (VLMs) have made significant advancements in video understanding. However, a crucial capability - fine-grained motion comprehension - remains under-explored in current benchmarks. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wenyi Hong , Yean Cheng , Zhuoyi Yang , Weihan Wang , Lefan Wang , Xiaotao Gu , Shiyu Huang , Yuxiao Dong , Jie Tang

The evolution of video generation toward complex, multi-shot narratives has exposed a critical deficit in current evaluation methods. Existing benchmarks remain anchored to single-shot paradigms, lacking the comprehensive story assets and…

Multimedia · Computer Science 2026-03-02 Haoyuan Shi , Yunxin Li , Nanhao Deng , Zhenran Xu , Xinyu Chen , Longyue Wang , Baotian Hu , Min Zhang

The rapid progress of Large Language Models (LLMs) has spurred growing interest in Multi-modal LLMs (MLLMs) and motivated the development of benchmarks to evaluate their perceptual and comprehension abilities. Existing benchmarks, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Purui Bai , Tao Wu , Jiayang Sun , Xinyue Liu , Huaibo Huang , Ran He

Rapid advances in audio-video (AV) generation have enabled high-fidelity synthesis with synchronized sound, particularly for human-related scenarios involving speech and interactions. Yet evaluation for AV generation remains at an early…

Artificial Intelligence · Computer Science 2026-05-26 Jialiang Yang , Bin Xia , Ruihang Chu , Dingdong Wang , Wanke Xia , Zhun Mou , Tianyang Zhong , Yiting Zhao , Wenming Yang

We introduce CameraBench, a large-scale dataset and benchmark designed to assess and improve camera motion understanding. CameraBench consists of ~3,000 diverse internet videos, annotated by experts through a rigorous multi-stage quality…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhiqiu Lin , Siyuan Cen , Daniel Jiang , Jay Karhade , Hewei Wang , Chancharik Mitra , Tiffany Ling , Yuhan Huang , Sifan Liu , Mingyu Chen , Rushikesh Zawar , Xue Bai , Yilun Du , Chuang Gan , Deva Ramanan

While current video generation focuses on text or image conditions, practical applications like video editing and vlogging often need to seamlessly connect separate clips. In our work, we introduce Video Connecting, an innovative task that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Zhiyu Yin , Zhipeng Liu , Kehai Chen , Lemao Liu , Jin Liu , Hong-Dong Li , Yang Xiang , Min Zhang

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

Evaluating the nuanced human-centric video understanding capabilities of Multimodal Large Language Models (MLLMs) remains a great challenge, as existing benchmarks often overlook the intricacies of emotion, behavior, and cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ting Zhou , Daoyuan Chen , Qirui Jiao , Bolin Ding , Yaliang Li , Ying Shen

With AI-generated videos increasingly indistinguishable from reality, current benchmarks primarily focus on broad semantic alignment and basic physical consistency, offering limited discriminative power for evaluating them. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Jiaqi Wang , Weijia Wu , Yi Zhan , Rui Zhao , Ming Hu , James Cheng , Wei Liu , Philip Torr , Kevin Qinghong Lin

The next frontier for video generation lies in developing models capable of zero-shot reasoning, where understanding real-world scientific laws is crucial for accurate physical outcome modeling under diverse conditions. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Lanxiang Hu , Abhilash Shankarampeta , Yixin Huang , Zilin Dai , Haoyang Yu , Yujie Zhao , Haoqiang Kang , Daniel Zhao , Tajana Rosing , Hao Zhang

Recent text-to-video generation models have made remarkable progress in visual realism, motion fidelity, and text-video alignment, yet they still struggle to produce socially coherent behavior. Unlike humans, who readily infer intentions,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wenshuo Peng , Gongxuan Wang , Tianmeng Yang , Chuanhao Li , Xiaojie Xu , Hui He , Kaipeng Zhang

Video generation models have significantly advanced embodied intelligence, unlocking new possibilities for generating diverse robot data that capture perception, reasoning, and action in the physical world. However, synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufan Deng , Zilin Pan , Hongyu Zhang , Xiaojie Li , Ruoqing Hu , Yufei Ding , Yiming Zou , Yan Zeng , Daquan Zhou

Video generation has advanced rapidly, with recent methods producing increasingly convincing animated results. However, existing benchmarks-largely designed for realistic videos-struggle to evaluate animation-style generation with its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Leyi Wu , Pengjun Fang , Kai Sun , Yazhou Xing , Yinwei Wu , Songsong Wang , Ziqi Huang , Dan Zhou , Yingqing He , Ying-Cong Chen , Qifeng Chen

Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Weihan Wang , Zehai He , Wenyi Hong , Yean Cheng , Xiaohan Zhang , Ji Qi , Xiaotao Gu , Shiyu Huang , Bin Xu , Yuxiao Dong , Ming Ding , Jie Tang

Cinematography is a cornerstone of film production and appreciation, shaping mood, emotion, and narrative through visual elements such as camera movement, shot composition, and lighting. Despite recent progress in multimodal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xinran Wang , Songyu Xu , Xiangxuan Shan , Yuxuan Zhang , Muxi Diao , Xueyan Duan , Yanhua Huang , Kongming Liang , Zhanyu Ma

Large Vision-Language Models (LVLMs) have made significant strides in the field of video understanding in recent times. Nevertheless, existing video benchmarks predominantly rely on text prompts for evaluation, which often require complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yiming Zhao , Yu Zeng , Yukun Qi , YaoYang Liu , Xikun Bao , Lin Chen , Zehui Chen , Qing Miao , Chenxi Liu , Jie Zhao , Feng Zhao

Recent advances in video generation have been remarkable, enabling models to produce visually compelling videos with synchronized audio. While existing video generation benchmarks provide comprehensive metrics for visual quality, they lack…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Daili Hua , Xizhi Wang , Bohan Zeng , Xinyi Huang , Hao Liang , Junbo Niu , Xinlong Chen , Quanqing Xu , Wentao Zhang
‹ Prev 1 2 3 10 Next ›