English
Related papers

Related papers: A Physical Coherence Benchmark for Evaluating Vide…

200 papers

Video generation models have rapidly progressed, positioning themselves as video world models capable of supporting decision-making applications like robotics and autonomous driving. However, current benchmarks fail to rigorously evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dacheng Li , Yunhao Fang , Yukang Chen , Shuo Yang , Shiyi Cao , Justin Wong , Michael Luo , Xiaolong Wang , Hongxu Yin , Joseph E. Gonzalez , Ion Stoica , Song Han , Yao Lu

Text- and image-conditioned video generation models have achieved strong visual fidelity and temporal coherence, but they often fail to generate motion governed by kinematic and geometric constraints. In these settings, object parts must…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Rahul Jain , Mayank Patel , Asim Unmesh , Karthik Ramani

Video generation has advanced rapidly, with recent methods producing increasingly convincing animated results. However, existing benchmarks-largely designed for realistic videos-struggle to evaluate animation-style generation with its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Leyi Wu , Pengjun Fang , Kai Sun , Yazhou Xing , Yinwei Wu , Songsong Wang , Ziqi Huang , Dan Zhou , Yingqing He , Ying-Cong Chen , Qifeng Chen

Current video generation models produce high-quality aesthetic videos but often struggle to learn representations of real-world physics dynamics, resulting in artifacts such as unnatural object collisions, inconsistent gravity, and temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Siddarth Nilol Kundur Satish , Devesh Jaiswal , Hongyu Chen , Abhishek Bakshi

Video generative models show emerging reasoning behaviors. It is essential to ensure that generated events remain causally consistent across frames for reliable deployment, a property we define as reasoning coherence. To bridge the gap in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yu Qi , Xinyi Xu , Ziyu Guo , Siyuan Ma , Renrui Zhang , Xinyan Chen , Ruichuan An , Ruofan Xing , Jiayi Zhang , Haojie Huang , Pheng-Ann Heng , Jonathan Tremblay , Lawson L. S. Wong

Text-to-audio-video (T2AV) generation is central to applications such as filmmaking and world modeling. However, current models often fail to produce physically plausible sounds. Previous benchmarks primarily focus on audio-video temporal…

The vision and language generative models have been overgrown in recent years. For video generation, various open-sourced models and public-available services have been developed to generate high-quality videos. However, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yaofang Liu , Xiaodong Cun , Xuebo Liu , Xintao Wang , Yong Zhang , Haoxin Chen , Yang Liu , Tieyong Zeng , Raymond Chan , Ying Shan

World simulators can provide safe and scalable environments for training Physical AI systems before real-world deployment. Large video generation models are emerging as a promising basis for such simulators because they can generate diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Pu Zhao , Juyi Lin , Timothy Rupprecht , Arash Akbari , Chence Yang , Rahul Chowdhury , Elaheh Motamedi , Arman Akbari , Yumei He , Chen Wang , Geng Yuan , Weiwei Chen , Yanzhi Wang

Commercial video generation systems such as Seedance2.0 and Veo3.1 have rapidly improved, strengthening the view that video generators may be evolving into "world simulators." Yet the community still lacks a benchmark that directly tests…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Keming Wu , Yijing Cui , Wenhan Xue , Qijie Wang , Xuan Luo , Zhiyuan Feng , Zuhao Yang , Sudong Wang , Sicong Jiang , Haowei Zhu , Zihan Wang , Ping Nie , Wenhu Chen , Bin Wang

Video Diffusion Models (VDMs) offer a promising approach for simulating dynamic scenes and environments, with broad applications in robotics and media generation. However, existing models often generate temporally incoherent content that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhexiao Xiong , Yizhi Song , Liu He , Wei Xiong , Yu Yuan , Feng Qiao , Nathan Jacobs

Large-scale video generative models, capable of creating realistic videos of diverse visual concepts, are strong candidates for general-purpose physical world simulators. However, their adherence to physical commonsense across real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hritik Bansal , Clark Peng , Yonatan Bitton , Roman Goldenberg , Aditya Grover , Kai-Wei Chang

Recently, open-domain text-to-video (T2V) generation models have made remarkable progress. However, the promising results are mainly shown by the qualitative cases of generated videos, while the quantitative evaluation of T2V models still…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yuanxin Liu , Lei Li , Shuhuai Ren , Rundong Gao , Shicheng Li , Sishuo Chen , Xu Sun , Lu Hou

Text-to-video (T2V) generative models have advanced significantly, yet their ability to compose different objects, attributes, actions, and motions into a video remains unexplored. Previous text-to-video benchmarks also neglect this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Kaiyue Sun , Kaiyi Huang , Xian Liu , Yue Wu , Zihan Xu , Zhenguo Li , Xihui Liu

Understanding the physical world is a fundamental challenge in embodied AI, critical for enabling agents to perform complex tasks and operate safely in real-world environments. While Vision-Language Models (VLMs) have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Wei Chow , Jiageng Mao , Boyi Li , Daniel Seita , Vitor Guizilini , Yue Wang

Recent advances in text-to-video (T2V) generation have achieved good visual quality, yet synthesizing videos that faithfully follow physical laws remains an open challenge. Existing methods mainly based on graphics or prompt extension…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yuanhao Cai , Kunpeng Li , Menglin Jia , Jialiang Wang , Junzhe Sun , Feng Liang , Weifeng Chen , Felix Juefei-Xu , Chu Wang , Ali Thabet , Xiaoliang Dai , Xuan Ju , Alan Yuille , Ji Hou

Video generation assessment is essential for ensuring that generative models produce visually realistic, high-quality videos while aligning with human expectations. Current video generation benchmarks fall into two main categories:…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Hui Han , Siyuan Li , Jiaqi Chen , Yiwen Yuan , Yuling Wu , Chak Tou Leong , Hanwen Du , Junchen Fu , Youhua Li , Jie Zhang , Chi Zhang , Li-jia Li , Yongxin Ni

Recent text-to-video generation models have made remarkable progress in visual realism, motion fidelity, and text-video alignment, yet they still struggle to produce socially coherent behavior. Unlike humans, who readily infer intentions,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wenshuo Peng , Gongxuan Wang , Tianmeng Yang , Chuanhao Li , Xiaojie Xu , Hui He , Kaipeng Zhang

Recent advances in generative foundational models, often termed "world models," have propelled interest in applying them to critical tasks like robotic planning and autonomous system training. For reliable deployment, these models must…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Rishi Upadhyay , Howard Zhang , Jim Solomon , Ayush Agrawal , Pranay Boreddy , Shruti Satya Narayana , Yunhao Ba , Alex Wong , Celso M de Melo , Achuta Kadambi

Recent advances in video generation have been remarkable, enabling models to produce visually compelling videos with synchronized audio. While existing video generation benchmarks provide comprehensive metrics for visual quality, they lack…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Daili Hua , Xizhi Wang , Bohan Zeng , Xinyi Huang , Hao Liang , Junbo Niu , Xinlong Chen , Quanqing Xu , Wentao Zhang

While current video generation focuses on text or image conditions, practical applications like video editing and vlogging often need to seamlessly connect separate clips. In our work, we introduce Video Connecting, an innovative task that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Zhiyu Yin , Zhipeng Liu , Kehai Chen , Lemao Liu , Jin Liu , Hong-Dong Li , Yang Xiang , Min Zhang