中文
相关论文

相关论文: A Physical Coherence Benchmark for Evaluating Vide…

200 篇论文

We propose a novel text-to-video (T2V) generation benchmark, ChronoMagic-Bench, to evaluate the temporal and metamorphic capabilities of the T2V models (e.g. Sora and Lumiere) in time-lapse video generation. In contrast to existing…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Shenghai Yuan , Jinfa Huang , Yongqi Xu , Yaoyang Liu , Shaofeng Zhang , Yujun Shi , Ruijie Zhu , Xinhua Cheng , Jiebo Luo , Li Yuan

The training of controllable text-to-video (T2V) models relies heavily on the alignment between videos and captions, yet little existing research connects video caption evaluation with T2V generation assessment. This paper introduces…

Video generation has achieved remarkable progress, with generated videos increasingly resembling real ones. However, the rapid advance in generation has outpaced the development of adequate evaluation metrics. Currently, the assessment of…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Nabyl Quignon , Baptiste Chopin , Yaohui Wang , Antitza Dantcheva

Despite recent progress in video generation, producing videos that adhere to physical laws remains a significant challenge. Traditional diffusion-based methods struggle to extrapolate to unseen physical conditions (eg, velocity) due to…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Wang Lin , Liyu Jia , Wentao Hu , Kaihang Pan , Zhongqi Yue , Wei Zhao , Jingyuan Chen , Fei Wu , Hanwang Zhang

Recent progress in video generation has led to substantial improvements in visual fidelity, yet ensuring physically consistent motion remains a fundamental challenge. Intuitively, this limitation can be attributed to the fact that…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Cong Wang , Hanxin Zhu , Xiao Tang , Jiayi Luo , Xin Jin , Long Chen , Zhibo Chen

Generating videos of complex human motions such as flips, cartwheels, and martial arts remains challenging for current video diffusion models. Text-only conditioning is temporally ambiguous for fine-grained motion control, while explicit…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Ashkan Taghipour , Morteza Ghahremani , Zinuo Li , Hamid Laga , Farid Boussaid , Mohammed Bennamoun

Video generative models have made remarkable progress, yet they often yield visual artifacts that violate grounding in physical dynamics. Recent works such as PhysGen3D tackle single image-to-3D physics through mesh reconstruction and…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Hwidong Kim , Yunho Kim , Tae-Kyun Kim

Significant advancements have been made in video generative models recently. Unlike image generation, video generation presents greater challenges, requiring not only generating high-quality frames but also ensuring temporal consistency…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Jiahe Liu , Youran Qu , Qi Yan , Xiaohui Zeng , Lele Wang , Renjie Liao

Synthetic videos nowadays is widely used to complement data scarcity and diversity of real-world videos. Current synthetic datasets primarily replicate real-world scenarios, leaving impossible, counterfactual and anti-reality video concepts…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Zechen Bai , Hai Ci , Mike Zheng Shou

Interactive world models are advancing rapidly, yet existing benchmarks cover only part of the required competencies, leaving no unified standard for systematic evaluation. To fill this gap, we introduce WBench, a comprehensive multi-turn…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Kaining Ying , Hengrui Hu , Siyu Ren , Jiamu Li , Fengjiao Chen , Ziwen Wang , Xuezhi Cao , Xunliang Cai , Henghui Ding

Existing video generation models excel at producing photo-realistic videos from text or images, but often lack physical plausibility and 3D controllability. To overcome these limitations, we introduce PhysCtrl, a novel framework for…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Chen Wang , Chuhao Chen , Yiming Huang , Zhiyang Dou , Yuan Liu , Jiatao Gu , Lingjie Liu

The rapid evolution of video generative models has shifted their focus from producing visually plausible outputs to tackling tasks requiring physical plausibility and logical consistency. However, despite recent breakthroughs such as Veo…

Physically Plausible Video Generation (PPVG) has emerged as a promising avenue for modeling real-world physical phenomena. PPVG requires an understanding of commonsense knowledge, which remains a challenge for video diffusion models.…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Zixuan Wang , Yixin Hu , Haolan Wang , Feng Chen , Yan Liu , Wen Li , Yinjie Lei

This paper reports on the LoViF 2026 PhyScore challenge, a competition on holistic quality assessment of world-model-generated videos across both 2D and 4D generation settings. The challenge is motivated by a central gap in current…

Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. However, state-of-the-art video diffusion models frequently produce implausible results such as…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Siwei Meng , Yawei Luo , Ping Liu

Recent advancements in video generation have witnessed significant progress, especially with the rapid advancement of diffusion models. Despite this, their deficiencies in physical cognition have gradually received widespread attention -…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Minghui Lin , Xiang Wang , Yishan Wang , Shu Wang , Fengqi Dai , Pengxiang Ding , Cunxiang Wang , Zhengrong Zuo , Nong Sang , Siteng Huang , Donglin Wang

Generating realistic human motion is a central yet unsolved challenge in video generation. While reinforcement learning (RL)-based post-training has driven recent gains in general video quality, extending it to human motion remains…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Yidong Huang , Zun Wang , Han Lin , Dong-Ki Kim , Shayegan Omidshafiei , Jaehong Yoon , Jaemin Cho , Yue Zhang , Mohit Bansal

The rapid advancement of video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models, primarily due to simple prompts that cannot showcase the model's capabilities, fixed evaluation operators…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Yuhang Yang , Ke Fan , Shangkun Sun , Hongxiang Li , Ailing Zeng , FeiLin Han , Wei Zhai , Wei Liu , Yang Cao , Zheng-Jun Zha

Autonomous driving requires robust perception models trained on high-quality, large-scale multi-view driving videos for tasks like 3D object detection, segmentation and trajectory prediction. While world models provide a cost-effective…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Zhuoran Yang , Xi Guo , Chenjing Ding , Chiyu Wang , Wei Wu

A current limitation of video generative video models is that they generate plausible looking frames, but poor motion -- an issue that is not well captured by FVD and other popular methods for evaluating generated videos. Here we go beyond…