中文
相关论文

相关论文: A Physical Coherence Benchmark for Evaluating Vide…

200 篇论文

Recent advances in diffusion-based and autoregressive video generation models have achieved remarkable visual realism. However, these models typically lack accurate physical alignment, failing to replicate real-world dynamics in object…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Tao Feng , Xianbing Zhao , Zhenhua Chen , Tien Tsin Wong , Hamid Rezatofighi , Gholamreza Haffari , Lizhen Qu

Despite significant advances in video generation, synthesizing physically plausible human actions remains a persistent challenge, particularly in modeling fine-grained semantics and complex temporal dynamics. For instance, generating…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Dian Shao , Mingfei Shi , Shengda Xu , Haodong Chen , Yongle Huang , Binglu Wang

Recent years have witnessed an exponential increase in the demand for face video compression, and the success of artificial intelligence has expanded the boundaries beyond traditional hybrid video coding. Generative coding approaches have…

图像与视频处理 · 电气工程与系统科学 2023-10-31 Yixuan Li , Bolin Chen , Baoliang Chen , Meng Wang , Shiqi Wang , Weisi Lin

Recent advances in model architectures, compute, and data scale have driven rapid progress in video generation, producing increasingly realistic content. Yet, no prior method systematically measures how faithfully these systems render human…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Yusu Fang , Tiange Xiang , Tian Tan , Narayan Schuetz , Scott Delp , Li Fei-Fei , Ehsan Adeli

Existing benchmarks fail to capture a crucial aspect of intelligence: physical reasoning, the integrated ability to combine domain knowledge, symbolic reasoning, and understanding of real-world constraints. To address this gap, we introduce…

Physics problem-solving is a challenging domain for AI models, requiring integration of conceptual understanding, mathematical reasoning, and interpretation of physical diagrams. Existing evaluations fail to capture the full breadth and…

Instructional video generation is an emerging task that aims to synthesize coherent demonstrations of procedural activities from textual descriptions. Such capability has broad implications for content creation, education, and human-AI…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Cheeun Hong , German Barquero , Fadime Sener , Markos Georgopoulos , Edgar Schönfeld , Stefan Popov , Yuming Du , Oscar Mañas , Albert Pumarola

Recent advancements in video generation models, like Stable Video Diffusion, show promising results, but primarily focus on short, single-scene videos. These models struggle with generating long videos that involve multiple scenes, coherent…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Weijia Wu , Mingyu Liu , Zeyu Zhu , Xi Xia , Haoen Feng , Wen Wang , Kevin Qinghong Lin , Chunhua Shen , Mike Zheng Shou

Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Zhiyu Yin , Kehai Chen , Xuefeng Bai , Ruili Jiang , Juntao Li , Hongdong Li , Jin Liu , Yang Xiang , Jun Yu , Min Zhang

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

Recent advances in video generation have enabled high-fidelity video synthesis from user provided prompts. However, existing models and benchmarks fail to capture the complexity and requirements of professional video generation. Towards…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Agneet Chatterjee , Rahim Entezari , Maksym Zhuravinskyi , Maksim Lapin , Reshinth Adithyan , Amit Raj , Chitta Baral , Yezhou Yang , Varun Jampani

Layout-guided text-to-image models offer greater control over the generation process by explicitly conditioning image synthesis on the spatial arrangement of elements. As a result, their adoption has increased in many computer vision…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Elena Izzo , Luca Parolari , Davide Vezzaro , Lamberto Ballan

Accurately estimating humans' subjective feedback on video fluency, e.g., motion consistency and frame continuity, is crucial for various applications like streaming and gaming. Yet, it has long been overlooked, as prior arts have focused…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Qizhi Xie , Kun Yuan , Yunpeng Qu , Ming Sun , Chao Zhou , Jihong Zhu

Text-to-video (T2V) generation models have made rapid progress in producing visually high-quality and temporally coherent videos. However, existing benchmarks primarily focus on perceptual quality, text-video alignment, or physical…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Xianjing Han , Bin Zhu , Shiqi Hu , Franklin Mingzhe Li , Patrick Carrington , Roger Zimmermann , Jingjing Chen

Physics-aware symbolic simulation of 3D scenes is critical for robotics, embodied AI, and scientific computing, requiring models to understand natural language descriptions of physical phenomena and translate them into executable simulation…

机器人学 · 计算机科学 2026-04-28 Tianyidan Xie , Peiyu Wang , Yuyi Qian , Yuxuan Wang , Rui Ma , Ying Tai , Song Wu , Qian Wang , Lanjun Wang , Zili Yi

Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation. This gap highlights a critical limitation in rendering rigid body motion, a core tenet of…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Qiyuan Zhang , Biao Gong , Shuai Tan , Zheng Zhang , Yujun Shen , Xing Zhu , Yuyuan Li , Kelu Yao , Chunhua Shen , Changqing Zou

Traditional fluid dynamics simulation pipelines combine numerical solvers with rendering, producing highly realistic results but at considerable computational cost. Diffusion-based generative video models offer a faster alternative, yet…

图形学 · 计算机科学 2026-03-18 Yang Bai , George Eskandar , Ziyuan Liu , Gitta Kutyniok

Video understanding requires models to continuously track and update world state during playback. While existing benchmarks have advanced video understanding evaluation across multiple dimensions, the observation of how models maintain…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Pengyiang Liu , Zhongyue Shi , Hongye Hao , Qi Fu , Xueting Bi , Siwei Zhang , Xiaoyang Hu , Zitian Wang , Linjiang Huang , Si Liu

Over the years, performance evaluation has become essential in computer vision, enabling tangible progress in many sub-fields. While talking-head video generation has become an emerging research topic, existing evaluations on this topic…

计算机视觉与模式识别 · 计算机科学 2020-05-08 Lele Chen , Guofeng Cui , Ziyi Kou , Haitian Zheng , Chenliang Xu

Scene generation has extensive industrial applications, demanding both high realism and precise control over geometry and appearance. Language-driven retrieval methods compose plausible scenes from a large object database, but overlook…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Zhifei Yang , Guangyao Zhai , Keyang Lu , YuYang Yin , Chao Zhang , Zhen Xiao , Jieyi Long , Nassir Navab , Yikai Wang