中文
相关论文

相关论文: Quantitative Video World Model Evaluation for Geom…

200 篇论文

Generative world models are increasingly used for video generation, where learned simulators are expected to capture the physical rules that govern real-world dynamics. However, evaluating whether generated videos actually follow these…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Juyi Lin , Arash Akbari , Yumei He , Lin Zhao , Haichao Zhang , Arman Akbari , Xingchen Xu , Zoe Y. Lu , Enfu Nan , Hokin Deng , Edmund Yeh , Sarah Ostadabbas , Yun Fu , Jennifer Dy , Pu Zhao , Yanzhi Wang

Recent advancements in predictive models have demonstrated exceptional capabilities in predicting the future state of objects and scenes. However, the lack of categorization based on inherent characteristics continues to hinder the progress…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Yiran Qin , Zhelun Shi , Jiwen Yu , Xijun Wang , Enshen Zhou , Lijun Li , Zhenfei Yin , Xihui Liu , Lu Sheng , Jing Shao , Lei Bai , Wanli Ouyang , Ruimao Zhang

The rapid evolution of video generation has enabled models to simulate complex physical dynamics and long-horizon causalities, positioning them as potential world simulators. However, a critical gap still remains between the theoretical…

图像与视频处理 · 电气工程与系统科学 2026-05-06 Muyang He , Hanzhong Guo , Junxiong Lin , Yizhou Yu

Video generation models have developed rapidly in recent years, where generating natural human motion plays a pivotal role. However, accurately evaluating the quality of generated human motion video remains a significant challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Bingzi Zhang , Kaisi Guan , Ruihua Song

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches depend on templates, are effective only in quasi-static scenes, or fail to model 3D…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Qianqian Wang , Vickie Ye , Hang Gao , Weijia Zeng , Jake Austin , Zhengqi Li , Angjoo Kanazawa

Video generation models have made significant progress in generating realistic content, enabling applications in simulation, gaming, and film making. However, current generated videos still contain visual artifacts arising from 3D…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Duolikun Danier , Ge Gao , Steven McDonagh , Changjian Li , Hakan Bilen , Oisin Mac Aodha

Geometric distortions and blurring caused by atmospheric turbulence degrade the quality of long-range dynamic scene videos. Existing methods struggle with restoring edge details and eliminating mixed distortions, especially under conditions…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Tao Wu , Jingyuan Ye , Ying Fu

To address the data scarcity associated with 3D assets, 2D-lifting techniques such as Score Distillation Sampling (SDS) have become a widely adopted practice in text-to-3D generation pipelines. However, the diffusion models used in these…

计算机视觉与模式识别 · 计算机科学 2025-01-23 Utkarsh Nath , Rajeev Goel , Eun Som Jeon , Changhoon Kim , Kyle Min , Yezhou Yang , Yingzhen Yang , Pavan Turaga

Predictive world models that simulate future observations under explicit camera control are fundamental to interactive AI. Despite rapid advances, current systems lack spatial persistence: they fail to maintain stable scene structures over…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Chendong Xiang , Jiajun Liu , Jintao Zhang , Xiao Yang , Zhengwei Fang , Shizun Wang , Zijun Wang , Yingtian Zou , Hang Su , Jun Zhu

Reconstructing complete 3D shapes from incomplete or noisy observations is a fundamentally ill-posed problem that requires balancing measurement consistency with shape plausibility. Existing methods for shape reconstruction can achieve…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Linus Härenstam-Nielsen , Dmitrii Pozdeev , Thomas Dagès , Nikita Araslanov , Daniel Cremers

Video generative models can be regarded as world simulators due to their ability to capture dynamic, continuous changes inherent in real-world environments. These models integrate high-dimensional information across visual, temporal,…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Hengyuan Cao , Yutong Feng , Biao Gong , Yijing Tian , Yunhong Lu , Chuang Liu , Bin Wang

Recent advances in deep generative models have lead to remarkable progress in synthesizing high quality images. Following their successful application in image processing and representation learning, an important next step is to consider…

计算机视觉与模式识别 · 计算机科学 2019-03-28 Thomas Unterthiner , Sjoerd van Steenkiste , Karol Kurach , Raphael Marinier , Marcin Michalski , Sylvain Gelly

Due to the statistical complexity of video, the high degree of inherent stochasticity, and the sheer amount of data, generating natural video remains a challenging task. State-of-the-art video generation models often attempt to address…

计算机视觉与模式识别 · 计算机科学 2020-02-12 Dirk Weissenborn , Oscar Täckström , Jakob Uszkoreit

We present two major contributions in this work: 1) we create a full HD resolution stereoscopic (S3D) video dataset comprised of 12 reference and 360 distorted videos. The test stimuli are produced by simulating the five levels of fog and…

多媒体 · 计算机科学 2024-12-02 Sria Biswas , Balasubramanyam Appina , Priyanka Kokil , Sumohana S Channappayya

We propose a perceptual video quality assessment (PVQA) metric for distorted videos by analyzing the power spectral density (PSD) of a group of pictures. This is an estimation approach that relies on the changes in video dynamic calculated…

计算机视觉与模式识别 · 计算机科学 2018-12-14 Mohammed A. Aabed , Gukyeong Kwon , Ghassan AlRegib

For bandwidth-constrained multimedia applications, simultaneously achieving ultra-low bitrate human video compression and accurate vertex prediction remains a critical challenge, as it demands the harmonization of dynamic motion modeling,…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Bolin Chen , Ru-Ling Liao , Yan Ye , Jie Chen , Shanzhi Yin , Xinrui Ju , Shiqi Wang , Yibo Fan

As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Yinmin Zhang , Xinzhu Ma , Shuai Yi , Jun Hou , Zhihui Wang , Wanli Ouyang , Dan Xu

Embodied AI training and evaluation require object-centric digital twin environments with accurate metric geometry and semantic grounding. Recent transformer-based feedforward reconstruction methods can efficiently predict global point…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Quanyun Wu , Kyle Gao , Daniel Long , David A. Clausi , Jonathan Li , Yuhao Chen

Video generation has achieved remarkable progress, with generated videos increasingly resembling real ones. However, the rapid advance in generation has outpaced the development of adequate evaluation metrics. Currently, the assessment of…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Nabyl Quignon , Baptiste Chopin , Yaohui Wang , Antitza Dantcheva

Recent progress in video generation has led to impressive visual quality, yet current models still struggle to produce results that align with real-world physical principles. To this end, we propose an iterative self-refinement framework…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Yang Liu , Xilin Zhao , Peisong Wen , Siran Dai , Qingming Huang