English
Related papers

Related papers: Quantitative Video World Model Evaluation for Geom…

200 papers

Generative world models are increasingly used for video generation, where learned simulators are expected to capture the physical rules that govern real-world dynamics. However, evaluating whether generated videos actually follow these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Juyi Lin , Arash Akbari , Yumei He , Lin Zhao , Haichao Zhang , Arman Akbari , Xingchen Xu , Zoe Y. Lu , Enfu Nan , Hokin Deng , Edmund Yeh , Sarah Ostadabbas , Yun Fu , Jennifer Dy , Pu Zhao , Yanzhi Wang

Recent advancements in predictive models have demonstrated exceptional capabilities in predicting the future state of objects and scenes. However, the lack of categorization based on inherent characteristics continues to hinder the progress…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yiran Qin , Zhelun Shi , Jiwen Yu , Xijun Wang , Enshen Zhou , Lijun Li , Zhenfei Yin , Xihui Liu , Lu Sheng , Jing Shao , Lei Bai , Wanli Ouyang , Ruimao Zhang

The rapid evolution of video generation has enabled models to simulate complex physical dynamics and long-horizon causalities, positioning them as potential world simulators. However, a critical gap still remains between the theoretical…

Image and Video Processing · Electrical Eng. & Systems 2026-05-06 Muyang He , Hanzhong Guo , Junxiong Lin , Yizhou Yu

Video generation models have developed rapidly in recent years, where generating natural human motion plays a pivotal role. However, accurately evaluating the quality of generated human motion video remains a significant challenge. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Bingzi Zhang , Kaisi Guan , Ruihua Song

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches depend on templates, are effective only in quasi-static scenes, or fail to model 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Qianqian Wang , Vickie Ye , Hang Gao , Weijia Zeng , Jake Austin , Zhengqi Li , Angjoo Kanazawa

Video generation models have made significant progress in generating realistic content, enabling applications in simulation, gaming, and film making. However, current generated videos still contain visual artifacts arising from 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Duolikun Danier , Ge Gao , Steven McDonagh , Changjian Li , Hakan Bilen , Oisin Mac Aodha

Geometric distortions and blurring caused by atmospheric turbulence degrade the quality of long-range dynamic scene videos. Existing methods struggle with restoring edge details and eliminating mixed distortions, especially under conditions…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Tao Wu , Jingyuan Ye , Ying Fu

To address the data scarcity associated with 3D assets, 2D-lifting techniques such as Score Distillation Sampling (SDS) have become a widely adopted practice in text-to-3D generation pipelines. However, the diffusion models used in these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Utkarsh Nath , Rajeev Goel , Eun Som Jeon , Changhoon Kim , Kyle Min , Yezhou Yang , Yingzhen Yang , Pavan Turaga

Predictive world models that simulate future observations under explicit camera control are fundamental to interactive AI. Despite rapid advances, current systems lack spatial persistence: they fail to maintain stable scene structures over…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chendong Xiang , Jiajun Liu , Jintao Zhang , Xiao Yang , Zhengwei Fang , Shizun Wang , Zijun Wang , Yingtian Zou , Hang Su , Jun Zhu

Reconstructing complete 3D shapes from incomplete or noisy observations is a fundamentally ill-posed problem that requires balancing measurement consistency with shape plausibility. Existing methods for shape reconstruction can achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Linus Härenstam-Nielsen , Dmitrii Pozdeev , Thomas Dagès , Nikita Araslanov , Daniel Cremers

Video generative models can be regarded as world simulators due to their ability to capture dynamic, continuous changes inherent in real-world environments. These models integrate high-dimensional information across visual, temporal,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Hengyuan Cao , Yutong Feng , Biao Gong , Yijing Tian , Yunhong Lu , Chuang Liu , Bin Wang

Recent advances in deep generative models have lead to remarkable progress in synthesizing high quality images. Following their successful application in image processing and representation learning, an important next step is to consider…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Thomas Unterthiner , Sjoerd van Steenkiste , Karol Kurach , Raphael Marinier , Marcin Michalski , Sylvain Gelly

Due to the statistical complexity of video, the high degree of inherent stochasticity, and the sheer amount of data, generating natural video remains a challenging task. State-of-the-art video generation models often attempt to address…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Dirk Weissenborn , Oscar Täckström , Jakob Uszkoreit

We present two major contributions in this work: 1) we create a full HD resolution stereoscopic (S3D) video dataset comprised of 12 reference and 360 distorted videos. The test stimuli are produced by simulating the five levels of fog and…

Multimedia · Computer Science 2024-12-02 Sria Biswas , Balasubramanyam Appina , Priyanka Kokil , Sumohana S Channappayya

We propose a perceptual video quality assessment (PVQA) metric for distorted videos by analyzing the power spectral density (PSD) of a group of pictures. This is an estimation approach that relies on the changes in video dynamic calculated…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Mohammed A. Aabed , Gukyeong Kwon , Ghassan AlRegib

For bandwidth-constrained multimedia applications, simultaneously achieving ultra-low bitrate human video compression and accurate vertex prediction remains a critical challenge, as it demands the harmonization of dynamic motion modeling,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Bolin Chen , Ru-Ling Liao , Yan Ye , Jie Chen , Shanzhi Yin , Xinrui Ju , Shiqi Wang , Yibo Fan

As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yinmin Zhang , Xinzhu Ma , Shuai Yi , Jun Hou , Zhihui Wang , Wanli Ouyang , Dan Xu

Embodied AI training and evaluation require object-centric digital twin environments with accurate metric geometry and semantic grounding. Recent transformer-based feedforward reconstruction methods can efficiently predict global point…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Quanyun Wu , Kyle Gao , Daniel Long , David A. Clausi , Jonathan Li , Yuhao Chen

Video generation has achieved remarkable progress, with generated videos increasingly resembling real ones. However, the rapid advance in generation has outpaced the development of adequate evaluation metrics. Currently, the assessment of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Nabyl Quignon , Baptiste Chopin , Yaohui Wang , Antitza Dantcheva

Recent progress in video generation has led to impressive visual quality, yet current models still struggle to produce results that align with real-world physical principles. To this end, we propose an iterative self-refinement framework…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yang Liu , Xilin Zhao , Peisong Wen , Siran Dai , Qingming Huang