English
Related papers

Related papers: Temporally Coherent General Dynamic Scene Reconstr…

200 papers

Reconstructing fast-dynamic scenes from multi-view videos is crucial for high-speed motion analysis and realistic 4D reconstruction. However, the majority of 4D capture systems are limited to frame rates below 30 FPS (frames per second),…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yutian Chen , Shi Guo , Tianshuo Yang , Lihe Ding , Xiuyuan Yu , Jinwei Gu , Tianfan Xue

Despite the impressive progress of telepresence systems for room-scale scenes with static and dynamic scene entities, expanding their capabilities to scenarios with larger dynamic environments beyond a fixed size of a few square-meters…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Leif Van Holland , Patrick Stotko , Stefan Krumpen , Reinhard Klein , Michael Weinmann

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Scene reconstruction from multi-view images is a fundamental problem in computer vision and graphics. Recent neural implicit surface reconstruction methods have achieved high-quality results; however, editing and manipulating the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xiaoyang Lyu , Chirui Chang , Peng Dai , Yang-Tian Sun , Xiaojuan Qi

Dense 3D reconstruction and ego-motion estimation are key challenges in autonomous driving and robotics. Compared to the complex, multi-modal systems deployed today, multi-camera systems provide a simpler, low-cost alternative. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Aron Schmied , Tobias Fischer , Martin Danelljan , Marc Pollefeys , Fisher Yu

Synthesizing novel views from monocular videos of dynamic scenes remains a challenging problem. Scene-specific methods that optimize 4D representations with explicit motion priors often break down in highly dynamic regions where multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Thomas Tanay , Mohammed Brahimi , Michal Nazarczuk , Qingwen Zhang , Sibi Catley-Chandar , Arthur Moreau , Zhensong Zhang , Eduardo Pérez-Pellitero

Learning to understand dynamic 3D scenes from imagery is crucial for applications ranging from robotics to scene reconstruction. Yet, unlike other problems where large-scale supervised training has enabled rapid progress, directly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Linyi Jin , Richard Tucker , Zhengqi Li , David Fouhey , Noah Snavely , Aleksander Holynski

Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Heyu Si , Brandon James Denis , Muyang Sun , Dragos Datcu , Yaoru Li , Xin Jin , Ruiju Fu , Yuliia Tatarinova , Federico Landi , Jie Song , Mingli Song , Qi Guo

Reconstructing dynamic 4D scenes is challenging, as it requires robust disentanglement of dynamic objects from the static background. While 3D foundation models like VGGT provide accurate 3D geometry, their performance drops markedly when…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yu Hu , Chong Cheng , Sicheng Yu , Xiaoyang Guo , Hao Wang

High-dynamic scene reconstruction aims to represent static background with rigid spatial features and dynamic objects with deformed continuous spatiotemporal features. Typically, existing methods adopt unified representation model (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Hanyu Zhou , Haonan Wang , Haoyue Liu , Yuxing Duan , Luxin Yan , Gim Hee Lee

Capturing general deforming scenes from monocular RGB video is crucial for many computer graphics and vision applications. However, current approaches suffer from drawbacks such as struggling with large scene deformations, inaccurate shape…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Erik C. M. Johnson , Marc Habermann , Soshi Shimada , Vladislav Golyanik , Christian Theobalt

Existing methods for reconstructing objects and humans from a monocular image suffer from severe mesh collisions and performance limitations for interacting occluding objects. This paper introduces a method to obtain a globally consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Sarthak Batra , Partha P. Chakrabarti , Simon Hadfield , Armin Mustafa

Recovering 4D from monocular video, which jointly estimates dynamic geometry and camera poses, is an inevitably challenging problem. While recent pointmap-based 3D reconstruction methods (e.g., DUSt3R) have made great progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Shizun Wang , Zhenxiang Jiang , Xingyi Yang , Xinchao Wang

3D reconstruction and novel view synthesis are critical for validating autonomous driving systems and training advanced perception models. Recent self-supervised methods have gained significant attention due to their cost-effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xiao Tang , Guirong Zhuo , Cong Wang , Boyuan Zheng , Minqing Huang , Lianqing Zheng , Long Chen , Shouyi Lu

Scenes in the real world are often composed of several static and dynamic objects. Capturing their 4-dimensional structures, composition and spatio-temporal configuration in-the-wild, though extremely interesting, is equally hard.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ahmet Berke Gokmen , Ajad Chhatkuli , Luc Van Gool , Danda Pani Paudel

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

3D meshes are widely used in computer vision and graphics for their efficiency in animation and minimal memory use, playing a crucial role in movies, games, AR, and VR. However, creating temporally consistent and realistic textures for mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Jingzhi Bao , Xueting Li , Ming-Hsuan Yang

Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes. Compared to traditional frame-based cameras, event cameras produce sparse yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Chuanzhi Xu , Haoxian Zhou , Langyi Chen , Haodong Chen , Zeke Zexi Hu , Zhicheng Lu , Ying Zhou , Vera Chung , Qiang Qu , Weidong Cai

This paper aims to address the challenge of reconstructing long volumetric videos from multi-view RGB videos. Recent dynamic view synthesis methods leverage powerful 4D representations, like feature grids or point cloud sequences, to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhen Xu , Yinghao Xu , Zhiyuan Yu , Sida Peng , Jiaming Sun , Hujun Bao , Xiaowei Zhou

Dense 3D reconstruction and tracking of dynamic scenes from monocular video remains an important open challenge in computer vision. Progress in this area has been constrained by the scarcity of high-quality datasets with dense, complete,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zeren Jiang , Yushi Lan , Yihang Luo , Yufan Deng , Zihang Lai , Edgar Sucar , Christian Rupprecht , Iro Laina , Diane Larlus , Chuanxia Zheng , Andrea Vedaldi