English
Related papers

Related papers: MoRe: Motion-aware Feed-forward 4D Reconstruction …

200 papers

Reconstructing dense geometry for dynamic scenes from a monocular video is a critical yet challenging task. Recent memory-based methods enable efficient online reconstruction, but they fundamentally suffer from a Memory Demand Dilemma: The…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Xudong Cai , Shuo Wang , Peng Wang , Yongcai Wang , Zhaoxin Fan , Wanting Li , Tianbao Zhang , Jianrong Tao , Yeying Jin , Deying Li

Reconstructing an accurate 3D object model from a few image observations remains a challenging problem in computer vision. State-of-the-art approaches typically assume accurate camera poses as input, which could be difficult to obtain in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zhenpei Yang , Zhile Ren , Miguel Angel Bautista , Zaiwei Zhang , Qi Shan , Qixing Huang

Monocular 3D foundation models offer an extensible solution for perception tasks, making them attractive for broader 3D vision applications. In this paper, we propose MoRe, a training-free Monocular Geometry Refinement method designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Dongki Jung , Jaehoon Choi , Yonghan Lee , Sungmin Eum , Heesung Kwon , Dinesh Manocha

Reconstructing and tracking dynamic 3D scenes remains a fundamental challenge in computer vision. Existing approaches often decouple geometry from motion: multi-view reconstruction methods assume static scenes, while dynamic tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Shenhan Qian , Ganlin Zhang , Shangzhe Wu , Daniel Cremers

Existing methods for the 4D reconstruction of general, non-rigidly deforming objects focus on novel-view synthesis and neglect correspondences. However, time consistency enables advanced downstream tasks like 3D editing, motion analysis, or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Edith Tretschk , Vladislav Golyanik , Michael Zollhoefer , Aljaz Bozic , Christoph Lassner , Christian Theobalt

Motion segmentation in dynamic scenes is highly challenging, as conventional methods heavily rely on estimating camera poses and point correspondences from inherently noisy motion cues. Existing statistical inference or iterative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Xiankang He , Peile Lin , Ying Cui , Dongyan Guo , Chunhua Shen , Xiaoqin Zhang

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

There has been extensive progress in the reconstruction and generation of 4D scenes from monocular casually-captured video. While these tasks rely heavily on known camera poses, the problem of finding such poses using structure-from-motion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Lily Goli , Sara Sabour , Mark Matthews , Marcus Brubaker , Dmitry Lagun , Alec Jacobson , David J. Fleet , Saurabh Saxena , Andrea Tagliasacchi

We present 4DNeX, the first feed-forward framework for generating 4D (i.e., dynamic 3D) scene representations from a single image. In contrast to existing methods that rely on computationally intensive optimization or require multi-frame…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Zhaoxi Chen , Tianqi Liu , Long Zhuo , Jiawei Ren , Zeng Tao , He Zhu , Fangzhou Hong , Liang Pan , Ziwei Liu

3D reconstruction, which aims to recover the dense three-dimensional structure of a scene, is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics. While traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Wei Zhang , Yihang Wu , Songhua Li , Wenjie Ma , Xin Ma , Qiang Li , Qi Wang

Reliable autonomous driving systems require accurate detection of traffic participants. To this end, multi-modal fusion has emerged as an effective strategy. In particular, 4D radar and LiDAR fusion methods based on multi-frame radar point…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Xiangyuan Peng , Yu Wang , Miao Tang , Bierzynski Kay , Lorenzo Servadei , Robert Wille

We present MoVieS, a Motion-aware View Synthesis model that reconstructs 4D dynamic scenes from monocular videos in one second. It represents dynamic 3D scenes with pixel-aligned Gaussian primitives and explicitly supervises their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chenguo Lin , Yuchen Lin , Panwang Pan , Yifan Yu , Tao Hu , Honglei Yan , Katerina Fragkiadaki , Yadong Mu

Learning to understand dynamic 3D scenes from imagery is crucial for applications ranging from robotics to scene reconstruction. Yet, unlike other problems where large-scale supervised training has enabled rapid progress, directly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Linyi Jin , Richard Tucker , Zhengqi Li , David Fouhey , Noah Snavely , Aleksander Holynski

Creating deformable 3D content has gained increasing attention with the rise of text-to-image and image-to-video generative models. While these models provide rich semantic priors for appearance, they struggle to capture the physical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jixuan He , Chieh Hubert Lin , Lu Qi , Ming-Hsuan Yang

Continual learning requires models to adapt to new data while preserving previously acquired knowledge. At its core, this challenge can be viewed as principled one-step adaptation: incorporating new information with minimal interference to…

Machine Learning · Computer Science 2026-05-21 Jiaqi Sun , Boyang Sun , Rasmy M. H. , Xiangchen Song , Kun Zhang

Reconstructing dynamic 4D scenes is challenging, as it requires robust disentanglement of dynamic objects from the static background. While 3D foundation models like VGGT provide accurate 3D geometry, their performance drops markedly when…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yu Hu , Chong Cheng , Sicheng Yu , Xiaoyang Guo , Hao Wang

3D scene reconstruction is a long-standing vision task. Existing approaches can be categorized into geometry-based and learning-based methods. The former leverages multi-view geometry but can face catastrophic failures due to the reliance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Zhao

We present 4RC, a unified feed-forward framework for 4D reconstruction from monocular videos. Unlike existing approaches that typically decouple motion from geometry or produce limited 4D attributes such as sparse trajectories or two-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yihang Luo , Shangchen Zhou , Yushi Lan , Xingang Pan , Chen Change Loy

Existing techniques for dynamic scene reconstruction from multiple wide-baseline cameras primarily focus on reconstruction in controlled environments, with fixed calibrated cameras and strong prior constraints. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Armin Mustafa , Marco Volino , Hansung Kim , Jean-Yves Guillemaut , Adrian Hilton

Reconstructing fast-dynamic scenes from multi-view videos is crucial for high-speed motion analysis and realistic 4D reconstruction. However, the majority of 4D capture systems are limited to frame rates below 30 FPS (frames per second),…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yutian Chen , Shi Guo , Tianshuo Yang , Lihe Ding , Xiuyuan Yu , Jinwei Gu , Tianfan Xue