English
Related papers

Related papers: Efficiently Reconstructing Dynamic Scenes One D4RT…

200 papers

Creating deformable 3D content has gained increasing attention with the rise of text-to-image and image-to-video generative models. While these models provide rich semantic priors for appearance, they struggle to capture the physical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jixuan He , Chieh Hubert Lin , Lu Qi , Ming-Hsuan Yang

The synthesis of spatiotemporally coherent 4D content presents fundamental challenges in computer vision, requiring simultaneous modeling of high-fidelity spatial representations and physically plausible temporal dynamics. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyan Liu , Kangrui Li , Yuehao Song , Jiaxin Liu

Reconstructing dynamic 4D scenes remains challenging due to the presence of moving objects that corrupt camera pose estimation. Existing optimization methods alleviate this issue with additional supervision, but they are mostly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Juntong Fang , Zequn Chen , Weiqi Zhang , Donglin Di , Xuancheng Zhang , Chengmin Yang , Yu-Shen Liu

This paper addresses the long-standing challenge of reconstructing 3D structures from videos with dynamic content. Current approaches to this problem were not designed to operate on casual videos recorded by standard cameras or require a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yoni Kasten , Wuyue Lu , Haggai Maron

Dynamic scene reconstruction in autonomous driving remains a fundamental challenge due to significant temporal variations, moving objects, and complex scene dynamics. Existing feed-forward 3D models have demonstrated strong performance in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhuolin He , Jing Li , Guanghao Li , Xiaolei Chen , Jiacheng Tang , Siyang Zhang , Zhounan Jin , Feipeng Cai , Bin Li , Jian Pu , Jia Cai , Xiangyang Xue

We introduce Geo4D, a method to repurpose video diffusion models for monocular 3D reconstruction of dynamic scenes. By leveraging the strong dynamic priors captured by large-scale pre-trained video models, Geo4D can be trained using only…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Zeren Jiang , Chuanxia Zheng , Iro Laina , Diane Larlus , Andrea Vedaldi

Existing deep methods produce highly accurate 3D reconstructions in stereo and multiview stereo settings, i.e., when cameras are both internally and externally calibrated. Nevertheless, the challenge of simultaneous recovery of camera poses…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Dror Moran , Hodaya Koslowsky , Yoni Kasten , Haggai Maron , Meirav Galun , Ronen Basri

Most SLAM algorithms are based on the assumption that the scene is static. However, in practice, most scenes are dynamic which usually contains moving objects, these methods are not suitable. In this paper, we introduce DymSLAM, a dynamic…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Chenjie Wang , Bin Luo , Yun Zhang , Qing Zhao , Lu Yin , Wei Wang , Xin Su , Yajun Wang , Chengyuan Li

Stereo videos for the dynamic scenes often show unpleasant blurred effects due to the camera motion and the multiple moving objects with large depth variations. Given consecutive blurred stereo video frames, we aim to recover the latent…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Liyuan Pan , Yuchao Dai , Miaomiao Liu , Fatih Porikli , Quan Pan

Dense 3D reconstruction and ego-motion estimation are key challenges in autonomous driving and robotics. Compared to the complex, multi-modal systems deployed today, multi-camera systems provide a simpler, low-cost alternative. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Aron Schmied , Tobias Fischer , Martin Danelljan , Marc Pollefeys , Fisher Yu

Depth completion is crucial for many robotic tasks such as autonomous driving, 3-D reconstruction, and manipulation. Despite the significant progress, existing methods remain computationally intensive and often fail to meet the real-time…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Tianan Li , Zhehan Chen , Huan Liu , Chen Wang

Perceiving and reconstructing 3D scene geometry from visual inputs is crucial for autonomous driving. However, there still lacks a driving-targeted dense geometry perception model that can adapt to different scenarios and camera…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Shengyin Jiang , Long Chen , Zhi-Xin Yang , Jiwen Lu

As a core step in structure-from-motion and SLAM, robust feature detection and description under challenging scenarios such as significant viewpoint changes remain unresolved despite their ubiquity. While recent works have identified the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Gonglin Chen , Tianwen Fu , Haiwei Chen , Wenbin Teng , Hanyuan Xiao , Yajie Zhao

This paper tackles the challenge of recovering 4D dynamic scenes from videos captured by as few as four portable cameras. Learning to model scene dynamics for temporally consistent novel-view rendering is a foundational task in computer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Junsheng Zhou , Zhifan Yang , Liang Han , Wenyuan Zhang , Kanle Shi , Shenkun Xu , Yu-Shen Liu

We present Any4D, a scalable multi-view transformer for metric-scale, dense feed-forward 4D reconstruction. Any4D directly generates per-pixel motion and geometry predictions for N frames, in contrast to prior work that typically focuses on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jay Karhade , Nikhil Keetha , Yuchen Zhang , Tanisha Gupta , Akash Sharma , Sebastian Scherer , Deva Ramanan

Addressing the intricate challenge of modeling and re-rendering dynamic scenes, most recent approaches have sought to simplify these complexities using plane-based explicit representations, overcoming the slow training time issues…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Ange Lou , Benjamin Planche , Zhongpai Gao , Yamin Li , Tianyu Luan , Hao Ding , Terrence Chen , Jack Noble , Ziyan Wu

This paper tackles the challenge of robust reconstruction, i.e., the task of reconstructing a 3D scene from a set of inconsistent multi-view images. Some recent works have attempted to simultaneously remove image inconsistencies and perform…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Jin Cao , Hongrui Wu , Ziyong Feng , Hujun Bao , Xiaowei Zhou , Sida Peng

Recovering sharp video sequence from a motion-blurred image is highly ill-posed due to the significant loss of motion information in the blurring process. For event-based cameras, however, fast motion can be captured as events at high time…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Zhe Jiang , Yu Zhang , Dongqing Zou , Jimmy Ren , Jiancheng Lv , Yebin Liu

Multi-view 3D reconstruction remains a core challenge in computer vision, particularly in applications requiring accurate and scalable representations across diverse perspectives. Current leading methods such as DUSt3R employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jianing Yang , Alexander Sax , Kevin J. Liang , Mikael Henaff , Hao Tang , Ang Cao , Joyce Chai , Franziska Meier , Matt Feiszli

This paper presents SceneCut, a novel approach to jointly discover previously unseen objects and non-object surfaces using a single RGB-D image. SceneCut's joint reasoning over scene semantics and geometry allows a robot to detect and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Trung Pham , Thanh-Toan Do , Niko Sünderhauf , Ian Reid