English
Related papers

Related papers: Robust Dynamic Radiance Fields

200 papers

Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Liao Wang , Kaixin Yao , Chengcheng Guo , Zhirui Zhang , Qiang Hu , Jingyi Yu , Lan Xu , Minye Wu

We present a novel non-rigid reconstruction method using a moving RGB-D camera. Current approaches use only non-rigid part of the scene and completely ignore the rigid background. Non-rigid parts often lack sufficient geometric and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Shafeeq Elanattil , Peyman Moghadam , Sridha Sridharan , Clinton Fookes , Mark Cox

Neural surface reconstruction methods typically treat camera poses as fixed values, assuming perfect accuracy from Structure-from-Motion (SfM) systems. This assumption breaks down with imperfect pose estimates, leading to distorted or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Shravan Venkatraman , Rakesh Raj Madavan , Pavan Kumar Sathya Venkatesh

We describe a data-driven method for inferring the camera viewpoints given multiple images of an arbitrary object. This task is a core component of classic geometric pipelines such as SfM and SLAM, and also serves as a vital pre-processing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Jason Y. Zhang , Deva Ramanan , Shubham Tulsiani

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

We estimate the radiance field of large-scale dynamic areas from multiple vehicle captures under varying environmental conditions. Previous works in this domain are either restricted to static environments, do not scale to more than a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tobias Fischer , Lorenzo Porzi , Samuel Rota Bulò , Marc Pollefeys , Peter Kontschieder

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

We propose a novel explicit dense 3D reconstruction approach that processes a set of images of a scene with sensor poses and calibrations and estimates a photo-real digital model. One of the key innovations is that the underlying volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Samir Aroudj , Steven Lovegrove , Eddy Ilg , Tanner Schmidt , Michael Goesele , Richard Newcombe

Multi-modality (or multi-channel) imaging is becoming increasingly important and more widely available, e.g. hyperspectral imaging in remote sensing, spectral CT in material sciences as well as multi-contrast MRI and PET-MR in medicine.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Leon Bungert , Matthias J. Ehrhardt

Neural Radiance Field(NeRF) is an novel implicit method to achieve the 3D reconstruction and representation with a high resolution. After the first research of NeRF is proposed, NeRF has gained a robust developing power and is booming in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Jinwei Lin

In the paper, we propose a robust real-time visual odometry in dynamic environments via rigid-motion model updated by scene flow. The proposed algorithm consists of spatial motion segmentation and temporal motion tracking. The spatial…

Robotics · Computer Science 2019-07-22 Sangil Lee , Clark Youngdong Son , H. Jin Kim

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

We propose a novel method to accurately reconstruct a set of images representing a single scene from few linear multi-view measurements. Each observed image is modeled as the sum of a background image and a foreground one. The background…

Computer Vision and Pattern Recognition · Computer Science 2013-09-19 Gilles Puy , Pierre Vandergheynst

Volumetric reconstruction of dynamic scenes is an important problem in computer vision. It is especially challenging in poor lighting and with fast motion. This is partly due to limitations of RGB cameras: To capture frames under low…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Viktor Rudnev , Gereon Fox , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik

Omnidirectional cameras are extensively used in various applications to provide a wide field of vision. However, they face a challenge in synthesizing novel views due to the inevitable presence of dynamic objects, including the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Dongyoung Choi , Hyeonjoong Jang , Min H. Kim

Capturing the 3D geometry of transparent objects is a challenging task, ill-suited for general-purpose scanning and reconstruction techniques, since these cannot handle specular light transport phenomena. Existing state-of-the-art methods,…

Graphics · Computer Science 2020-09-22 Jiahui Lyu , Bojian Wu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Structure from motion (SfM) enables us to reconstruct a scene via casual capture from cameras at different viewpoints, and novel view synthesis (NVS) allows us to render a captured scene from a new viewpoint. Both are hard with casual…

Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based methods achieve state-of-the-art quality in challenging scenarios such as in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Daniel Duckworth , Rama Gosula , Keisuke Tateno , John Bates , Dominik Kaeser , Federico Tombari

3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 San Jiang , Kan You , Yaxin Li , Duojie Weng , Wu Chen