English
Related papers

Related papers: Robust Dynamic Radiance Fields

200 papers

We proposed a novel approach to coherent imaging of dynamic samples. The inter-frame similarity of the sample's local structures is found to be a powerful constraint in phasing a sequence of diffraction patterns. We devised a new image…

Optics · Physics 2024-07-11 Pengju Sheng , Fucai Zhang

Estimating neural radiance fields (NeRFs) from "ideal" images has been extensively studied in the computer vision community. Most approaches assume optimal illumination and slow camera motion. These assumptions are often violated in robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Simon Klenk , Lukas Koestler , Davide Scaramuzza , Daniel Cremers

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optimizing both the shape…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chunyu Li , Taisuke Hashimoto , Eiichi Matsumoto , Hiroharu Kato

3D surface reconstruction from images is essential for numerous applications. Recently, Neural Radiance Fields (NeRFs) have emerged as a promising framework for 3D modeling. However, NeRFs require accurate camera poses as input, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yiyang Chen , Siyan Dong , Xulong Wang , Lulu Cai , Youyi Zheng , Yanchao Yang

We present a novel Structure from Motion pipeline that is capable of reconstructing accurate camera poses for panorama-style video capture without prior camera intrinsic calibration. While panorama-style capture is common and convenient,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Chris Sweeney , Aleksander Holynski , Brian Curless , Steve M Seitz

Existing techniques for dynamic scene reconstruction from multiple wide-baseline cameras primarily focus on reconstruction in controlled environments, with fixed calibrated cameras and strong prior constraints. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Armin Mustafa , Marco Volino , Hansung Kim , Jean-Yves Guillemaut , Adrian Hilton

Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Guanjun Wu , Taoran Yi , Jiemin Fang , Wenyu Liu , Xinggang Wang

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

High-quality 4D reconstruction enables photorealistic and immersive rendering of the dynamic real world. However, unlike static scenes that can be fully captured with a single camera, high-quality dynamic scenes typically require dense…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Weihong Pan , Xiaoyu Zhang , Zhuang Zhang , Zhichao Ye , Nan Wang , Haomin Liu , Guofeng Zhang

Radiance fields have emerged as powerful tools for 3D scene reconstruction. However, casual capture remains challenging due to the narrow field of view of perspective cameras, which limits viewpoint coverage and feature correspondences…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yalda Foroutan , Ipek Oztas , Daniel Rebain , Aysegul Dundar , Kwang Moo Yi , Lily Goli , Andrea Tagliasacchi

The paper introduces an accurate solution to dense orthographic Non-Rigid Structure from Motion (NRSfM) in scenarios with severe occlusions or, likewise, inaccurate correspondences. We integrate a shape prior term into variational…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Vladislav Golyanik , Torben Fetzer , Didier Stricker

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Dynamic Neural Radiance Field (NeRF) from monocular videos has recently been explored for space-time novel view synthesis and achieved excellent results. However, defocus blur caused by depth variation often occurs in video capture,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Xianrui Luo , Huiqiang Sun , Juewen Peng , Zhiguo Cao

We extend neural radiance fields (NeRFs) to dynamic large-scale urban scenes. Prior work tends to reconstruct single video clips of short durations (up to 10 seconds). Two reasons are that such methods (a) tend to scale linearly with the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Haithem Turki , Jason Y. Zhang , Francesco Ferroni , Deva Ramanan

Event cameras are bio-inspired sensors that offer several advantages, such as low latency, high-speed and high dynamic range, to tackle challenging scenarios in computer vision. This paper presents a solution to the problem of 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Yi Zhou , Guillermo Gallego , Henri Rebecq , Laurent Kneip , Hongdong Li , Davide Scaramuzza

Radiance field methods have achieved photorealistic novel view synthesis and geometry reconstruction. But they are mostly applied in per-scene optimization or small-baseline settings. While several recent works investigate feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Anpei Chen , Haofei Xu , Stefano Esposito , Siyu Tang , Andreas Geiger

Reliable incremental estimation of camera poses and 3D reconstruction is key to enable various applications including robotics, interactive visualization, and augmented reality. However, this task is particularly challenging in dynamic…

Robotics · Computer Science 2025-12-09 Xingguang Zhong , Liren Jin , Marija Popović , Jens Behley , Cyrill Stachniss

Asynchronously operating event cameras find many applications due to their high dynamic range, vanishingly low motion blur, low latency and low data bandwidth. The field saw remarkable progress during the last few years, and existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Viktor Rudnev , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Shilei Sun , Ming Liu , Zhongyi Fan , Yuxue Liu , Chengwei Lv , Liquan Dong , Lingqin Kong