English
Related papers

Related papers: Gear-NeRF: Free-Viewpoint Rendering and Tracking w…

200 papers

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel views, unlocking…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Huajian Huang , Yingshu Chen , Tianjia Zhang , Sai-Kit Yeung

Neural Radiance Fields (NeRF) have emerged as a powerful paradigm for 3D scene representation, offering high-fidelity renderings and reconstructions from a set of sparse and unstructured sensor data. In the context of autonomous robotics,…

Robotics · Computer Science 2024-12-09 Yuhang Ming , Xingrui Yang , Weihan Wang , Zheng Chen , Jinglun Feng , Yifan Xing , Guofeng Zhang

Recent advancements in the study of Neural Radiance Fields (NeRF) for dynamic scenes often involve explicit modeling of scene dynamics. However, this approach faces challenges in modeling scene dynamics in urban environments, where moving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Takashi Otonari , Satoshi Ikehata , Kiyoharu Aizawa

Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Liao Wang , Kaixin Yao , Chengcheng Guo , Zhirui Zhang , Qiang Hu , Jingyi Yu , Lan Xu , Minye Wu

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zheng Chen , Chen Wang , Yuan-Chen Guo , Song-Hai Zhang

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Predicting scene dynamics from visual observations is challenging. Existing methods capture dynamics only within observed boundaries failing to extrapolate far beyond the training sequence. Node-RF (Neural ODE-based NeRF) overcomes this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hiran Sarkar , Liming Kuang , Yordanka Velikova , Benjamin Busam

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende

Neural radiance field (NeRF) is an emerging view synthesis method that samples points in a three-dimensional (3D) space and estimates their existence and color probabilities. The disadvantage of NeRF is that it requires a long training time…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hye Bin Yoo , Hyun Min Han , Sung Soo Hwang , Il Yong Chun

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ashkan Mirzaei , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Jonathan Kelly , Marcus A. Brubaker , Igor Gilitschenski , Alex Levinshtein

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

In the realm of autonomous driving, achieving precise 3D reconstruction of the driving environment is critical for ensuring safety and effective navigation. Neural Radiance Fields (NeRF) have shown promise in creating highly detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Xiaochao Pan , Jiawei Yao , Hongrui Kou , Tong Wu , Canran Xiao

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Thu Nguyen-Phuoc , Feng Liu , Lei Xiao

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Neural Radiance Field (NeRF), as an implicit 3D scene representation, lacks inherent ability to accommodate changes made to the initial static scene. If objects are reconfigured, it is difficult to update the NeRF to reflect the new state…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziqi Lu , Jianbo Ye , Xiaohan Fei , Xiaolong Li , Jiawei Mo , Ashwin Swaminathan , Stefano Soatto

Compared to frame-based methods, computational neuromorphic imaging using event cameras offers significant advantages, such as minimal motion blur, enhanced temporal resolution, and high dynamic range. The multi-view consistency of Neural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chaoran Feng , Wangbo Yu , Xinhua Cheng , Zhenyu Tang , Junwu Zhang , Li Yuan , Yonghong Tian