English
Related papers

Related papers: PyNeRF: Pyramidal Neural Radiance Fields

200 papers

We present NeRF-XL, a principled method for distributing Neural Radiance Fields (NeRFs) across multiple GPUs, thus enabling the training and rendering of NeRFs with an arbitrarily large capacity. We begin by revisiting existing multi-GPU…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ruilong Li , Sanja Fidler , Angjoo Kanazawa , Francis Williams

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Benedict Quartey , Tuluhan Akbulut , Wasiwasi Mgonzo , Zheng Xin Yong

Recent work on Neural Radiance Fields (NeRF) exploits multi-view 3D consistency, achieving impressive results in 3D scene modeling and high-fidelity novel-view synthesis. However, there are limitations. First, existing methods assume enough…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Mengfei Li , Ming Lu , Xiaofang Li , Shanghang Zhang

While NeRF has shown great success for neural reconstruction and rendering, its limited MLP capacity and long per-scene optimization times make it challenging to model large-scale indoor scenes. In contrast, classical 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xiaoshuai Zhang , Sai Bi , Kalyan Sunkavalli , Hao Su , Zexiang Xu

While deep learning reshaped the classical motion capture pipeline with feed-forward networks, generative models are required to recover fine alignment via iterative refinement. Unfortunately, the existing models are usually hand-crafted or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Shih-Yang Su , Frank Yu , Michael Zollhoefer , Helge Rhodin

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

While existing Neural Radiance Fields (NeRFs) for dynamic scenes are offline methods with an emphasis on visual fidelity, our paper addresses the online use case that prioritises real-time adaptability. We present ParticleNeRF, a new…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jad Abou-Chakra , Feras Dayoub , Niko Sünderhauf

Neural Radiance Field (NeRF) and its variants have recently emerged as successful methods for novel view synthesis and 3D scene reconstruction. However, most current NeRF models either achieve high accuracy using large model sizes, or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Shiran Yuan , Hao Zhao

We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Jiabao Li , Yuqi Li , Ciliang Sun , Chong Wang , Jinhui Xiang

Neural Radiance Fields (NeRF) have recently gained a surge of interest within the computer vision community for its power to synthesize photorealistic novel views of real-world scenes. One limitation of NeRF, however, is its requirement of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Chen-Hsuan Lin , Wei-Chiu Ma , Antonio Torralba , Simon Lucey

Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Saeejith Nair , Yuhao Chen , Mohammad Javad Shafiee , Alexander Wong

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

Neural Radiance Field~(NeRF) achieves extremely high quality in object-scaled and indoor scene reconstruction. However, there exist some challenges when reconstructing large-scale scenes. MLP-based NeRFs suffer from limited network…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Sidun Liu , Peng Qiao , Zongxin Ye , Wenyu Li , Yong Dou

Neural Radiance Fields (NeRFs) have emerged as promising tools for advancing autonomous driving (AD) research, offering scalable closed-loop simulation and data augmentation capabilities. However, to trust the results achieved in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Carl Lindström , Georg Hess , Adam Lilja , Maryam Fatemi , Lars Hammarstrand , Christoffer Petersson , Lennart Svensson

Spike cameras, leveraging spike-based integration sampling and high temporal resolution, offer distinct advantages over standard cameras. However, existing approaches reliant on spike cameras often assume optimal illumination, a condition…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Lin Zhu , Kangmin Jia , Yifan Zhao , Yunshan Qi , Lizhi Wang , Hua Huang