English
Related papers

Related papers: Learning Robust Generalizable Radiance Field with …

200 papers

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

We present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Zhang Chen , Zhong Li , Liangchen Song , Lele Chen , Jingyi Yu , Junsong Yuan , Yi Xu

The ability of neural radiance fields or NeRFs to conduct accurate 3D modelling has motivated application of the technique to scene representation. Previous approaches have mainly followed a centralised learning paradigm, which assumes that…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Lachlan Holden , Feras Dayoub , David Harvey , Tat-Jun Chin

High-fidelity 3D scene reconstruction has been substantially advanced by recent progress in neural fields. However, most existing methods train a separate network from scratch for each individual scene. This is not scalable, inefficient,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yang Fu , Shalini De Mello , Xueting Li , Amey Kulkarni , Jan Kautz , Xiaolong Wang , Sifei Liu

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liqi Yan , Qifan Wang , Junhan Zhao , Qiang Guan , Zheng Tang , Jianhui Zhang , Dongfang Liu

Due to the ability to synthesize high-quality novel views, Neural Radiance Fields (NeRF) have been recently exploited to improve visual localization in a known environment. However, the existing methods mostly utilize NeRFs for data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Boming Zhao , Luwei Yang , Mao Mao , Hujun Bao , Zhaopeng Cui

Generalizing Neural Radiance Fields (NeRF) to new scenes is a significant challenge that existing approaches struggle to address without extensive modifications to vanilla NeRF framework. We introduce InsertNeRF, a method for INStilling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yanqi Bao , Tianyu Ding , Jing Huo , Wenbin Li , Yuxin Li , Yang Gao

We present a novel framework to regularize Neural Radiance Field (NeRF) in a few-shot setting with a geometry-aware consistency regularization. The proposed approach leverages a rendered depth map at unobserved viewpoint to warp sparse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Min-seop Kwak , Jiuhn Song , Seungryong Kim

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

Generalizable Neural Radiance Fields (GNeRF) are one of the most promising real-world solutions for novel view synthesis, thanks to their cross-scene generalization capability and thus the possibility of instant rendering on new scenes.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Ye Yuan , Souvik Kundu , Shang Wu , Shunyao Zhang , Yingyan Celine Lin

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

Graphics · Computer Science 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong

We propose to tackle the multiview photometric stereo problem using an extension of Neural Radiance Fields (NeRFs), conditioned on light source direction. The geometric part of our neural representation predicts surface normal direction,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Meghna Asthana , William A. P. Smith , Patrik Huber

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume rendering, which…

Graphics · Computer Science 2025-08-20 Nan Luo , Chenglin Ye , Jiaxu Li , Gang Liu , Bo Wan , Di Wang , Lupeng Liu , Jun Xiao

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Neural Radiance Field (NeRF) has achieved substantial progress in novel view synthesis given multi-view images. Recently, some works have attempted to train a NeRF from a single image with 3D priors. They mainly focus on a limited field of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Guangcong Wang , Peng Wang , Zhaoxi Chen , Wenping Wang , Chen Change Loy , Ziwei Liu