English
Related papers

Related papers: Re-ReND: Real-time Rendering of NeRFs across Devic…

200 papers

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

In recent years, Neural Radiance Fields (NeRFs) have demonstrated significant potential in encoding highly-detailed 3D geometry and environmental appearance, positioning themselves as a promising alternative to traditional explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Tianxiang Ye , Qi Wu , Junyuan Deng , Guoqing Liu , Liu Liu , Songpengcheng Xia , Liang Pang , Wenxian Yu , Ling Pei

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Mohammad Shafiei , Sai Bi , Zhengqin Li , Aidas Liaudanskas , Rodrigo Ortiz-Cayon , Ravi Ramamoorthi

Recently, significant progress has been made in the study of methods for 3D reconstruction from multiple images using implicit neural representations, exemplified by the neural radiance field (NeRF) method. Such methods, which are based on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Wooseok Kim , Taiki Fukiage , Takeshi Oishi

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Neural Radiance Fields (NeRF) achieves photo-realistic image rendering from novel views, and the Neural Scene Graphs (NSG) \cite{ost2021neural} extends it to dynamic scenes (video) with multiple objects. Nevertheless, computationally heavy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yeji Song , Chaerin Kong , Seoyoung Lee , Nojun Kwak , Joonseok Lee

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

Real-time novel-view image synthesis on mobile devices is prohibitive due to the limited computational power and storage. Using volumetric rendering methods, such as NeRF and its derivatives, on mobile devices is not suitable due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Aarush Gupta , Junli Cao , Chaoyang Wang , Ju Hu , Sergey Tulyakov , Jian Ren , László A Jeni

This work tackles the challenging task of achieving real-time novel view synthesis for reflective surfaces across various scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chaojie Ji , Yufeng Li , Yiyi Liao

Constructing a high-quality dense map in real-time is essential for robotics, AR/VR, and digital twins applications. As Neural Radiance Field (NeRF) greatly improves the mapping performance, in this paper, we propose a NeRF-based mapping…

Robotics · Computer Science 2023-09-21 Chenxing Jiang , Hanwen Zhang , Peize Liu , Zehuan Yu , Hui Cheng , Boyu Zhou , Shaojie Shen

Neural Radiance Fields (NeRF) with hybrid representations have shown impressive capabilities for novel view synthesis, delivering high efficiency. Nonetheless, their performance significantly drops with sparse input views. Various…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yuru Xiao , Deming Zhai , Wenbo Zhao , Kui Jiang , Junjun Jiang , Xianming Liu

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

We introduce a method to render Neural Radiance Fields (NeRFs) in real time using PlenOctrees, an octree-based 3D representation which supports view-dependent effects. Our method can render 800x800 images at more than 150 FPS, which is over…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Alex Yu , Ruilong Li , Matthew Tancik , Hao Li , Ren Ng , Angjoo Kanazawa

A high-quality 3D reconstruction of a scene from a collection of 2D images can be achieved through offline/online mapping methods. In this paper, we explore active mapping from the perspective of implicit representations, which have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Huangying Zhan , Jiyang Zheng , Yi Xu , Ian Reid , Hamid Rezatofighi

Dynamic Neural Radiance Field (NeRF) is a powerful algorithm capable of rendering photo-realistic novel view images from a monocular RGB video of a dynamic scene. Although it warps moving points across frames from the observation spaces to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zhiwen Yan , Chen Li , Gim Hee Lee

This paper presents a method, namely NeuS-PIR, for recovering relightable neural surfaces using pre-integrated rendering from multi-view images or video. Unlike methods based on NeRF and discrete meshes, our method utilizes implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shi Mao , Chenming Wu , Zhelun Shen , Yifan Wang , Dayan Wu , Liangjun Zhang