English
Related papers

Related papers: Cross-Spectral Neural Radiance Fields

200 papers

Neural radiance fields (NeRF) has achieved outstanding performance in modeling 3D objects and controlled scenes, usually under a single scale. In this work, we focus on multi-scale cases where large changes in imagery are observed at…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Yuanbo Xiangli , Linning Xu , Xingang Pan , Nanxuan Zhao , Anyi Rao , Christian Theobalt , Bo Dai , Dahua Lin

In this paper, we introduce a new challenge for synthesizing novel view images in practical environments with limited input multi-view images and varying lighting conditions. Neural radiance fields (NeRF), one of the pioneering works for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 SeokYeong Lee , JunYong Choi , Seungryong Kim , Ig-Jae Kim , Junghyun Cho

Neural Radiance Field (NeRF) has enabled novel view synthesis with high fidelity given images and camera poses. Subsequent works even succeeded in eliminating the necessity of pose priors by jointly optimizing NeRF and camera pose. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Injae Kim , Minhyuk Choi , Hyunwoo J. Kim

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Recent advances in Neural radiance fields (NeRF) have enabled high-fidelity scene reconstruction for novel view synthesis. However, NeRF requires hundreds of network evaluations per pixel to approximate a volume rendering integral, making…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Yifan Wang , Yi Gong , Yuan Zeng

Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Miriam Jäger , Patrick Hübner , Dennis Haitz , Boris Jutzi

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Neural Radiance Fields (NeRF) have become an increasingly popular representation to capture high-quality appearance and shape of scenes and objects. However, learning generalizable NeRF priors over categories of scenes or objects has been…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bipasha Sen , Gaurav Singh , Aditya Agarwal , Rohith Agaram , K Madhava Krishna , Srinath Sridhar

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Christina Tsalicoglou , Keisuke Tateno , Jonathan T. Barron , Federico Tombari

We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene. Given a single observed RGB image of the target, we can predict the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yunzhi Lin , Thomas Müller , Jonathan Tremblay , Bowen Wen , Stephen Tyree , Alex Evans , Patricio A. Vela , Stan Birchfield

We present PanoHDR-NeRF, a neural representation of the full HDR radiance field of an indoor scene, and a pipeline to capture it casually, without elaborate setups or complex capture protocols. First, a user captures a low dynamic range…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Pulkit Gera , Mohammad Reza Karimi Dastjerdi , Charles Renaud , P. J. Narayanan , Jean-François Lalonde

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original…

Graphics · Computer Science 2021-09-07 Wonbong Jang , Lourdes Agapito

Recently, Neural Radiance Fields (NeRF) has shown promising performances on reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D images. Albeit effective, the performance of NeRF is highly influenced by the quality…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Xuran Pan , Zihang Lai , Shiji Song , Gao Huang

We present Omnidirectional Neural Radiance Fields (OmniNeRF), the first method to the application of parallax-enabled novel panoramic view synthesis. Recent works for novel view synthesis focus on perspective images with limited…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Ching-Yu Hsu , Cheng Sun , Hwann-Tzong Chen

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

The standard Neural Radiance Fields (NeRF) paradigm employs a viewer-centered methodology, entangling the aspects of illumination and material reflectance into emission solely from 3D points. This simplified rendering approach presents…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ziteng Cui , Lin Gu , Xiao Sun , Xianzheng Ma , Yu Qiao , Tatsuya Harada