中文
相关论文

相关论文: Cross-Spectral Neural Radiance Fields

200 篇论文

Neural radiance fields (NeRF) has achieved outstanding performance in modeling 3D objects and controlled scenes, usually under a single scale. In this work, we focus on multi-scale cases where large changes in imagery are observed at…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Yuanbo Xiangli , Linning Xu , Xingang Pan , Nanxuan Zhao , Anyi Rao , Christian Theobalt , Bo Dai , Dahua Lin

In this paper, we introduce a new challenge for synthesizing novel view images in practical environments with limited input multi-view images and varying lighting conditions. Neural radiance fields (NeRF), one of the pioneering works for…

计算机视觉与模式识别 · 计算机科学 2023-12-19 SeokYeong Lee , JunYong Choi , Seungryong Kim , Ig-Jae Kim , Junghyun Cho

Neural Radiance Field (NeRF) has enabled novel view synthesis with high fidelity given images and camera poses. Subsequent works even succeeded in eliminating the necessity of pose priors by jointly optimizing NeRF and camera pose. However,…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Injae Kim , Minhyuk Choi , Hyunwoo J. Kim

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Recent advances in Neural radiance fields (NeRF) have enabled high-fidelity scene reconstruction for novel view synthesis. However, NeRF requires hundreds of network evaluations per pixel to approximate a volume rendering integral, making…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Yifan Wang , Yi Gong , Yuan Zeng

Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Miriam Jäger , Patrick Hübner , Dennis Haitz , Boris Jutzi

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Neural Radiance Fields (NeRF) have become an increasingly popular representation to capture high-quality appearance and shape of scenes and objects. However, learning generalizable NeRF priors over categories of scenes or objects has been…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Bipasha Sen , Gaurav Singh , Aditya Agarwal , Rohith Agaram , K Madhava Krishna , Srinath Sridhar

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene. Given a single observed RGB image of the target, we can predict the…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Yunzhi Lin , Thomas Müller , Jonathan Tremblay , Bowen Wen , Stephen Tyree , Alex Evans , Patricio A. Vela , Stan Birchfield

We present PanoHDR-NeRF, a neural representation of the full HDR radiance field of an indoor scene, and a pipeline to capture it casually, without elaborate setups or complex capture protocols. First, a user captures a low dynamic range…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Pulkit Gera , Mohammad Reza Karimi Dastjerdi , Charles Renaud , P. J. Narayanan , Jean-François Lalonde

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Kang Han , Wei Xiang , Lu Yu

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original…

图形学 · 计算机科学 2021-09-07 Wonbong Jang , Lourdes Agapito

Recently, Neural Radiance Fields (NeRF) has shown promising performances on reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D images. Albeit effective, the performance of NeRF is highly influenced by the quality…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Xuran Pan , Zihang Lai , Shiji Song , Gao Huang

We present Omnidirectional Neural Radiance Fields (OmniNeRF), the first method to the application of parallax-enabled novel panoramic view synthesis. Recent works for novel view synthesis focus on perspective images with limited…

计算机视觉与模式识别 · 计算机科学 2021-06-22 Ching-Yu Hsu , Cheng Sun , Hwann-Tzong Chen

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

The standard Neural Radiance Fields (NeRF) paradigm employs a viewer-centered methodology, entangling the aspects of illumination and material reflectance into emission solely from 3D points. This simplified rendering approach presents…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Ziteng Cui , Lin Gu , Xiao Sun , Xianzheng Ma , Yu Qiao , Tatsuya Harada