中文
相关论文

相关论文: NeRF for Outdoor Scene Relighting

200 篇论文

In the realm of autonomous driving, achieving precise 3D reconstruction of the driving environment is critical for ensuring safety and effective navigation. Neural Radiance Fields (NeRF) have shown promise in creating highly detailed and…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Xiaochao Pan , Jiawei Yao , Hongrui Kou , Tong Wu , Canran Xiao

Thermal imaging has a variety of applications, from agricultural monitoring to building inspection to imaging under poor visibility, such as in low light, fog, and rain. However, reconstructing thermal scenes in 3D presents several…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yvette Y. Lin , Xin-Yi Pan , Sara Fridovich-Keil , Gordon Wetzstein

Physics-based inverse rendering enables joint optimization of shape, material, and lighting based on captured 2D images. To ensure accurate reconstruction, using a light model that closely resembles the captured environment is essential.…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Jingwang Ling , Ruihan Yu , Feng Xu , Chun Du , Shuang Zhao

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Chen Gao , Yipeng Wang , Changil Kim , Jia-Bin Huang , Johannes Kopf

Neural Radiance Fields (NeRFs) have shown significant promise in 3D scene reconstruction and novel view synthesis. In agricultural settings, NeRFs can serve as digital twins, providing critical information about fruit detection for yield…

机器人学 · 计算机科学 2024-09-25 Samarth Chopra , Fernando Cladera , Varun Murali , Vijay Kumar

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

计算机视觉与模式识别 · 计算机科学 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and…

计算机视觉与模式识别 · 计算机科学 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Xuan Wang , Qing Wang

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

计算机视觉与模式识别 · 计算机科学 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin

Neural Radiance Fields (NeRFs) have shown remarkable success in synthesizing photorealistic views from multi-view images of static scenes, but face challenges in dynamic, real-world environments with distractors like moving objects,…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Weining Ren , Zihan Zhu , Boyang Sun , Jiaqi Chen , Marc Pollefeys , Songyou Peng

When capturing images through the glass during rainy or snowy weather conditions, the resulting images often contain waterdrops adhered on the glass surface, and these waterdrops significantly degrade the image quality and performance of…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Yunhao Li , Jing Wu , Lingzhe Zhao , Peidong Liu

Physical simulations produce excellent predictions of weather effects. Neural radiance fields produce SOTA scene models. We describe a novel NeRF-editing procedure that can fuse physical simulations with NeRF models of scenes, producing…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Yuan Li , Zhi-Hao Lin , David Forsyth , Jia-Bin Huang , Shenlong Wang

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

We present a new generic method for shadow-aware multi-view satellite photogrammetry of Earth Observation scenes. Our proposed method, the Shadow Neural Radiance Field (S-NeRF) follows recent advances in implicit volumetric representation…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Dawa Derksen , Dario Izzo

We present the first method capable of photorealistically reconstructing deformable scenes using photos/videos captured casually from mobile phones. Our approach augments neural radiance fields (NeRF) by optimizing an additional continuous…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Keunhong Park , Utkarsh Sinha , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Steven M. Seitz , Ricardo Martin-Brualla

Neural Radiance Field (NeRF) approaches learn the underlying 3D representation of a scene and generate photo-realistic novel views with high fidelity. However, most proposed settings concentrate on modelling a single object or a single…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Ankit Dhiman , Srinath R , Harsh Rangwani , Rishubh Parihar , Lokesh R Boregowda , Srinath Sridhar , R Venkatesh Babu

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene lighting into an…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Zian Wang , Wenzheng Chen , David Acuna , Jan Kautz , Sanja Fidler