English
Related papers

Related papers: Fast Sun-aligned Outdoor Scene Relighting based on…

200 papers

Inverse rendering is an ill-posed problem. Previous work has sought to resolve this by focussing on priors for object or scene shape or appearance. In this work, we instead focus on a prior for natural illuminations. Current methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 James A. D. Gardner , Bernhard Egger , William A. P. Smith

We propose to tackle the multiview photometric stereo problem using an extension of Neural Radiance Fields (NeRFs), conditioned on light source direction. The geometric part of our neural representation predicts surface normal direction,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Meghna Asthana , William A. P. Smith , Patrik Huber

Neural Radiance Fields (NeRF) face significant challenges in extreme few-shot scenarios, primarily due to overfitting and long training times. Existing methods, such as FreeNeRF and SparseNeRF, use frequency regularization or pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Chin-Yang Lin , Chung-Ho Wu , Chang-Han Yeh , Shih-Han Yen , Cheng Sun , Yu-Lun Liu

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Neural Scene Flow Prior (NSFP) is of significant interest to the vision community due to its inherent robustness to out-of-distribution (OOD) effects and its ability to deal with dense lidar points. The approach utilizes a coordinate neural…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Xueqian Li , Jianqiao Zheng , Francesco Ferroni , Jhony Kaesemodel Pontes , Simon Lucey

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin

Estimating neural radiance fields (NeRFs) from "ideal" images has been extensively studied in the computer vision community. Most approaches assume optimal illumination and slow camera motion. These assumptions are often violated in robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Simon Klenk , Lukas Koestler , Davide Scaramuzza , Daniel Cremers

Recent works on implicit neural representations have shown promising results for multi-view surface reconstruction. However, most approaches are limited to relatively simple geometries and usually require clean object masks for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jingyang Zhang , Yao Yao , Long Quan

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Young Chun Ahn , Seokhwan Jang , Sungheon Park , Ji-Yeon Kim , Nahyup Kang

Rendering novel views from captured multi-view images has made considerable progress since the emergence of the neural radiance field. This paper aims to further advance the quality of view synthesis by proposing a novel approach dubbed the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Kang Han , Wei Xiang

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing single-view methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

We present a learning framework for reconstructing neural scene representations from a small number of unconstrained tourist photos. Since each image contains transient occluders, decomposing the static and transient components is necessary…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Jaewon Lee , Injae Kim , Hwan Heo , Hyunwoo J. Kim

In this paper, we introduce a new challenge for synthesizing novel view images in practical environments with limited input multi-view images and varying lighting conditions. Neural radiance fields (NeRF), one of the pioneering works for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 SeokYeong Lee , JunYong Choi , Seungryong Kim , Ig-Jae Kim , Junghyun Cho

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Shilei Sun , Ming Liu , Zhongyi Fan , Yuxue Liu , Chengwei Lv , Liquan Dong , Lingqin Kong

Synthesizing realistic videos of talking faces under custom lighting conditions and viewing angles benefits various downstream applications like video conferencing. However, most existing relighting methods are either time-consuming or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Ziqi Cai , Kaiwen Jiang , Shu-Yu Chen , Yu-Kun Lai , Hongbo Fu , Boxin Shi , Lin Gao

Neural Radiance Fields (NeRF) are an advanced technology that creates highly realistic images by learning about scenes through a neural network model. However, NeRF often encounters issues when there are not enough images to work with,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiawei Guo , HungChyun Chou , Ning Ding

Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Dor Verbin , Pratul P. Srinivasan , Peter Hedman , Ben Mildenhall , Benjamin Attal , Richard Szeliski , Jonathan T. Barron

A high-quality 3D reconstruction of a scene from a collection of 2D images can be achieved through offline/online mapping methods. In this paper, we explore active mapping from the perspective of implicit representations, which have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Huangying Zhan , Jiyang Zheng , Yi Xu , Ian Reid , Hamid Rezatofighi

This paper proposes PreSem-Surf, an optimized method based on the Neural Radiance Field (NeRF) framework, capable of reconstructing high-quality scene surfaces from RGB-D sequences in a short time. The method integrates RGB, depth, and…

Graphics · Computer Science 2025-08-20 Yuyan Ye , Hang Xu , Yanghang Huang , Jiali Huang , Qian Weng