English
Related papers

Related papers: A Learned Radiance-Field Representation for Comple…

200 papers

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Xuan Wang , Qing Wang

Neural radiance fields (NeRF) excel at synthesizing new views given multi-view, calibrated images of a static scene. When scenes include distractors, which are not persistent during image capture (moving objects, lighting variations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Sara Sabour , Suhani Vora , Daniel Duckworth , Ivan Krasin , David J. Fleet , Andrea Tagliasacchi

This paper presents a Progressively-connected Light Field network (ProLiF), for the novel view synthesis of complex forward-facing scenes. ProLiF encodes a 4D light field, which allows rendering a large batch of rays in one training step…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Peng Wang , Yuan Liu , Guying Lin , Jiatao Gu , Lingjie Liu , Taku Komura , Wenping Wang

Neural radiance fields achieve unprecedented quality for novel view synthesis, but their volumetric formulation remains expensive, requiring a huge number of samples to render high-resolution images. Volumetric encodings are essential to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Zian Wang , Tianchang Shen , Merlin Nimier-David , Nicholas Sharp , Jun Gao , Alexander Keller , Sanja Fidler , Thomas Müller , Zan Gojcic

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

Neural Radiance Fields (NeRFs), despite their outstanding performance on novel view synthesis, often need dense input views. Many papers train one model for each scene respectively and few of them explore incorporating multi-modal data into…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Haoyi Zhu , Hao-Shu Fang , Cewu Lu

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

We propose a novel explicit dense 3D reconstruction approach that processes a set of images of a scene with sensor poses and calibrations and estimates a photo-real digital model. One of the key innovations is that the underlying volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Samir Aroudj , Steven Lovegrove , Eddy Ilg , Tanner Schmidt , Michael Goesele , Richard Newcombe

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

The standard Neural Radiance Fields (NeRF) paradigm employs a viewer-centered methodology, entangling the aspects of illumination and material reflectance into emission solely from 3D points. This simplified rendering approach presents…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ziteng Cui , Lin Gu , Xiao Sun , Xianzheng Ma , Yu Qiao , Tatsuya Harada

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi , Andrea Tagliasacchi

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes a weighted sum of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nikita Morozov , Denis Rakitin , Oleg Desheulin , Dmitry Vetrov , Kirill Struminsky

A variety of Neural Radiance Fields (NeRF) methods have recently achieved remarkable success in high render speed. However, current accelerating methods are specialized and incompatible with various implicit methods, preventing real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyu Gao , Ziyi Yang , Yunlu Zhao , Yuxiang Sun , Xiaogang Jin , Changqing Zou

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

The recent progress in implicit 3D representation, i.e., Neural Radiance Fields (NeRFs), has made accurate and photorealistic 3D reconstruction possible in a differentiable manner. This new representation can effectively convey the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yoonwoo Jeong , Seungjoo Shin , Junha Lee , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

Rendering novel views from captured multi-view images has made considerable progress since the emergence of the neural radiance field. This paper aims to further advance the quality of view synthesis by proposing a novel approach dubbed the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Kang Han , Wei Xiang

Neural Radiance Fields (NeRFs) have demonstrated amazing ability to synthesize images of 3D scenes from novel views. However, they rely upon specialized volumetric rendering algorithms based on ray marching that are mismatched to the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zhiqin Chen , Thomas Funkhouser , Peter Hedman , Andrea Tagliasacchi