English
Related papers

Related papers: DDNeRF: Depth Distribution Neural Radiance Fields

200 papers

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi , Andrea Tagliasacchi

A commonly observed failure mode of Neural Radiance Field (NeRF) is fitting incorrect geometries when given an insufficient number of input views. One potential reason is that standard volumetric rendering does not enforce the constraint…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Kangle Deng , Andrew Liu , Jun-Yan Zhu , Deva Ramanan

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Shilei Sun , Ming Liu , Zhongyi Fan , Yuxue Liu , Chengwei Lv , Liquan Dong , Lingqin Kong

Neural Radiance Field (NeRF) has broken new ground in the novel view synthesis due to its simple concept and state-of-the-art quality. However, it suffers from severe performance degradation unless trained with a dense set of images with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Seunghyeon Seo , Donghoon Han , Yeonjin Chang , Nojun Kwak

Novel view synthesis has recently been revolutionized by learning neural radiance fields directly from sparse observations. However, rendering images with this new paradigm is slow due to the fact that an accurate quadrature of the volume…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Andreas Kurz , Thomas Neff , Zhaoyang Lv , Michael Zollhöfer , Markus Steinberger

Neural radiance fields (NeRFs) have exhibited potential in synthesizing high-fidelity views of 3D scenes but the standard training paradigm of NeRF presupposes an equal importance for each image in the training set. This assumption poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Rongkai Ma , Leo Lebrat , Rodrigo Santa Cruz , Gil Avraham , Yan Zuo , Clinton Fookes , Olivier Salvado

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

Neural Radiance Fields (NeRFs) increase reconstruction detail for novel view synthesis and scene reconstruction, with applications ranging from large static scenes to dynamic human motion. However, the increased resolution and model-free…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Abiramy Kuganesan , Shih-yang Su , James J. Little , Helge Rhodin

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiaxiang Tang , Xiaokang Chen , Jingbo Wang , Gang Zeng

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

Deep neural networks (DNNs) have shown remarkable performance improvements on vision-related tasks such as object detection or image segmentation. Despite their success, they generally lack the understanding of 3D objects which form the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Hiroharu Kato , Deniz Beker , Mihai Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Recent work on Neural Radiance Fields (NeRF) exploits multi-view 3D consistency, achieving impressive results in 3D scene modeling and high-fidelity novel-view synthesis. However, there are limitations. First, existing methods assume enough…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Mengfei Li , Ming Lu , Xiaofang Li , Shanghang Zhang

Neural radiance fields (NeRF) encode a scene into a neural representation that enables photo-realistic rendering of novel views. However, a successful reconstruction from RGB images requires a large number of input views taken under static…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Barbara Roessle , Jonathan T. Barron , Ben Mildenhall , Pratul P. Srinivasan , Matthias Nießner

As previous representations for reinforcement learning cannot effectively incorporate a human-intuitive understanding of the 3D environment, they usually suffer from sub-optimal performances. In this paper, we present Semantic-aware Neural…

Machine Learning · Computer Science 2023-06-01 Dongseok Shim , Seungjae Lee , H. Jin Kim

Domain scientists often face I/O and storage challenges when keeping raw data from large-scale simulations. Saving visualization images, albeit practical, is limited to preselected viewpoints, transfer functions, and simulation parameters.…

Graphics · Computer Science 2025-02-25 Siyuan Yao , Yunfei Lu , Chaoli Wang