English
Related papers

Related papers: Compact Real-time Radiance Fields with Neural Code…

200 papers

Despite the potential of neural scene representations to effectively compress 3D scalar fields at high reconstruction quality, the computational complexity of the training and data reconstruction step using scene representation networks…

Graphics · Computer Science 2022-07-26 Sebastian Weiss , Philipp Hermüller , Rüdiger Westermann

Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Mohammad Shafiei , Sai Bi , Zhengqin Li , Aidas Liaudanskas , Rodrigo Ortiz-Cayon , Ravi Ramamoorthi

We propose an efficient method for rendering complex luminaires using a high-quality octree-based representation of the luminaire emission. Complex luminaires are a particularly challenging problem in rendering, due to their caustic light…

Graphics · Computer Science 2022-07-12 Jorge Condor , Adrián Jarabo

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

Volumetric videos, benefiting from immersive 3D realism and interactivity, hold vast potential for various applications, while the tremendous data volume poses significant challenges for compression. Recently, NeRF has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Zhiyu Zhang , Guo Lu , Huanxiong Liang , Anni Tang , Qiang Hu , Li Song

Learning a 3D representation of a scene has been a challenging problem for decades in computer vision. Recent advances in implicit neural representation from images using neural radiance fields(NeRF) have shown promising results. Some of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Andrew I. Comport

We introduce a new approach for reconstruction and novel view synthesis of unbounded real-world scenes. In contrast to previous methods using either volumetric fields, grid-based models, or discrete point cloud proxies, we propose a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Florian Hahlbohm , Linus Franke , Moritz Kappel , Susana Castillo , Martin Eisemann , Marc Stamminger , Marcus Magnor

The goal of this paper is to encode a 3D scene into an extremely compact representation from 2D images and to enable its transmittance, decoding and rendering in real-time across various platforms. Despite the progress in NeRFs and Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Jae Yong Lee , Yuqun Wu , Chuhang Zou , Derek Hoiem , Shenlong Wang

Radiance fields have revolutionized photo-realistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them an ideal match for light field displays. However, integrating these technologies…

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Neural Radiance Fields (NeRFs) have demonstrated remarkable potential in capturing complex 3D scenes with high fidelity. However, one persistent challenge that hinders the widespread adoption of NeRFs is the computational bottleneck due to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Joo Chan Lee , Daniel Rho , Xiangyu Sun , Jong Hwan Ko , Eunbyung Park

We present a novel way of approaching image-based 3D reconstruction based on radiance fields. The problem of volumetric reconstruction is formulated as a non-linear least-squares problem and solved explicitly without the use of neural…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Sverker Rasmuson , Erik Sintorn , Ulf Assarsson

The neural radiance fields (NeRF) have advanced the development of 3D volumetric video technology, but the large data volumes they involve pose significant challenges for storage and transmission. To address these problems, the existing…

Multimedia · Computer Science 2024-11-11 Zhiyu Zhang , Guo Lu , Huanxiong Liang , Zhengxue Cheng , Anni Tang , Li Song

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Novel view synthesis has recently been revolutionized by learning neural radiance fields directly from sparse observations. However, rendering images with this new paradigm is slow due to the fact that an accurate quadrature of the volume…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Andreas Kurz , Thomas Neff , Zhaoyang Lv , Michael Zollhöfer , Markus Steinberger

The recent progress in implicit 3D representation, i.e., Neural Radiance Fields (NeRFs), has made accurate and photorealistic 3D reconstruction possible in a differentiable manner. This new representation can effectively convey the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yoonwoo Jeong , Seungjoo Shin , Junha Lee , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

Neural radiance fields (NeRF) have shown great success in modeling 3D scenes and synthesizing novel-view images. However, most previous NeRF methods take much time to optimize one single scene. Explicit data structures, e.g. voxel features,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Jiemin Fang , Taoran Yi , Xinggang Wang , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Matthias Nießner , Qi Tian

We present TensoRF, a novel approach to model and reconstruct radiance fields. Unlike NeRF that purely uses MLPs, we model the radiance field of a scene as a 4D tensor, which represents a 3D voxel grid with per-voxel multi-channel features.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Anpei Chen , Zexiang Xu , Andreas Geiger , Jingyi Yu , Hao Su

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec