English
Related papers

Related papers: NerfAcc: A General NeRF Acceleration Toolbox

200 papers

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

Neural radiance field (NeRF), in particular its extension by instant neural graphics primitives, is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ke Li , Tim Rolff , Susanne Schmidt , Reinhard Bacher , Simone Frintrop , Wim Leemans , Frank Steinicke

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

Methods have recently been proposed that densely segment 3D volumes into classes using only color images and expert supervision in the form of sparse semantically annotated pixels. While impressive, these methods still require a relatively…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Kenneth Blomqvist , Lionel Ott , Jen Jen Chung , Roland Siegwart

Neural Radiance Fields (NeRF) are a rapidly growing area of research with wide-ranging applications in computer vision, graphics, robotics, and more. In order to streamline the development and deployment of NeRF research, we propose a…

Neural Radiance Fields (NeRF) achieves photo-realistic image rendering from novel views, and the Neural Scene Graphs (NSG) \cite{ost2021neural} extends it to dynamic scenes (video) with multiple objects. Nevertheless, computationally heavy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yeji Song , Chaerin Kong , Seoyoung Lee , Nojun Kwak , Joonseok Lee

Recent work on Neural Radiance Fields (NeRF) showed how neural networks can be used to encode complex 3D environments that can be rendered photorealistically from novel viewpoints. Rendering these images is very computationally demanding…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Stephan J. Garbin , Marek Kowalski , Matthew Johnson , Jamie Shotton , Julien Valentin

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel views, unlocking…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Huajian Huang , Yingshu Chen , Tianjia Zhang , Sai-Kit Yeung

An increasingly common approach for creating photo-realistic digital avatars is through the use of volumetric neural fields. The original neural radiance field (NeRF) allowed for impressive novel view synthesis of static heads when trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yingyan Xu , Prashanth Chandran , Sebastian Weiss , Markus Gross , Gaspard Zoss , Derek Bradley

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Neural Radiance Fields (NeRF) is a cutting-edge neural network-based technique for novel view synthesis in 3D reconstruction. However, its significant computational demands pose challenges for deployment on mobile devices. While mesh-based…

Graphics · Computer Science 2025-04-07 Zhe Wang , Yifei Zhu

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang

Neural Radiance Field (NeRF) is a powerful tool to faithfully generate novel views for scenes with only sparse captured images. Despite its strong capability for representing 3D scenes and their appearance, its editing ability is very…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Qiling Wu , Jianchao Tan , Kun Xu