English
Related papers

Related papers: Content-Aware Radiance Fields: Aligning Model Comp…

200 papers

While the use of neural radiance fields (NeRFs) in different challenging settings has been explored, only very recently have there been any contributions that focus on the use of NeRF in foggy environments. We argue that the traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Andreas L. Teigen , Mauhing Yip , Victor P. Hamran , Vegard Skui , Annette Stahl , Rudolf Mester

The 3D-aware image synthesis focuses on conserving spatial consistency besides generating high-resolution images with fine details. Recently, Neural Radiance Field (NeRF) has been introduced for synthesizing novel views with low…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiwook Kim , Minhyeok Lee

A critical limitation of current methods based on Neural Radiance Fields (NeRF) is that they are unable to quantify the uncertainty associated with the learned appearance and geometry of the scene. This information is paramount in real…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jianxiong Shen , Antonio Agudo , Francesc Moreno-Noguer , Adria Ruiz

NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural radiance field to RGB images. However, NeRF requires querying a deep Multi-Layer Perceptron (MLP) millions of times, leading to slow rendering times,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Christian Reiser , Songyou Peng , Yiyi Liao , Andreas Geiger

Making generative models 3D-aware bridges the 2D image space and the 3D physical world yet remains challenging. Recent attempts equip a Generative Adversarial Network (GAN) with a Neural Radiance Field (NeRF), which maps 3D coordinates to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yinghao Xu , Sida Peng , Ceyuan Yang , Yujun Shen , Bolei Zhou

We propose an application of online hard sample mining for efficient training of Neural Radiance Fields (NeRF). NeRF models produce state-of-the-art quality for many 3D reconstruction and rendering tasks but require substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Juuso Korhonen , Goutham Rangu , Hamed R. Tavakoli , Juho Kannala

We propose a differentiable rendering algorithm for efficient novel view synthesis. By departing from volume-based representations in favor of a learned point representation, we improve on existing methods more than an order of magnitude in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Qiang Zhang , Seung-Hwan Baek , Szymon Rusinkiewicz , Felix Heide

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

We present Instant Neural Radiance Fields Stylization, a novel approach for multi-view image stylization for the 3D scene. Our approach models a neural radiance field based on neural graphics primitives, which use a hash table-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Shaoxu Li , Ye Pan

Radiance fields have revolutionized photo-realistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them an ideal match for light field displays. However, integrating these technologies…

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong

Neural radiance fields, or NeRF, represent a breakthrough in the field of novel view synthesis and 3D modeling of complex scenes from multi-view image collections. Numerous recent works have shown the importance of making NeRF models more…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Thibaud Ehret , Roger Marí , Gabriele Facciolo

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

Neural Radiance Fields employ simple volume rendering as a way to overcome the challenges of differentiating through ray-triangle intersections by leveraging a probabilistic notion of visibility. This is achieved by assuming the scene is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Andrea Tagliasacchi , Ben Mildenhall

Efficient and accurate 3D reconstruction is essential for applications in cultural heritage. This study addresses the challenge of visualizing objects within large-scale scenes at a high level of detail (LOD) using Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Quoc-Anh Bui , Gilles Rougeron , Géraldine Morin , Simone Gasparini

Neural Radiance Fields (NeRF) have achieved huge success in effectively capturing and representing 3D objects and scenes. However, to establish a ubiquitous presence in everyday media formats, such as images and videos, we need to fulfill…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Gyeongjin Kang , Younggeun Lee , Seungjun Oh , Eunbyung Park

We propose IBL-NeRF, which decomposes the neural radiance fields (NeRF) of large-scale indoor scenes into intrinsic components. Recent approaches further decompose the baked radiance of the implicit volume into intrinsic components such…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Changwoon Choi , Juhyeon Kim , Young Min Kim

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liqi Yan , Qifan Wang , Junhan Zhao , Qiang Guan , Zheng Tang , Jianhui Zhang , Dongfang Liu

Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiemin Fang , Lingxi Xie , Xinggang Wang , Xiaopeng Zhang , Wenyu Liu , Qi Tian