English
Related papers

Related papers: 3D Visibility-aware Generalizable Neural Radiance …

200 papers

In recent advancements in novel view synthesis, generalizable Neural Radiance Fields (NeRF) based methods applied to human subjects have shown remarkable results in generating novel views from few images. However, this generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Arnab Dey , Di Yang , Antitza Dantcheva , Jean Martinet

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

We present a novel approach for synthesizing realistic novel views using Neural Radiance Fields (NeRF) with uncontrolled photos in the wild. While NeRF has shown impressive results in controlled settings, it struggles with transient objects…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Shuaixian Wang , Haoran Xu , Yaokun Li , Jiwei Chen , Guang Tan

Neural Radiance Fields (NeRFs) have emerged as promising digital mediums of 3D objects and scenes, sparking a surge in research to extend the editing capabilities in this domain. The task of seamless editing and merging of multiple NeRFs,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

The neural radiance fields (NeRF) have emerged as a prominent methodology for synthesizing realistic images of novel views. While neural radiance representations based on voxels or mesh individually offer distinct advantages, excelling in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Chenhao Zhang , Yongyang Zhou , Lei Zhang

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

High-fidelity 4D dynamic facial avatar reconstruction from monocular video is a critical yet challenging task, driven by increasing demands for immersive virtual human applications. While Neural Radiance Fields (NeRF) have advanced scene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Zhe Chang , Haodong Jin , Ying Sun , Yan Song , Hui Yu

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Neural Radiance Field (NeRF) regresses a neural parameterized scene by differentially rendering multi-view images with ground-truth supervision. However, when interpolating novel views, NeRF often yields inconsistent and visually non-smooth…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Tianlong Chen , Peihao Wang , Zhiwen Fan , Zhangyang Wang

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ashkan Mirzaei , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Jonathan Kelly , Marcus A. Brubaker , Igor Gilitschenski , Alex Levinshtein

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

In this paper, we address the challenge of decomposing Neural Radiance Fields (NeRF) into objects from an open vocabulary, a critical task for object manipulation in 3D reconstruction and view synthesis. Current techniques for NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Hao Zhang , Fang Li , Narendra Ahuja

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

The development of Neural Radiance Fields (NeRFs) has provided a potent representation for encapsulating the geometric and appearance characteristics of 3D scenes. Enhancing the capabilities of NeRFs in open-vocabulary 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guibiao Liao , Kaichen Zhou , Zhenyu Bao , Kanglin Liu , Qing Li