English
Related papers

Related papers: Registering Neural Radiance Fields as 3D Density I…

200 papers

In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Qunjie Zhou , Maxim Maximov , Or Litany , Laura Leal-Taixé

A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Michael Fischer , Zhengqin Li , Thu Nguyen-Phuoc , Aljaz Bozic , Zhao Dong , Carl Marshall , Tobias Ritschel

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed traditional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Ali Youssef , Francisco Vasconcelos

Neural radiance field (NeRF) is an emerging view synthesis method that samples points in a three-dimensional (3D) space and estimates their existence and color probabilities. The disadvantage of NeRF is that it requires a long training time…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hye Bin Yoo , Hyun Min Han , Sung Soo Hwang , Il Yong Chun

Neural Radiance Fields (NeRF) has demonstrated its superior capability to represent 3D geometry but require accurately precomputed camera poses during training. To mitigate this requirement, existing methods jointly optimize camera poses…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hoang Chuong Nguyen , Wei Mao , Jose M. Alvarez , Miaomiao Liu

Neural Radiance Fields (NeRFs) have emerged as a powerful neural 3D representation for objects and scenes derived from 2D data. Generating NeRFs, however, remains difficult in many scenarios. For instance, training a NeRF with only a small…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Guandao Yang , Abhijit Kundu , Leonidas J. Guibas , Jonathan T. Barron , Ben Poole

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a set of registered images. Increasing sizes of a scene demands more complex functions, typically represented by neural networks, to capture all details. Training and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Tim Elsner , Victor Czech , Julia Berger , Zain Selman , Isaak Lim , Leif Kobbelt

We present Neural Feature Fusion Fields (N3F), a method that improves dense 2D image feature extractors when the latter are applied to the analysis of multiple images reconstructible as a 3D scene. Given an image feature extractor, for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Vadim Tschernezki , Iro Laina , Diane Larlus , Andrea Vedaldi

Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene. In contrast to classical methods that are based on explicit representations such as point clouds, neural fields provide a…

Robotics · Computer Science 2024-02-16 Stephen Hausler , David Hall , Sutharsan Mahendren , Peyman Moghadam

Neural Radiance Fields (NeRFs) have emerged as a groundbreaking paradigm for representing 3D objects and scenes by encoding shape and appearance information into the weights of a neural network. Recent studies have demonstrated that these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Francesco Ballerini , Pierluigi Zama Ramirez , Luigi Di Stefano , Samuele Salti

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

In this paper, we propose a novel learning-based framework for 3D shape registration, which overcomes the challenges of significant non-rigid deformation and partiality undergoing among input shapes, and, remarkably, requires no…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhangquan Chen , Puhua Jiang , Mingze Sun , Ruqi Huang

As a promising fashion for visual localization, scene coordinate regression (SCR) has seen tremendous progress in the past decade. Most recent methods usually adopt neural networks to learn the mapping from image pixels to 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Le Chen , Weirong Chen , Rui Wang , Marc Pollefeys

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ashkan Mirzaei , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Jonathan Kelly , Marcus A. Brubaker , Igor Gilitschenski , Alex Levinshtein

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Neural Radiance Fields (NeRF) have shown impressive capabilities for photorealistic novel view synthesis when trained on dense inputs. However, when trained on sparse inputs, NeRF typically encounters issues of incorrect density or color…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yingji Zhong , Lanqing Hong , Zhenguo Li , Dan Xu