English
Related papers

Related papers: Instance Neural Radiance Field

200 papers

A neural radiance field (NeRF) is a scene model supporting high-quality view synthesis, optimized per scene. In this paper, we explore enabling user editing of a category-level NeRF - also known as a conditional radiance field - trained on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Steven Liu , Xiuming Zhang , Zhoutong Zhang , Richard Zhang , Jun-Yan Zhu , Bryan Russell

In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Qunjie Zhou , Maxim Maximov , Or Litany , Laura Leal-Taixé

This paper presents the first significant work on directly predicting 3D face landmarks on neural radiance fields (NeRFs). Our 3D coarse-to-fine Face Landmarks NeRF (FLNeRF) model efficiently samples from a given face NeRF with individual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Hao Zhang , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Letian Zhang , Ming Li , Chen Chen , Jie Xu

We introduce Neural Radiance and Gaze Fields (NeRGs), a novel approach for representing visual attention in complex environments. Much like how Neural Radiance Fields (NeRFs) perform novel view synthesis, NeRGs reconstruct gaze patterns…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Andrei Chubarau , Yinan Wang , James J. Clark

Neural radiance fields (NeRF) have gained prominence as a machine learning technique for representing 3D scenes and estimating the bidirectional reflectance distribution function (BRDF) from multiple images. However, most existing research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Lulin Zhang , Ewelina Rupnik , Tri Dung Nguyen , Stéphane Jacquemoud , Yann Klinger

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Pascal Fua

Neural radiance fields (NeRF) methods have demonstrated impressive novel view synthesis performance. The core approach is to render individual rays by querying a neural network at points sampled along the ray to obtain the density and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Relja Arandjelović , Andrew Zisserman

Radiance Fields (RF) are popular to represent casually-captured scenes for new view synthesis and several applications beyond it. Mixed reality on personal spaces needs understanding and manipulating scenes represented as RFs, with semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rahul Goel , Dhawal Sirikonda , Saurabh Saini , PJ Narayanan

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world. However, it is still a very demanding task to repaint the content in NeRF. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xingchen Zhou , Ying He , F. Richard Yu , Jianqiang Li , You Li

Learning a 3D representation of a scene has been a challenging problem for decades in computer vision. Recent advances in implicit neural representation from images using neural radiance fields(NeRF) have shown promising results. Some of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Andrew I. Comport

Modern 3D semantic instance segmentation approaches predominantly rely on specialized voting mechanisms followed by carefully designed geometric clustering techniques. Building on the successes of recent Transformer-based methods for object…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jonas Schult , Francis Engelmann , Alexander Hermans , Or Litany , Siyu Tang , Bastian Leibe

Recently, progress in acquisition equipment such as LiDAR sensors has enabled sensing increasingly spacious outdoor 3D environments. Making sense of such 3D acquisitions requires fine-grained scene understanding, such as constructing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Cedric Perauer , Laurenz Adrian Heidrich , Haifan Zhang , Matthias Nießner , Anastasiia Kornilova , Alexey Artemov

We propose GazeNeRF, a 3D-aware method for the task of gaze redirection. Existing gaze redirection methods operate on 2D images and struggle to generate 3D consistent results. Instead, we build on the intuition that the face region and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Alessandro Ruzzi , Xiangwei Shi , Xi Wang , Gengyan Li , Shalini De Mello , Hyung Jin Chang , Xucong Zhang , Otmar Hilliges

Recent advances in Neural Radiance Fields (NeRF) have shown great potential in 3D reconstruction and novel view synthesis, particularly for indoor and small-scale scenes. However, extending NeRF to large-scale outdoor environments presents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yizhou Li , Yusuke Monno , Masatoshi Okutomi , Yuuichi Tanaka , Seiichi Kataoka , Teruaki Kosiba

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Neural radiance fields (NeRFs) have exhibited potential in synthesizing high-fidelity views of 3D scenes but the standard training paradigm of NeRF presupposes an equal importance for each image in the training set. This assumption poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Rongkai Ma , Leo Lebrat , Rodrigo Santa Cruz , Gil Avraham , Yan Zuo , Clinton Fookes , Olivier Salvado