English
Related papers

Related papers: LENS: Localization enhanced by NeRF synthesis

200 papers

In this work, we consider the problem of learning end to end perception to control for ground vehicles solely from aerial imagery. Photogrammetric simulators allow the synthesis of novel views through the transformation of pre-generated…

Robotics · Computer Science 2024-10-21 Varun Murali , Guy Rosman , Sertac Karaman , Daniela Rus

Neural Radiance Fields (NeRFs) have made great success in representing complex 3D scenes with high-resolution details and efficient memory. Nevertheless, current NeRF-based pose estimators have no initial pose prediction and are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Zhenxin Zhu , Yuantao Chen , Zirui Wu , Chao Hou , Yongliang Shi , Chuxuan Li , Pengfei Li , Hao Zhao , Guyue Zhou

Neural Radiance Fields (NeRF) have shown remarkable success in image novel view synthesis (NVS), inspiring extensions to LiDAR NVS. However, most methods heavily rely on accurate camera poses for scene reconstruction. The sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yinuo Jiang , Jun Cheng , Yiran Wang , Cheng Cheng

Recently, neural radiance field (NeRF) has shown remarkable performance in novel view synthesis and 3D reconstruction. However, it still requires abundant high-quality images, limiting its applicability in real-world scenarios. To overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaewoo Jung , Jisang Han , Jiwon Kang , Seongchan Kim , Min-Seop Kwak , Seungryong Kim

Recent work on Neural Radiance Fields (NeRF) has demonstrated significant advances in high-quality view synthesis. A major limitation of NeRF is its low rendering efficiency due to the need for multiple network forwardings to render a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yushuang Wu , Xiao Li , Jinglu Wang , Xiaoguang Han , Shuguang Cui , Yan Lu

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Recent advances in 3D scene representation and novel view synthesis have witnessed the rise of Neural Radiance Fields (NeRFs). Nevertheless, it is not trivial to exploit NeRF for the photorealistic 3D scene stylization task, which aims to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zicheng Zhang , Yinglu Liu , Congying Han , Yingwei Pan , Tiande Guo , Ting Yao

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

Neural radiance fields (NeRF) show great success in novel view synthesis. However, in real-world scenes, recovering high-quality details from the source images is still challenging for the existing NeRF-based approaches, due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Kun Zhou , Wenbo Li , Yi Wang , Tao Hu , Nianjuan Jiang , Xiaoguang Han , Jiangbo Lu

Visual relocalization has been a widely discussed problem in 3D vision: given a pre-constructed 3D visual map, the 6 DoF (Degrees-of-Freedom) pose of a query image is estimated. Relocalization in large-scale indoor environments enables…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jiahui Zhang , Shitao Tang , Kejie Qiu , Rui Huang , Chuan Fang , Le Cui , Zilong Dong , Siyu Zhu , Ping Tan

The long-standing problem of novel view synthesis has many applications, notably in sports broadcasting. Photorealistic novel view synthesis of soccer actions, in particular, is of enormous interest to the broadcast industry. Yet only a few…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Sacha Lewin , Maxime Vandegar , Thomas Hoyoux , Olivier Barnich , Gilles Louppe

Neural Radiance Fields (NeRFs) implicitly model continuous three-dimensional scenes using a set of images with known camera poses, enabling the rendering of photorealistic novel views. However, existing NeRF-based methods encounter…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhengyu Zou , Jingfeng Li , Hao Li , Xiaolei Hou , Jinwen Hu , Jingkun Chen , Lechao Cheng , Dingwen Zhang

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision. Existing deep learning approaches for 6D pose estimation typically rely on the assumption of availability of 3D object models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Fu Li , Hao Yu , Ivan Shugurov , Benjamin Busam , Shaowu Yang , Slobodan Ilic

Collaborative mapping of unknown environments can be done faster and more robustly than a single robot. However, a collaborative approach requires a distributed paradigm to be scalable and deal with communication issues. This work presents…

Robotics · Computer Science 2025-08-08 Mahboubeh Asadi , Kourosh Zareinia , Sajad Saeedi

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Neural Radiance Fields (NeRF) have achieved photorealistic novel views synthesis; however, the requirement of accurate camera poses limits its application. Despite analysis-by-synthesis extensions for jointly learning neural 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yue Chen , Xingyu Chen , Xuan Wang , Qi Zhang , Yu Guo , Ying Shan , Fei Wang

Visual localization occupies an important position in many areas such as Augmented Reality, robotics and 3D reconstruction. The state-of-the-art visual localization methods perform pose estimation using geometry based solver within the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Xiaqing Ding , Yue Wang , Li Tang , Yanmei Jiao , Rong Xiong

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

Recently, Neural Radiance Fields (NeRF) has shown promising performances on reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D images. Albeit effective, the performance of NeRF is highly influenced by the quality…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Xuran Pan , Zihang Lai , Shiji Song , Gao Huang