English
Related papers

Related papers: Vision-Only Robot Navigation in a Neural Radiance …

200 papers

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

The proliferation of technologies, such as extended reality (XR), has increased the demand for high-quality three-dimensional (3D) graphical representations. Industrial 3D applications encompass computer-aided design (CAD), finite element…

Robotics · Computer Science 2025-04-25 Eugen Šlapak , Enric Pardo , Matúš Dopiriak , Taras Maksymyuk , Juraj Gazda

Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Prune Truong , Marie-Julie Rakotosaona , Fabian Manhardt , Federico Tombari

Neural Signed Distance Fields (SDFs) provide a differentiable environment representation to readily obtain collision checks and well-defined gradients for robot navigation tasks. However, updating neural SDFs as the scene evolves entails…

Robotics · Computer Science 2025-03-07 S. Talha Bukhari , Daniel Lawson , Ahmed H. Qureshi

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

Pose-free neural radiance fields (NeRF) aim to train NeRF with unposed multi-view images and it has achieved very impressive success in recent years. Most existing works share the pipeline of training a coarse pose estimator with rendered…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Jiahui Zhang , Fangneng Zhan , Yingchen Yu , Kunhao Liu , Rongliang Wu , Xiaoqin Zhang , Ling Shao , Shijian Lu

Dynamic scene reconstruction for autonomous driving enables vehicles to perceive and interpret complex scene changes more precisely. Dynamic Neural Radiance Fields (NeRFs) have recently shown promising capability in scene modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Yue Wen , Liang Song , Yijia Liu , Siting Zhu , Yanzi Miao , Lijun Han , Hesheng Wang

Neural Radiance Fields (NeRF) have emerged as a paradigm-shifting methodology for the photorealistic rendering of objects and environments, enabling the synthesis of novel viewpoints with remarkable fidelity. This is accomplished through…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Peng Tu , Xun Zhou , Mingming Wang , Xiaojun Yang , Bo Peng , Ping Chen , Xiu Su , Yawen Huang , Yefeng Zheng , Chang Xu

In this study, we introduce the DriveEnv-NeRF framework, which leverages Neural Radiance Fields (NeRF) to enable the validation and faithful forecasting of the efficacy of autonomous driving agents in a targeted real-world scene. Standard…

Robotics · Computer Science 2024-05-31 Mu-Yi Shen , Chia-Chi Hsu , Hao-Yu Hou , Yu-Chen Huang , Wei-Fang Sun , Chia-Che Chang , Yu-Lun Liu , Chun-Yi Lee

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Current robotic grasping methods often rely on estimating the pose of the target object, explicitly predicting grasp poses, or implicitly estimating grasp success probabilities. In this work, we propose a novel approach that directly maps…

Robotics · Computer Science 2023-09-18 Gergely Sóti , Björn Hein , Christian Wurll

Recent advances in neural radiance fields (NeRFs) achieve state-of-the-art novel view synthesis and facilitate dense estimation of scene properties. However, NeRFs often fail for large, unbounded scenes that are captured under very sparse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Alexandra Carlson , Manikandasriram Srinivasan Ramanagopal , Nathan Tseng , Matthew Johnson-Roberson , Ram Vasudevan , Katherine A. Skinner

3D representation disentanglement aims to identify, decompose, and manipulate the underlying explanatory factors of 3D data, which helps AI fundamentally understand our 3D world. This task is currently under-explored and poses great…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Baao Xie , Bohan Li , Zequn Zhang , Junting Dong , Xin Jin , Jingyu Yang , Wenjun Zeng

Neural Radiance Fields (NeRFs) have emerged as powerful tools for capturing detailed 3D scenes through continuous volumetric representations. Recent NeRFs utilize feature grids to improve rendering quality and speed; however, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Tuan Pham , Stephan Mandt

We introduce a novel monocular visual odometry (VO) system, NeRF-VO, that integrates learning-based sparse visual odometry for low-latency camera tracking and a neural radiance scene representation for fine-detailed dense reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Jens Naumann , Binbin Xu , Stefan Leutenegger , Xingxing Zuo

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

Visual relocalization is a key technique to autonomous driving, robotics, and virtual/augmented reality. After decades of explorations, absolute pose regression (APR), scene coordinate regression (SCR), and hierarchical methods (HMs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Fei Xue , Ignas Budvytis , Daniel Olmeda Reino , Roberto Cipolla

Neural radiance fields (NeRF) excel at synthesizing new views given multi-view, calibrated images of a static scene. When scenes include distractors, which are not persistent during image capture (moving objects, lighting variations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Sara Sabour , Suhani Vora , Daniel Duckworth , Ivan Krasin , David J. Fleet , Andrea Tagliasacchi

Neural Radiance Fields (NeRFs) have demonstrated amazing ability to synthesize images of 3D scenes from novel views. However, they rely upon specialized volumetric rendering algorithms based on ray marching that are mismatched to the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zhiqin Chen , Thomas Funkhouser , Peter Hedman , Andrea Tagliasacchi

Neural Radiance Fields (NeRF) presented a novel way to represent scenes, allowing for high-quality 3D reconstruction from 2D images. Following its remarkable achievements, global localization within NeRF maps is an essential task for…

Robotics · Computer Science 2025-03-17 Mangyu Kong , Seongwon Lee , Jaewon Lee , Euntai Kim