English
Related papers

Related papers: Towards Open World NeRF-Based SLAM

200 papers

Neural implicit representations have recently become popular in simultaneous localization and mapping (SLAM), especially in dense visual SLAM. However, previous works in this direction either rely on RGB-D sensors, or require a separate…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Zihan Zhu , Songyou Peng , Viktor Larsson , Zhaopeng Cui , Martin R. Oswald , Andreas Geiger , Marc Pollefeys

Visual SLAM has regained attention due to its ability to provide perceptual capabilities and simulation test data for Embodied AI. However, traditional SLAM methods struggle to meet the demands of high-quality scene reconstruction, and…

Robotics · Computer Science 2025-09-03 Fan Zhu , Yifan Zhao , Ziyu Chen , Biao Yu , Hui Zhu

We propose a novel end-to-end RGB-D SLAM, iDF-SLAM, which adopts a feature-based deep neural tracker as the front-end and a NeRF-style neural implicit mapper as the back-end. The neural implicit mapper is trained on-the-fly, while though…

Robotics · Computer Science 2022-09-19 Yuhang Ming , Weicai Ye , Andrew Calway

Visual simultaneous localization and mapping (SLAM) plays a critical role in autonomous robotic systems, especially where accurate and reliable measurements are essential for navigation and sensing. In feature-based SLAM, the quantityand…

Robotics · Computer Science 2025-09-03 Haolan Zhang , Chenghao Li , Thanh Nguyen Canh , Lijun Wang , Nak Young Chong

A Simultaneous Localization and Mapping (SLAM) system must be robust to support long-term mobile vehicle and robot applications. However, camera and LiDAR based SLAM systems can be fragile when facing challenging illumination or weather…

Robotics · Computer Science 2021-04-13 Ziyang Hong , Yvan Petillot , Andrew Wallace , Sen Wang

Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ze-Xin Yin , Peng-Yi Jiao , Jiaxiong Qiu , Ming-Ming Cheng , Bo Ren

Neural radiance fields~(NeRF) have recently been applied to render large-scale scenes. However, their limited model capacity typically results in blurred rendering results. Existing large-scale NeRFs primarily address this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Mingqi Shao , Feng Xiong , Hang Zhang , Shuang Yang , Mu Xu , Wei Bian , Xueqian Wang

Active SLAM is the task of actively planning robot paths while simultaneously building a map and localizing within. Existing work has focused on planning paths with occupancy grid maps, which do not scale well and suffer from long term…

Robotics · Computer Science 2016-08-30 Beipeng Mu , Matthew Giamou , Liam Paull , Ali-akbar Agha-mohammadi , John Leonard , Jonathan How

Autonomous vehicles such as the Mars rovers currently lead the vanguard of surface exploration on extraterrestrial planets and moons. In order to accelerate the pace of exploration and science objectives, it is critical to plan safe and…

Robotics · Computer Science 2026-03-19 Adam Dai , Shubh Gupta , Grace Gao

As Neural Radiance Field (NeRF) implementations become faster, more efficient and accurate, their applicability to real world mapping tasks becomes more accessible. Traditionally, 3D mapping, or scene reconstruction, has relied on expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Adam Korycki , Colleen Josephson , Steve McGuire

Simultaneous Localization And Mapping (SLAM) is a task to estimate the robot location and to reconstruct the environment based on observation from sensors such as LIght Detection And Ranging (LiDAR) and camera. It is widely used in robotic…

Robotics · Computer Science 2021-02-18 Han Wang , Chen Wang , Lihua Xie

With the emergence of Neural Radiance Fields (NeRF), neural implicit representations have gained widespread applications across various domains, including simultaneous localization and mapping. However, current neural implicit SLAM faces a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zhiyao Zhang , Yunzhou Zhang , Yanmin Wu , Bin Zhao , Xingshuo Wang , Rui Tian

Enabling robots to understand the world in terms of objects is a critical building block towards higher level autonomy. The success of foundation models in vision has created the ability to segment and identify nearly all objects in the…

Robotics · Computer Science 2024-04-09 Kurran Singh , Tim Magoun , John J. Leonard

Recently, ray tracing has gained renewed interest with the advent of Reflective Intelligent Surfaces (RIS) technology, a key enabler of 6G wireless communications due to its capability of intelligent manipulation of electromagnetic waves.…

Information Theory · Computer Science 2024-11-07 Huiying Yang , Zihan Jin , Chenhao Wu , Rujing Xiong , Robert Caiming Qiu , Zenan Ling

As a promising fashion for visual localization, scene coordinate regression (SCR) has seen tremendous progress in the past decade. Most recent methods usually adopt neural networks to learn the mapping from image pixels to 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Le Chen , Weirong Chen , Rui Wang , Marc Pollefeys

Robots operating in the open world encounter various different environments that can substantially differ from each other. This domain gap also poses a challenge for Simultaneous Localization and Mapping (SLAM) being one of the fundamental…

Robotics · Computer Science 2023-03-14 Niclas Vödisch , Daniele Cattaneo , Wolfram Burgard , Abhinav Valada

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel views, unlocking…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Huajian Huang , Yingshu Chen , Tianjia Zhang , Sai-Kit Yeung

In this work, we address the challenge of deploying Neural Radiance Field (NeRFs) in Simultaneous Localization and Mapping (SLAM) under the condition of lacking depth information, relying solely on RGB inputs. The key to unlocking the full…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Junru Lin , Asen Nachkov , Songyou Peng , Luc Van Gool , Danda Pani Paudel

Simultaneous localisation and mapping (SLAM) is the problem of autonomous robots to construct or update a map of an undetermined unstructured environment while simultaneously estimate the pose in it. The current trend towards self-driving…

Robotics · Computer Science 2023-02-14 B. Udugama

SLAM is a fundamental component of modern autonomous systems, providing robots and their operators with a deeper understanding of their environment. SLAM systems often encounter challenges due to the dynamic nature of robotic motion,…

Robotics · Computer Science 2025-04-29 Leon Davies , Baihua Li , Mohamad Saada , Simon Sølvsten , Qinggang Meng