English
Related papers

Related papers: NeRF-VIO: Map-Based Visual-Inertial Odometry with …

200 papers

Odometry estimation is crucial for every autonomous system requiring navigation in an unknown environment. In modern mobile robots, 3D LiDAR-inertial systems are often used for this task. By fusing LiDAR scans and IMU measurements, these…

Visual Inertial Odometry (VIO) is one of the most established state estimation methods for mobile platforms. However, when visual tracking fails, VIO algorithms quickly diverge due to rapid error accumulation during inertial data…

Robotics · Computer Science 2023-06-13 Russell Buchanan , Varun Agrawal , Marco Camurri , Frank Dellaert , Maurice Fallon

In recent years, the technology in visual-inertial odometry (VIO) has matured considerably and has been widely used in many applications. However, we still encounter challenges when applying VIO to a micro air vehicle (MAV) equipped with a…

Robotics · Computer Science 2023-11-17 Bo Dong , Yongkang Tao , Deng Peng , Zhigang Fu

Visual-inertial-odometry has attracted extensive attention in the field of autonomous driving and robotics. The size of Field of View (FoV) plays an important role in Visual-Odometry (VO) and Visual-Inertial-Odometry (VIO), as a large FoV…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Ze Wang , Kailun Yang , Hao Shi , Peng Li , Fei Gao , Kaiwei Wang

This paper presents a lightweight LiDAR-inertial-visual odometry system optimized for resource-constrained platforms. It integrates a degeneration-aware adaptive visual frame selector into error-state iterated Kalman filter (ESIKF) with…

Robotics · Computer Science 2025-01-24 Bingyang Zhou , Chunran Zheng , Ziming Wang , Fangcheng Zhu , Yixi Cai , Fu Zhang

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Visual relocalization is a key technique to autonomous driving, robotics, and virtual/augmented reality. After decades of explorations, absolute pose regression (APR), scene coordinate regression (SCR), and hierarchical methods (HMs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Fei Xue , Ignas Budvytis , Daniel Olmeda Reino , Roberto Cipolla

Radar ensures robust sensing capabilities in adverse weather conditions, yet challenges remain due to its high inherent noise level. Existing radar odometry has overcome these challenges with strategies such as filtering spurious points,…

Robotics · Computer Science 2025-02-25 Wooseong Yang , Hyesu Jang , Ayoung Kim

We propose a novel visual localization and navigation framework for real-world environments directly integrating observed visual information into the bird-eye-view map. While the renderable neural radiance map (RNR-Map) shows considerable…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Minsoo Kim , Obin Kwon , Howoong Jun , Songhwai Oh

Neural radiance fields (NeRFs) have shown impressive results for novel view synthesis. However, they depend on the repetitive use of a single-input single-output multilayer perceptron (SISO MLP) that maps 3D coordinates and view direction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Takuhiro Kaneko

Visual-Inertial Odometry (VIO) is a staple for reliable state estimation on constrained and lightweight platforms due to its versatility and demonstrated performance. However, pertinent challenges regarding robust operation in dark,…

Robotics · Computer Science 2026-03-26 Morten Nissov , Mohit Singh , Kostas Alexis

Cameras and inertial measurement units are complementary sensors for ego-motion estimation and environment mapping. Their combination makes visual-inertial odometry (VIO) systems more accurate and robust. For globally consistent mapping,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Vladyslav Usenko , Nikolaus Demmel , David Schubert , Jörg Stückler , Daniel Cremers

Odometry estimation using light detection and ranging (LiDAR) and an inertial measurement unit (IMU), known as LiDAR-inertial odometry (LIO), often suffers from performance degradation in degenerate environments, such as long corridors or…

Robotics · Computer Science 2026-04-06 Seongjun Kim , Daehan Lee , Junwoo Hong , Sanghyun Park , Hyunyoung Jo , Soohee Han

Localization is paramount for autonomous robots. While camera and LiDAR-based approaches have been extensively investigated, they are affected by adverse illumination and weather conditions. Therefore, radar sensors have recently gained…

Robotics · Computer Science 2024-11-05 Abhijeet Nayak , Daniele Cattaneo , Abhinav Valada

Visual localization is a critical task in mobile robotics, and researchers are continuously developing new approaches to enhance its efficiency. In this article, we propose a novel approach to improve the accuracy of visual localization…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Artem Nenashev , Mikhail Kurenkov , Andrei Potapov , Iana Zhura , Maksim Katerishich , Dzmitry Tsetserukou

Invariant Extended Kalman Filter (IEKF) has been successfully applied in Visual-inertial Odometry (VIO) as an advanced achievement of Kalman filter, showing great potential in sensor fusion. In this paper, we propose partial IEKF (PIEKF),…

Robotics · Computer Science 2023-03-15 Tong Hua , Tao Li , Ling Pei

We propose a novel type of map for visual navigation, a renderable neural radiance map (RNR-Map), which is designed to contain the overall visual information of a 3D environment. The RNR-Map has a grid form and consists of latent codes at…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Obin Kwon , Jeongho Park , Songhwai Oh

Visual-inertial odometry (VIO) is widely used for mobile robot localization, but its long-term accuracy degrades without global constraints. Incorporating ranging sensors such as ultra-wideband (UWB) can mitigate drift; however,…

Robotics · Computer Science 2026-04-17 Yu-An Liu , Li Zhang

This paper presents Neural Visibility Field (NVF), a novel uncertainty quantification method for Neural Radiance Fields (NeRF) applied to active mapping. Our key insight is that regions not visible in the training views lead to inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Shangjie Xue , Jesse Dill , Pranay Mathur , Frank Dellaert , Panagiotis Tsiotras , Danfei Xu