English
Related papers

Related papers: NeRF-VIO: Map-Based Visual-Inertial Odometry with …

200 papers

Implicit Neural Representations (INRs) are a versatile and powerful tool for encoding various forms of data, including images, videos, sound, and 3D shapes. A critical factor in the success of INRs is the initialization of the network,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chamin Hewa Koneputugodage , Yizhak Ben-Shabat , Sameera Ramasinghe , Stephen Gould

This study presents an innovative hybrid Visual-Inertial Odometry (VIO) method for Unmanned Aerial Vehicles (UAVs) that is resilient to environmental challenges and capable of dynamically assessing sensor reliability. Built upon a loosely…

Robotics · Computer Science 2025-12-22 Ufuk Asil , Efendi Nasibov

Visual Inertial Odometry (VIO) is a widely used computer vision method that determines an agent's movement through a camera and an IMU sensor. This paper presents an efficient and accurate VIO pipeline optimized for applications on micro-…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Jonas Kühne , Christian Vogt , Michele Magno , Luca Benini

A novel relative localization approach for guidance of a micro-scale Unmanned Aerial Vehicle (UAV) by a well-equipped aerial robot fusing Visual-Inertial Odometry (VIO) with Light Detection and Ranging (LiDAR) is proposed in this paper.…

Robotics · Computer Science 2026-03-05 Václav Pritzl , Matouš Vrba , Petr Štěpán , Martin Saska

Optical Flow (OF) and depth are commonly used for visual odometry since they provide sufficient information about camera ego-motion in a rigid scene. We reformulate the problem of ego-motion estimation as a problem of motion estimation of a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Igor Slinko , Anna Vorontsova , Filipp Konokhov , Olga Barinova , Anton Konushin

In this work, we present a lightweight, tightly-coupled deep depth network and visual-inertial odometry (VIO) system, which can provide accurate state estimates and dense depth maps of the immediate surroundings. Leveraging the proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Xingxing Zuo , Nathaniel Merrill , Wei Li , Yong Liu , Marc Pollefeys , Guoquan Huang

Visual-Inertial Odometry (VIO) utilizes an Inertial Measurement Unit (IMU) to overcome the limitations of Visual Odometry (VO). However, the VIO for vehicles in large-scale outdoor environments still has some difficulties in estimating…

Robotics · Computer Science 2017-08-15 Chang-Ryeol Lee , Kuk-Jin Yoon

Accurate, infrastructure-less sensor systems for motion tracking are essential for mobile robotics and augmented reality (AR) applications. The most popular state-of-the-art visual-inertial odometry (VIO) systems, however, are too…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Jonas Kühne , Christian Vogt , Michele Magno , Luca Benini

Modern Neural Radiance Fields (NeRFs) learn a mapping from position to volumetric density leveraging proposal network samplers. In contrast to the coarse-to-fine sampling approach with two NeRFs, this offers significant potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Lukas Radl , Andreas Kurz , Michael Steiner , Markus Steinberger

In recent years, Visual-Inertial Odometry (VIO) has achieved many significant progresses. However, VIO methods suffer from localization drift over long trajectories. In this paper, we propose a First-Estimates Jacobian…

Robotics · Computer Science 2022-07-19 Shenhan Jia , Yanmei Jiao , Zhuqing Zhang , Rong Xiong , Yue Wang

Precise geolocalization is crucial for unmanned aerial vehicles (UAVs). However, most current deployed UAVs rely on the global navigation satellite systems (GNSS) or high precision inertial navigation systems (INS) for geolocalization. In…

Robotics · Computer Science 2023-01-02 Jun Mao , Lilian Zhang , Xiaofeng He , Hao Qu , Xiaoping Hu

We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene. Given a single observed RGB image of the target, we can predict the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yunzhi Lin , Thomas Müller , Jonathan Tremblay , Bowen Wen , Stephen Tyree , Alex Evans , Patricio A. Vela , Stan Birchfield

In this paper, we propose a Neural Radiance Fields (NeRF) based framework, referred to as Novel View Synthesis Framework (NVSF). It jointly learns the implicit neural representation of space and time-varying scene for both LiDAR and Camera.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Gaurav Sharma , Ravi Kothari , Josef Schmid

With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin

We present an end-to-end system for the high-fidelity capture, model reconstruction, and real-time rendering of walkable spaces in virtual reality using neural radiance fields. To this end, we designed and built a custom multi-camera rig to…

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin

Reconstructing category-specific objects using Neural Radiance Field (NeRF) from a single image is a promising yet challenging task. Existing approaches predominantly rely on projection-based feature retrieval to associate 3D points in the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Kun Wang , Zhiqiang Yan , Zhenyu Zhang , Xiang Li , Jun Li , Jian Yang

Visual odometry (VO) is essential for enabling accurate point-goal navigation of embodied agents in indoor environments where GPS and compass sensors are unreliable and inaccurate. However, traditional VO methods face challenges in…

Robotics · Computer Science 2024-11-08 Sayan Paul , Ruddra dev Roychoudhury , Brojeshwar Bhowmick

In past few years we have observed an increase in the usage of RGBD sensors in mobile devices. These sensors provide a good estimate of the depth map for the camera frame, which can be used in numerous augmented reality applications. This…

Robotics · Computer Science 2021-10-22 Abhishek Tyagi , Yangwen Liang , Shuangquan Wang , Dongwoon Bai