English
Related papers

Related papers: Learning by Inertia: Self-supervised Monocular Vis…

200 papers

In this paper we present an on-manifold sequence-to-sequence learning approach to motion estimation using visual and inertial sensors. It is to the best of our knowledge the first end-to-end trainable method for visual-inertial odometry…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Ronald Clark , Sen Wang , Hongkai Wen , Andrew Markham , Niki Trigoni

Visual odometry (VO) and SLAM have been using multi-view geometry via local structure from motion for decades. These methods have a slight disadvantage in challenging scenarios such as low-texture images, dynamic scenarios, etc. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Akankshya Kar , Sajal Maheshwari , Shamit Lal , Vinay Sameer Raja Kad

One of the key challenges in high speed off road navigation on ground vehicles is that the kinodynamics of the vehicle terrain interaction can differ dramatically depending on the terrain. Previous approaches to addressing this challenge…

The research into autonomous driving applications has observed an increase in computer vision-based approaches in recent years. In attempts to develop exclusive vision-based systems, visual odometry is often considered as a key element to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Kai Li Lim , Thomas Bräunl

Mobile robots rely on odometry to navigate through areas where localization fails. Visual odometry (VO) is a common solution for obtaining robust and consistent relative motion estimates of the vehicle frame. Contrarily, Global Positioning…

Robotics · Computer Science 2021-06-09 Benjamin Congram , Timothy D. Barfoot

We introduce ZeroVO, a novel visual odometry (VO) algorithm that achieves zero-shot generalization across diverse cameras and environments, overcoming limitations in existing methods that depend on predefined or static camera calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Lei Lai , Zekai Yin , Eshed Ohn-Bar

We propose the MAC-VO, a novel learning-based stereo VO that leverages the learned metrics-aware matching uncertainty for dual purposes: selecting keypoint and weighing the residual in pose graph optimization. Compared to traditional…

Robotics · Computer Science 2025-03-13 Yuheng Qiu , Yutian Chen , Zihao Zhang , Wenshan Wang , Sebastian Scherer

Cameras and inertial measurement units are complementary sensors for ego-motion estimation and environment mapping. Their combination makes visual-inertial odometry (VIO) systems more accurate and robust. For globally consistent mapping,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Vladyslav Usenko , Nikolaus Demmel , David Schubert , Jörg Stückler , Daniel Cremers

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Rui Wang , Stephen M. Pizer , Jan-Michael Frahm

This paper addresses the robustness problem of visual-inertial state estimation for underwater operations. Underwater robots operating in a challenging environment are required to know their pose at all times. All vision-based localization…

Robotics · Computer Science 2023-04-05 Bharat Joshi , Hunter Damron , Sharmin Rahman , Ioannis Rekleitis

Estimating depth from a single image represents an attractive alternative to more traditional approaches leveraging multiple cameras. In this field, deep learning yielded outstanding results at the cost of needing large amounts of data…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Lorenzo Andraghetti , Panteleimon Myriokefalitakis , Pier Luigi Dovesi , Belen Luque , Matteo Poggi , Alessandro Pieropan , Stefano Mattoccia

Autonomous driving systems are highly dependent on sensors like cameras, LiDAR, and inertial measurement units (IMU) to perceive the environment and estimate their motion. Among these sensors, perception-based sensors are not protected from…

The increasing demand for autonomous vehicles has created a need for robust navigation systems that can also operate effectively in adverse weather conditions. Visual odometry is a technique used in these navigation systems, enabling the…

Event cameras open up new possibilities for robotic perception due to their low latency and high dynamic range. On the other hand, developing effective event-based vision algorithms that fully exploit the beneficial properties of event…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Daqi Liu , Alvaro Parra , Yasir Latif , Bo Chen , Tat-Jun Chin , Ian Reid

Data-driven visual odometry (VO) is a critical subroutine for autonomous edge robotics, and recent progress in the field has produced highly accurate point predictions in complex environments. However, emerging autonomous edge robotics…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Alex C. Stutts , Danilo Erricolo , Theja Tulabandhula , Amit Ranjan Trivedi

Dynamic scenes that contain both object motion and egomotion are a challenge for monocular visual odometry (VO). Another issue with monocular VO is the scale ambiguity, i.e. these methods cannot estimate scene depth and camera motion in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Hirak J Kashyap , Charless Fowlkes , Jeffrey L Krichmar

Visual motion estimation is a well-studied challenge in autonomous navigation. Recent work has focused on addressing multimotion estimation in highly dynamic environments. These environments not only comprise multiple, complex motions but…

Robotics · Computer Science 2024-09-18 Kevin M. Judd , Jonathan D. Gammell

Visual odometry techniques typically rely on feature extraction from a sequence of images and subsequent computation of optical flow. This point-to-point correspondence between two consecutive frames can be costly to compute and suffers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Chenqi Zhu , Levi Burner , Yiannis Aloimonos

Visual-Inertial odometry (VIO) is the process of estimating the state (pose and velocity) of an agent (e.g., an aerial robot) by using only the input of one or more cameras plus one or more Inertial Measurement Units (IMUs) attached to it.…

Robotics · Computer Science 2019-06-17 Davide Scaramuzza , Zichao Zhang

Neglecting the effects of rolling-shutter cameras for visual odometry (VO) severely degrades accuracy and robustness. In this paper, we propose a novel direct monocular VO method that incorporates a rolling-shutter model. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 David Schubert , Nikolaus Demmel , Vladyslav Usenko , Jörg Stückler , Daniel Cremers