English
Related papers

Related papers: Learning Monocular Visual Odometry via Self-Superv…

200 papers

For the task of simultaneous monocular depth and visual odometry estimation, we propose learning self-supervised transformer-based models in two steps. Our first step consists in a generic pretraining to learn 3D geometry, using cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Boris Chidlovskii , Leonid Antsfeld

One of the main open challenges in visual odometry (VO) is the robustness to difficult illumination conditions or high dynamic range (HDR) environments. The main difficulties in these situations come from both the limitations of the sensors…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Ruben Gomez-Ojeda , Zichao Zhang , Javier Gonzalez-Jimenez , Davide Scaramuzza

Monocular visual odometry (VO) has attracted extensive research attention by providing real-time vehicle motion from cost-effective camera images. However, state-of-the-art optimization-based monocular VO methods suffer from the scale…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Sen Zhang , Jing Zhang , Dacheng Tao

In this work we present WGANVO, a Deep Learning based monocular Visual Odometry method. In particular, a neural network is trained to regress a pose estimate from an image pair. The training is performed using a semi-supervised approach.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Javier Cremona , Lucas Uzal , Taihú Pire

In recent years, unsupervised deep learning approaches have received significant attention to estimate the depth and visual odometry (VO) from unlabelled monocular image sequences. However, their performance is limited in challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yasin Almalioglu , Angel Santamaria-Navarro , Benjamin Morrell , Ali-akbar Agha-mohammadi

Unsupervised learning for monocular camera motion and 3D scene understanding has gained popularity over traditional methods, relying on epipolar geometry or non-linear optimization. Notably, deep learning can overcome many issues of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Claudio Cimarelli , Hriday Bavle , Jose Luis Sanchez-Lopez , Holger Voos

Multi-view geometry-based methods dominate the last few decades in monocular Visual Odometry for their superior performance, while they have been vulnerable to dynamic and low-texture scenes. More importantly, monocular methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Huangying Zhan , Chamara Saroj Weerasekera , Jia-Wang Bian , Ravi Garg , Ian Reid

Hybrid pipelines that combine deep learning with classical optimization have established themselves as the dominant approach to visual odometry (VO). By integrating neural network predictions with bundle adjustment, these models estimate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Vlardimir Yugay , Duy-Kien Nguyen , Theo Gevers , Cees G. M. Snoek , Martin R. Oswald

Visual odometry (VO) and SLAM have been using multi-view geometry via local structure from motion for decades. These methods have a slight disadvantage in challenging scenarios such as low-texture images, dynamic scenarios, etc. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Akankshya Kar , Sajal Maheshwari , Shamit Lal , Vinay Sameer Raja Kad

We propose a novel deep visual odometry (VO) method that considers global information by selecting memory and refining poses. Existing learning-based methods take the VO task as a pure tracking problem via recovering camera poses from image…

Robotics · Computer Science 2020-08-05 Fei Xue , Xin Wang , Junqiu Wang , Hongbin Zha

The technology for Visual Odometry (VO) that estimates the position and orientation of the moving object through analyzing the image sequences captured by on-board cameras, has been well investigated with the rising interest in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Ran Zhu , Mingkun Yang , Wang Liu , Rujun Song , Bo Yan , Zhuoling Xiao

Recently, learning-based robotic navigation systems have gained extensive research attention and made significant progress. However, the diversity of open-world scenarios poses a major challenge for the generalization of such systems to…

Robotics · Computer Science 2025-04-17 Xingwu Ji , Haochen Niu , Dexin Duan , Rendong Ying , Fei Wen , Peilin Liu

Recent visual odometry (VO) methods incorporating geometric algorithm into deep-learning architecture have shown outstanding performance on the challenging monocular VO task. Despite encouraging results are shown, previous methods ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Yijun Cao , Xianshi Zhang , Fuya Luo , Peng Peng , Yongjie Li

We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth estimation network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Nan Yang , Lukas von Stumberg , Rui Wang , Daniel Cremers

Most learning-based methods estimate ego-motion by utilizing visual sensors, which suffer from dramatic lighting variations and textureless scenarios. In this paper, we incorporate sparse but accurate depth measurements obtained from lidars…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Bin Li , Mu Hu , Shuling Wang , Lianghao Wang , Xiaojin Gong

For ego-motion estimation, the feature representation of the scenes is crucial. Previous methods indicate that both the low-level and semantic feature-based methods can achieve promising results. Therefore, the incorporation of hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Xiaochuan Yin , Chengju Liu

Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nan Yang , Rui Wang , Jörg Stückler , Daniel Cremers

While many visual ego-motion algorithm variants have been proposed in the past decade, learning based ego-motion estimation methods have seen an increasing attention because of its desirable properties of robustness to image noise and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Guangyao Zhai , Liang Liu , Linjian Zhang , Yong Liu

This paper proposes a new framework to solve the problem of monocular visual odometry, called MagicVO . Based on Convolutional Neural Network (CNN) and Bi-directional LSTM (Bi-LSTM), MagicVO outputs a 6-DoF absolute-scale pose at each…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Jian Jiao , Jichao Jiao , Yaokai Mo , Weilun Liu , Zhongliang Deng

Visual Odometry (VO) is used in many applications including robotics and autonomous systems. However, traditional approaches based on feature matching are computationally expensive and do not directly address failure cases, instead relying…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Nimet Kaygusuz , Oscar Mendez , Richard Bowden