English
Related papers

Related papers: DeepVO: Towards End-to-End Visual Odometry with De…

200 papers

In this work, we propose a novel deep online correction (DOC) framework for monocular visual odometry. The whole pipeline has two stages: First, depth maps and initial poses are obtained from convolutional neural networks (CNNs) trained in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Jiaxin Zhang , Wei Sui , Xinggang Wang , Wenming Meng , Hongmei Zhu , Qian Zhang

Monocular visual odometry (VO) suffers severely from error accumulation during frame-to-frame pose estimation. In this paper, we present a self-supervised learning method for VO with special consideration for consistency over longer…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yuliang Zou , Pan Ji , Quoc-Huy Tran , Jia-Bin Huang , Manmohan Chandraker

Estimating the camera's pose given images from a single camera is a traditional task in mobile robots and autonomous vehicles. This problem is called monocular visual odometry and often relies on geometric approaches that require…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 André O. Françani , Marcos R. O. A. Maximo

While convolutional neural networks have gained impressive success recently in solving structured prediction problems such as semantic segmentation, it remains a challenge to differentiate individual object instances in the scene. Instance…

Machine Learning · Computer Science 2017-07-14 Mengye Ren , Richard S. Zemel

Odometry is of key importance for localization in the absence of a map. There is considerable work in the area of visual odometry (VO), and recent advances in deep learning have brought novel approaches to VO, which directly learn salient…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Wei Wang , Muhamad Risqi U. Saputra , Peijun Zhao , Pedro Gusmao , Bo Yang , Changhao Chen , Andrew Markham , Niki Trigoni

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nan Yang , Rui Wang , Jörg Stückler , Daniel Cremers

This paper presents an self-supervised deep learning network for monocular visual inertial odometry (named DeepVIO). DeepVIO provides absolute trajectory estimation by directly merging 2D optical flow feature (OFF) and Inertial Measurement…

Robotics · Computer Science 2019-07-01 Liming Han , Yimin Lin , Guoguang Du , Shiguo Lian

Deep learning techniques have significantly advanced in providing accurate visual odometry solutions by leveraging large datasets. However, generating uncertainty estimates for these methods remains a challenge. Traditional sensor fusion…

Robotics · Computer Science 2024-03-21 Jagatpreet Singh Nir , Dennis Giaya , Hanumant Singh

Unsupervised learning for monocular camera motion and 3D scene understanding has gained popularity over traditional methods, relying on epipolar geometry or non-linear optimization. Notably, deep learning can overcome many issues of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Claudio Cimarelli , Hriday Bavle , Jose Luis Sanchez-Lopez , Holger Voos

We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth estimation network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Nan Yang , Lukas von Stumberg , Rui Wang , Daniel Cremers

Resource-constrained autonomous robots rely on sparse direct and semi-direct visual-(inertial)-odometry (VO) pipelines, as they provide a favorable tradeoff between accuracy, robustness, and computational cost. However, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Simone Nascivera , Leonard Bauersfeld , Jeff Delaune , Davide Scaramuzza

Recently using convolutional neural networks (CNNs) has gained popularity in visual tracking, due to its robust feature representation of images. Recent methods perform online tracking by fine-tuning a pre-trained CNN model to the specific…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Tianyu Yang , Antoni B. Chan

Inspired by the cognitive process of humans and animals, Curriculum Learning (CL) trains a model by gradually increasing the difficulty of the training data. In this paper, we study whether CL can be applied to complex geometry problems…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Muhamad Risqi U. Saputra , Pedro P. B. de Gusmao , Sen Wang , Andrew Markham , Niki Trigoni

We introduce a novel monocular visual odometry (VO) system, NeRF-VO, that integrates learning-based sparse visual odometry for low-latency camera tracking and a neural radiance scene representation for fine-detailed dense reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Jens Naumann , Binbin Xu , Stefan Leutenegger , Xingxing Zuo

Monocular visual odometry (VO) is a fundamental computer vision problem with applications in autonomous navigation, augmented reality and more. While deep learning-based methods have recently shown superior accuracy compared to traditional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Dominik Kuczkowski , Laura Ruotsalainen

Depth is a vital piece of information for autonomous vehicles to perceive obstacles. Due to the relatively low price and small size of monocular cameras, depth estimation from a single RGB image has attracted great interest in the research…

Robotics · Computer Science 2021-11-25 Xingshuai Dong , Matthew A. Garratt , Sreenatha G. Anavatti , Hussein A. Abbass

We propose a self-supervised learning framework for visual odometry (VO) that incorporates correlation of consecutive frames and takes advantage of adversarial learning. Previous methods tackle self-supervised VO as a local structure from…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Shunkai Li , Fei Xue , Xin Wang , Zike Yan , Hongbin Zha

Convolutional Neural Networks (CNNs) have been recently employed to solve problems from both the computer vision and medical image analysis fields. Despite their popularity, most approaches are only able to process 2D images while most…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Fausto Milletari , Nassir Navab , Seyed-Ahmad Ahmadi

Learning-based monocular visual odometry (VO) poses robustness, generalization, and efficiency challenges in robotics. Recent advances in visual foundation models, such as DINOv2, have improved robustness and generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Maulana Bisyir Azhari , David Hyunchul Shim