English
Related papers

Related papers: Towards Visual Ego-motion Learning in Robots

200 papers

The technology for Visual Odometry (VO) that estimates the position and orientation of the moving object through analyzing the image sequences captured by on-board cameras, has been well investigated with the rising interest in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Ran Zhu , Mingkun Yang , Wang Liu , Rujun Song , Bo Yan , Zhuoling Xiao

We present a self-supervised approach to ignoring "distractors" in camera images for the purposes of robustly estimating vehicle motion in cluttered urban environments. We leverage offline multi-session mapping approaches to automatically…

Robotics · Computer Science 2018-03-06 Dan Barnes , Will Maddern , Geoffrey Pascoe , Ingmar Posner

We propose XVO, a semi-supervised learning method for training generalized monocular Visual Odometry (VO) models with robust off-the-self operation across diverse datasets and settings. In contrast to standard monocular VO approaches which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Lei Lai , Zhongkai Shangguan , Jimuyang Zhang , Eshed Ohn-Bar

Visual odometry (VO) is a prevalent way to deal with the relative localization problem, which is becoming increasingly mature and accurate, but it tends to be fragile under challenging environments. Comparing with classical geometry-based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Ke Wang , Sai Ma , Junlan Chen , Fan Ren

In this paper, we present iDVO (inertia-embedded deep visual odometry), a self-supervised learning based monocular visual odometry (VO) for road vehicles. When modelling the geometric consistency within adjacent frames, most deep VO methods…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Chengze Wang , Yuan Yuan , Qi Wang

Recent advances in deep learning for edge detection and segmentation opens up a new path for semantic-edge-based ego-motion estimation. In this work, we propose a robust monocular visual odometry (VO) framework using category-aware semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Xiaolong Wu , Assia Benbihi , Antoine Richard , Cedric Pradalier

Recent visual odometry (VO) methods incorporating geometric algorithm into deep-learning architecture have shown outstanding performance on the challenging monocular VO task. Despite encouraging results are shown, previous methods ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Yijun Cao , Xianshi Zhang , Fuya Luo , Peng Peng , Yongjie Li

We propose a self-supervised learning framework that uses unlabeled monocular video sequences to generate large-scale supervision for training a Visual Odometry (VO) frontend, a network which computes pointwise data associations across…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Daniel DeTone , Tomasz Malisiewicz , Andrew Rabinovich

In this work we present a monocular visual odometry (VO) algorithm which leverages geometry-based methods and deep learning. Most existing VO/SLAM systems with superior performance are based on geometry and have to be carefully designed for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Huangying Zhan , Chamara Saroj Weerasekera , Jiawang Bian , Ian Reid

With the success of deep learning based approaches in tackling challenging problems in computer vision, a wide range of deep architectures have recently been proposed for the task of visual odometry (VO) estimation. Most of these proposed…

Robotics · Computer Science 2018-04-16 Ganesh Iyer , J. Krishna Murthy , Gunshi Gupta , K. Madhava Krishna , Liam Paull

Optical Flow (OF) and depth are commonly used for visual odometry since they provide sufficient information about camera ego-motion in a rigid scene. We reformulate the problem of ego-motion estimation as a problem of motion estimation of a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Igor Slinko , Anna Vorontsova , Filipp Konokhov , Olga Barinova , Anton Konushin

Understanding how images of objects and scenes behave in response to specific ego-motions is a crucial aspect of proper visual development, yet existing visual learning methods are conspicuously disconnected from the physical source of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Dinesh Jayaraman , Kristen Grauman

Real-time ego-motion tracking for endoscope is a significant task for efficient navigation and robotic automation of endoscopy. In this paper, a novel framework is proposed to perform real-time ego-motion tracking for endoscope. Firstly, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Liangjing Shao , Benshuang Chen , Shuting Zhao , Xinrong Chen

Understanding ego-motion and surrounding vehicle state is essential to enable automated driving and advanced driving assistance technologies. Typical approaches to solve this problem use fusion of multiple sensors such as LiDAR, camera, and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Jun Hayakawa , Behzad Dariush

Visual odometry (VO) is essential for enabling accurate point-goal navigation of embodied agents in indoor environments where GPS and compass sensors are unreliable and inaccurate. However, traditional VO methods face challenges in…

Robotics · Computer Science 2024-11-08 Sayan Paul , Ruddra dev Roychoudhury , Brojeshwar Bhowmick

Accurate and robust localization is a fundamental need for mobile agents. Visual-inertial odometry (VIO) algorithms exploit the information from camera and inertial sensors to estimate position and translation. Recent deep learning based…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Zheming Tu , Changhao Chen , Xianfei Pan , Ruochen Liu , Jiarui Cui , Jun Mao

Data-driven visual odometry (VO) is a critical subroutine for autonomous edge robotics, and recent progress in the field has produced highly accurate point predictions in complex environments. However, emerging autonomous edge robotics…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Alex C. Stutts , Danilo Erricolo , Theja Tulabandhula , Amit Ranjan Trivedi

The development of aerial autonomy has enabled aerial robots to fly agilely in complex environments. However, dodging fast-moving objects in flight remains a challenge, limiting the further application of unmanned aerial vehicles (UAVs).…

Robotics · Computer Science 2021-03-12 Botao He , Haojia Li , Siyuan Wu , Dong Wang , Zhiwei Zhang , Qianli Dong , Chao Xu , Fei Gao

The problem of tracking self-motion as well as motion of objects in the scene using information from a camera is known as multi-body visual odometry and is a challenging task. This paper proposes a robust solution to achieve accurate…

Robotics · Computer Science 2020-07-29 Jun Zhang , Mina Henein , Robert Mahony , Viorela Ila

Event cameras open up new possibilities for robotic perception due to their low latency and high dynamic range. On the other hand, developing effective event-based vision algorithms that fully exploit the beneficial properties of event…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Daqi Liu , Alvaro Parra , Yasir Latif , Bo Chen , Tat-Jun Chin , Ian Reid