English
Related papers

Related papers: Beyond Photometric Loss for Self-Supervised Ego-Mo…

200 papers

Traditional monocular direct visual odometry (DVO) is one of the most famous methods to estimate the ego-motion of robots and map environments from images simultaneously. However, DVO heavily relies on high-quality images and accurate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Chaoqiang Zhao , Yang Tang , Qiyu Sun , Athanasios V. Vasilakos

Learning-based visual odometry and SLAM methods demonstrate a steady improvement over past years. However, collecting ground truth poses to train these methods is difficult and expensive. This could be resolved by training in an…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Igor Slinko , Anna Vorontsova , Dmitry Zhukov , Olga Barinova , Anton Konushin

In this paper we propose USegScene, a framework for semantically guided unsupervised learning of depth, optical flow and ego-motion estimation for stereo camera images using convolutional neural networks. Our framework leverages semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Johan Vertens , Wolfram Burgard

Recently, self-supervised learning of depth and ego-motion from thermal images shows strong robustness and reliability under challenging scenarios. However, the inherent thermal image properties such as weak contrast, blurry edges, and…

Robotics · Computer Science 2022-06-16 Ukcheol Shin , Kyunghyun Lee , Byeong-Uk Lee , In So Kweon

Ego-motion estimation is vital for drones when flying in GPS-denied environments. Vision-based methods struggle when flight speed increases and close-by objects lead to difficult visual conditions with considerable motion blur and large…

Robotics · Computer Science 2025-05-01 Stavrow A. Bahnam , Christophe De Wagter , Guido C. H. E. de Croon

Monocular Visual Odometry (MVO) provides a cost-effective, real-time positioning solution for autonomous vehicles. However, MVO systems face the common issue of lacking inherent scale information from monocular cameras. Traditional methods…

Robotics · Computer Science 2025-02-28 Yufei Wei , Sha Lu , Wangtao Lu , Rong Xiong , Yue Wang

This paper presents an unsupervised deep learning framework called UnDEMoN for estimating dense depth map and 6-DoF camera pose information directly from monocular images. The proposed network is trained using unlabeled monocular stereo…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Madhu Babu , Anima Majumder , Kaushik Das , Swagat Kumar

Monocular visual localization plays a pivotal role in advanced driver assistance systems and autonomous driving by estimating a vehicle's ego-motion from a single pinhole camera. Nevertheless, conventional monocular visual odometry…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Hui Zhang , Zhiyang Wu , Qianqian Shangguan , Kang An

In this paper, we propose a novel approach to enhance the 3D body pose estimation of a person computed from videos captured from a single wearable camera. The key idea is to leverage high-level features linking first- and third-views in a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Ameya Dhamanaskar , Mariella Dimiccoli , Enric Corona , Albert Pumarola , Francesc Moreno-Noguer

Self-supervised learning has emerged as a powerful tool for depth and ego-motion estimation, leading to state-of-the-art results on benchmark datasets. However, one significant limitation shared by current methods is the assumption of a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Sudeep Pillai , Wolfram Burgard , Greg Shakhnarovich , Adrien Gaidon

In this paper, we introduce Geometry-Inverse-Meet-Pixel-Insert, short for GEO, an exceptionally versatile image editing technique designed to cater to customized user requirements at both local and global scales. Our approach seamlessly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yan Zheng , Lemeng Wu

Visual relocalization aims to estimate the pose of a camera from one or more images. In recent years deep learning based pose regression methods have attracted many attentions. They feature predicting the absolute poses without relying on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Chengyu Qiao , Zhiyu Xiang , Xinglu Wang

We present a novel two-view geometry estimation framework which is based on a differentiable robust loss function fitting. We propose to treat the robust fundamental matrix estimation as an implicit layer, which allows us to avoid…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Vladislav Pyatov , Iaroslav Koshelev , Stamatis Lefkimmiatis

In this paper we propose a framework for integrating map-based relocalization into online direct visual odometry. To achieve map-based relocalization for direct methods, we integrate image features into Direct Sparse Odometry (DSO) and rely…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Mariia Gladkova , Rui Wang , Niclas Zeller , Daniel Cremers

Training networks to perform metric relocalization traditionally requires accurate image correspondences. In practice, these are obtained by restricting domain coverage, employing additional sensors, or capturing large multi-view datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Mike Kasper , Fernando Nobre , Christoffer Heckman , Nima Keivan

We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Anastasia Tkach , Shreyas Hampali , Linguang Zhang , Elliot J. Crowley , Cem Keskin

We present a novel self-supervised algorithm named MotionHint for monocular visual odometry (VO) that takes motion constraints into account. A key aspect of our approach is to use an appropriate motion model that can help existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Cong Wang , Yu-Ping Wang , Dinesh Manocha

Knowledge about the location of a vehicle is indispensable for autonomous driving. In order to apply global localisation methods, a pose prior must be known which can be obtained from visual odometry. The quality and robustness of that…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Johannes Graeter , Tobias Strauss , Martin Lauer

Egocentric human pose estimation (HPE) using a head-mounted device is crucial for various VR and AR applications, but it faces significant challenges due to keypoint invisibility. Nevertheless, none of the existing egocentric HPE datasets…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Peng Dai , Yu Zhang , Yiqiang Feng , Zhen Fan , Yang Zhang

Dense visual odometry (VO), which provides pose estimation and dense 3D reconstruction, serves as the cornerstone for applications ranging from robotics to augmented reality. Recently, feed-forward models have demonstrated remarkable…

Robotics · Computer Science 2026-04-03 Junxiang Pan , Lipu Zhou , Baojie Chen