English
Related papers

Related papers: Self-supervised Monocular Depth and Pose Estimatio…

200 papers

Egocentric 3D human pose estimation with a single head-mounted fisheye camera has recently attracted attention due to its numerous applications in virtual and augmented reality. Existing methods still struggle in challenging poses where the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Jian Wang , Lingjie Liu , Weipeng Xu , Kripasindhu Sarkar , Diogo Luvizon , Christian Theobalt

Self-supervised monocular depth estimation has been widely studied recently. Most of the work has focused on improving performance on benchmark datasets, such as KITTI, but has offered a few experiments on generalization performance. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jinwoo Bae , Sungho Moon , Sunghoon Im

Autonomous vehicles and robots need to operate over a wide variety of scenarios in order to complete tasks efficiently and safely. Multi-camera self-supervised monocular depth estimation from videos is a promising way to reason about the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Takayuki Kanai , Igor Vasiljevic , Vitor Guizilini , Adrien Gaidon , Rares Ambrus

In the last decade, many medical companies and research groups have tried to convert passive capsule endoscopes as an emerging and minimally invasive diagnostic technology into actively steerable endoscopic capsule robots which will provide…

Monocular depth estimation (MDE) has witnessed remarkable progress driven by Convolutional Neural Networks and transformer-based architectures. However, these approaches typically treat the problem as a generic image-to-image regression on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Qianlei Wang , Kexun Chen , Shaolin Zhang , Hongli Gao , Chaoning Zhang , Xiaolin Qin

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach, that requires a lot of ground truths. Previous works have successfully improved the accuracy of depth…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Noriaki Hirose , Shun Taguchi , Keisuke Kawano , Satoshi Koide

Monocular visual odometry (VO) suffers severely from error accumulation during frame-to-frame pose estimation. In this paper, we present a self-supervised learning method for VO with special consideration for consistency over longer…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yuliang Zou , Pan Ji , Quoc-Huy Tran , Jia-Bin Huang , Manmohan Chandraker

6D object pose estimation is a fundamental problem in computer vision. Convolutional Neural Networks (CNNs) have recently proven to be capable of predicting reliable 6D pose estimates even from monocular images. Nonetheless, CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Gu Wang , Fabian Manhardt , Jianzhun Shao , Xiangyang Ji , Nassir Navab , Federico Tombari

Reliable incremental estimation of camera poses and 3D reconstruction is key to enable various applications including robotics, interactive visualization, and augmented reality. However, this task is particularly challenging in dynamic…

Robotics · Computer Science 2025-12-09 Xingguang Zhong , Liren Jin , Marija Popović , Jens Behley , Cyrill Stachniss

Depth estimation is a foundational component for 3D reconstruction in minimally invasive endoscopic surgeries. However, existing monocular depth estimation techniques often exhibit limited performance to the varying illumination and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinning Yao , Bo Liu , Bojian Li , Jingjing Wang , Jinghua Yue , Fugen Zhou

6D object pose estimation is a fundamental yet challenging problem in computer vision. Convolutional Neural Networks (CNNs) have recently proven to be capable of predicting reliable 6D pose estimates even under monocular settings.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Gu Wang , Fabian Manhardt , Xingyu Liu , Xiangyang Ji , Federico Tombari

We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimation process including…

Image and Video Processing · Electrical Eng. & Systems 2022-01-13 Masahiro Oda , Hayato Itoh , Kiyohito Tanaka , Hirotsugu Takabatake , Masaki Mori , Hiroshi Natori , Kensaku Mori

Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised manner, without…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Hao Qu , Lilian Zhang , Xiaoping Hu , Xiaofeng He , Xianfei Pan , Changhao Chen

Self-supervised monocular depth estimation has emerged as a promising approach since it does not rely on labeled training data. Most methods combine convolution and Transformer to model long-distance dependencies to estimate depth…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Xuezhi Xiang , Yao Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Monocular depth estimation from a single image is an ill-posed problem for computer vision due to insufficient reliable cues as the prior knowledge. Besides the inter-frame supervision, namely stereo and adjacent frames, extensive prior…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Zhengyang Lu , Ying Chen

Variational autoencoders (VAEs) are a powerful class of deep generative latent variable model for unsupervised representation learning on high-dimensional data. To ensure computational tractability, VAEs are often implemented with a…

Machine Learning · Computer Science 2020-06-09 Alex Campbell , Pietro Liò

Recent studies have shown remarkable advances in 3D human pose estimation from monocular images, with the help of large-scale in-door 3D datasets and sophisticated network architectures. However, the generalizability to different…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Xipeng Chen , Kwan-Yee Lin , Wentao Liu , Chen Qian , Xiaogang Wang , Liang Lin

An event camera is a novel vision sensor that can capture per-pixel brightness changes and output a stream of asynchronous ``events''. It has advantages over conventional cameras in those scenes with high-speed motions and challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Junyu Zhu , Lina Liu , Bofeng Jiang , Feng Wen , Hongbo Zhang , Wanlong Li , Yong Liu

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid