English
Related papers

Related papers: Deconstructing Self-Supervised Monocular Reconstru…

200 papers

This paper summarizes the results of the first Monocular Depth Estimation Challenge (MDEC) organized at WACV2023. This challenge evaluated the progress of self-supervised monocular depth estimation on the challenging SYNS-Patches dataset.…

We present a novel algorithm for self-supervised monocular depth completion. Our approach is based on training a neural network that requires only sparse depth measurements and corresponding monocular video sequences without dense depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data. In this paper, we address the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tianwei Shen , Lei Zhou , Zixin Luo , Yao Yao , Shiwei Li , Jiahui Zhang , Tian Fang , Long Quan

Self-supervised monocular depth estimation has become an appealing solution to the lack of ground truth labels, but its reconstruction loss often produces over-smoothed results across object boundaries and is incapable of handling occlusion…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Hyesong Choi , Hunsang Lee , Sunkyung Kim , Sunok Kim , Seungryong Kim , Kwanghoon Sohn , Dongbo Min

Over the past few years, self-supervised monocular depth estimation that does not depend on ground-truth during the training phase has received widespread attention. Most efforts focus on designing different types of network architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Shuwei Shao , Zhongcai Pei , Weihai Chen , Dingchi Sun , Peter C. Y. Chen , Zhengguo Li

Monocular depth estimation is a highly challenging problem that is often addressed with deep neural networks. While these are able to use recognition of image features to predict reasonably looking depth maps the result often has low metric…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Patrik Persson , Linn Öström , Carl Olsson

Supervised deep learning often suffers from the lack of sufficient training data. Specifically in the context of monocular depth map prediction, it is barely possible to determine dense ground truth depth images in realistic dynamic outdoor…

Computer Vision and Pattern Recognition · Computer Science 2017-05-15 Yevhen Kuznietsov , Jörg Stückler , Bastian Leibe

Unsupervised monocular depth learning generally relies on the photometric relation among temporally adjacent images. Most of previous works use both mean absolute error (MAE) and structure similarity index measure (SSIM) with conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yijun Cao , Fuya Luo , Yongjie Li

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Self-supervised monocular depth estimation (SSMDE) has gained attention in the field of deep learning as it estimates depth without requiring ground truth depth maps. This approach typically uses a photometric consistency loss between a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Wonhyeok Choi , Kyumin Hwang , Minwoo Choi , Kiljoon Han , Wonjoon Choi , Mingyu Shin , Sunghoon Im

We revisit the problem of visual depth estimation in the context of autonomous vehicles. Despite the progress on monocular depth estimation in recent years, we show that the gap between monocular and stereo depth accuracy remains large$-$a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Nikolai Smolyanskiy , Alexey Kamenev , Stan Birchfield

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

In the domain of multi-baseline stereo, the conventional understanding is that, in general, increasing baseline separation substantially enhances the accuracy of depth estimation. However, prevailing self-supervised depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Kieran Saunders , Luis J. Manso , George Vogiatzis

Existing monocular depth estimation methods have achieved excellent robustness in diverse scenes, but they can only retrieve affine-invariant depth, up to an unknown scale and shift. However, in some video-based scenarios such as video…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Wu , Feng Zhao

Accurate endoscope pose estimation and 3D tissue surface reconstruction significantly enhances monocular minimally invasive surgical procedures by enabling accurate navigation and improved spatial awareness. However, monocular endoscope…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Muzammil Khan , Enzo Kerkhof , Matteo Fusaglia , Koert Kuhlmann , Theo Ruers , Françoise J. Siepel

Monocular depth estimation (MDE) plays a pivotal role in various computer vision applications, such as robotics, augmented reality, and autonomous driving. Despite recent advancements, existing methods often fail to meet key requirements…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Andrii Litvynchuk , Ivan Livinsky , Anand Ravi , Nima Kalantari , Andrii Tsarov

Self-supervised monocular depth and ego-motion estimation is a promising approach to replace or supplement expensive depth sensors such as LiDAR for robotics applications like autonomous driving. However, most research in this area focuses…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Vitor Guizilini , Igor Vasiljevic , Rares Ambrus , Greg Shakhnarovich , Adrien Gaidon

Monocular metric depth estimation (MMDE) is a crucial task to solve for indoor scene reconstruction on edge devices. Despite this importance, existing models are sensitive to factors such as boundary frequency of objects in the scene and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sanghyun Byun , Jacob Song , Woo Seong Chung

Self-supervised monocular depth estimation methods have been increasingly given much attention due to the benefit of not requiring large, labelled datasets. Such self-supervised methods require high-quality salient features and consequently…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Xiaotong Guo , Huijie Zhao , Shuwei Shao , Xudong Li , Baochang Zhang

We propose SUB-Depth, a universal multi-task training framework for self-supervised monocular depth estimation (SDE). Depth models trained with SUB-Depth outperform the same models trained in a standard single-task SDE framework. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Hang Zhou , Sarah Taylor , David Greenwood , Michal Mackiewicz