English
Related papers

Related papers: Towards Scale-Aware, Robust, and Generalizable Uns…

200 papers

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

This paper addresses the importance of full-image supervision for monocular depth estimation. We propose a semi-supervised architecture, which combines both unsupervised framework of using image consistency and supervised framework of dense…

Computer Vision and Pattern Recognition · Computer Science 2020-01-31 Bei Wang , Jianping An

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised manner, without…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Hao Qu , Lilian Zhang , Xiaoping Hu , Xiaofeng He , Xianfei Pan , Changhao Chen

We propose a semantics-driven unsupervised learning approach for monocular depth and ego-motion estimation from videos in this paper. Recent unsupervised learning methods employ photometric errors between synthetic view and actual image as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Xiaobin Wei , Jianjiang Feng , Jie Zhou

Monocular depth estimation has been actively studied in fields such as robot vision, autonomous driving, and 3D scene understanding. Given a sequence of color images, unsupervised learning methods based on the framework of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Songlin Wei , Guodong Chen , Wenzheng Chi , Zhenhua Wang , Lining Sun

In this paper, we introduce a novel training method for making any monocular depth network learn absolute scale and estimate metric road-scene depth just from regular training data, i.e., driving videos. We refer to this training framework…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Genki Kinoshita , Ko Nishino

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estimation require…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Mertalp Ocal , Armin Mustafa

The great potential of unsupervised monocular depth estimation has been demonstrated by many works due to low annotation cost and impressive accuracy comparable to supervised methods. To further improve the performance, recent works mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Junyu Zhu , Lina Liu , Yong Liu , Wanlong Li , Feng Wen , Hongbo Zhang

Self-supervised monocular depth estimation presents a powerful method to obtain 3D scene information from single camera images, which is trainable on arbitrary image sequences without requiring depth labels, e.g., from a LiDAR sensor. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Marvin Klingner , Jan-Aike Termöhlen , Jonas Mikolajczyk , Tim Fingscheidt

A monocular 3D object tracking system generally has only up-to-scale pose estimation results without any prior knowledge of the tracked object. In this paper, we propose a novel idea to recover the metric scale of an arbitrary dynamic…

Robotics · Computer Science 2018-08-22 Kejie Qiu , Tong Qin , Hongwen Xie , Shaojie Shen

Accurate monocular metric depth estimation (MMDE) is crucial to solving downstream tasks in 3D perception and modeling. However, the remarkable accuracy of recent MMDE methods is confined to their training domains. These methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Luigi Piccinelli , Christos Sakaridis , Yung-Hsu Yang , Mattia Segu , Siyuan Li , Wim Abbeloos , Luc Van Gool

Monocular Depth Estimation (MDE) enables spatial understanding, 3D reconstruction, and autonomous navigation, yet deep learning approaches often predict only relative depth without a consistent metric scale. This limitation reduces…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Jiuling Zhang

Accurate endoscope pose estimation and 3D tissue surface reconstruction significantly enhances monocular minimally invasive surgical procedures by enabling accurate navigation and improved spatial awareness. However, monocular endoscope…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Muzammil Khan , Enzo Kerkhof , Matteo Fusaglia , Koert Kuhlmann , Theo Ruers , Françoise J. Siepel

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

We present an approach which takes advantage of both structure and semantics for unsupervised monocular learning of depth and ego-motion. More specifically, we model the motion of individual objects and learn their 3D motion vector jointly…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Existing methods for scale-invariant monocular depth estimation (SI MDE) often struggle due to the complexity of the task, and limited and non-diverse datasets, hindering generalizability in real-world scenarios. This is while…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 S. Mahdi H. Miangoleh , Mahesh Reddy , Yağız Aksoy

Monocular depth estimation (MDE) plays a pivotal role in various computer vision applications, such as robotics, augmented reality, and autonomous driving. Despite recent advancements, existing methods often fail to meet key requirements…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Andrii Litvynchuk , Ivan Livinsky , Anand Ravi , Nima Kalantari , Andrii Tsarov

Full surround monodepth (FSM) methods can learn from multiple camera views simultaneously in a self-supervised manner to predict the scale-aware depth, which is more practical for real-world applications in contrast to scale-ambiguous depth…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yuchen Yang , Xinyi Wang , Dong Li , Lu Tian , Ashish Sirasao , Xun Yang