English
Related papers

Related papers: FSNet: Redesign Self-Supervised MonoDepth for Full…

200 papers

Autonomous vehicles and robots require a full scene understanding of the environment to interact with it. Such a perception typically incorporates pixel-wise knowledge of the depths and semantic labels for each image from a video sensor.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Matthias Ochs , Adrian Kretz , Rudolf Mester

We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dipan Mandal , Abhilash Jain

Depth completion is a crucial task in autonomous driving, aiming to convert a sparse depth map into a dense depth prediction. Due to its potentially rich semantic information, RGB image is commonly fused to enhance the completion effect.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Moyun Liu , Bing Chen , Youping Chen , Jingming Xie , Lei Yao , Yang Zhang , Joey Tianyi Zhou

In recent years, self-supervised methods for monocular depth estimation has rapidly become an significant branch of depth estimation task, especially for autonomous driving applications. Despite the high overall precision achieved, current…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Feng Xue , Guirong Zhuo , Ziyuan Huang , Wufei Fu , Zhuoyue Wu , Marcelo H. Ang

Self-supervised monocular depth estimation methods have been increasingly given much attention due to the benefit of not requiring large, labelled datasets. Such self-supervised methods require high-quality salient features and consequently…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Xiaotong Guo , Huijie Zhao , Shuwei Shao , Xudong Li , Baochang Zhang

Depth information is essential for on-board perception in autonomous driving and driver assistance. Monocular depth estimation (MDE) is very appealing since it allows for appearance and depth being on direct pixelwise correspondence without…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Akhil Gurram , Ahmet Faruk Tuna , Fengyi Shen , Onay Urfalioglu , Antonio M. López

Self-supervised depth learning from monocular images normally relies on the 2D pixel-wise photometric relation between temporally adjacent image frames. However, they neither fully exploit the 3D point-wise geometric correspondences, nor…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Kaichen Zhou , Lanqing Hong , Changhao Chen , Hang Xu , Chaoqiang Ye , Qingyong Hu , Zhenguo Li

We introduce MGNet, a multi-task framework for monocular geometric scene understanding. We define monocular geometric scene understanding as the combination of two known tasks: Panoptic segmentation and self-supervised monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Markus Schön , Michael Buchholz , Klaus Dietmayer

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

Fisheye cameras are commonly used in applications like autonomous driving and surveillance to provide a large field of view ($>180^{\circ}$). However, they come at the cost of strong non-linear distortions which require more complex…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Varun Ravi Kumar , Sandesh Athni Hiremath , Stefan Milz , Christian Witt , Clement Pinnard , Senthil Yogamani , Patrick Mader

Estimating the distance to objects is crucial for autonomous vehicles when using depth sensors is not possible. In this case, the distance has to be estimated from on-board mounted RGB cameras, which is a complex task especially in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Michaël Fonder , Damien Ernst , Marc Van Droogenbroeck

This paper presents a novel self-supervised two-frame multi-camera metric depth estimation network, termed M${^2}$Depth, which is designed to predict reliable scale-aware surrounding depth in autonomous driving. Unlike the previous works…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Yingshuang Zou , Yikang Ding , Xi Qiu , Haoqian Wang , Haotian Zhang

Self-supervised depth estimation has drawn much attention in recent years as it does not require labeled data but image sequences. Moreover, it can be conveniently used in various applications, such as autonomous driving, robotics,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Shaocheng Jia , Xin Pei , Wei Yao , S. C. Wong

The great potential of unsupervised monocular depth estimation has been demonstrated by many works due to low annotation cost and impressive accuracy comparable to supervised methods. To further improve the performance, recent works mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Junyu Zhu , Lina Liu , Yong Liu , Wanlong Li , Feng Wen , Hongbo Zhang

We design a multiscopic vision system that utilizes a low-cost monocular RGB camera to acquire accurate depth estimation. Unlike multi-view stereo with images captured at unconstrained camera poses, the proposed system controls the motion…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Weihao Yuan , Rui Fan , Michael Yu Wang , Qifeng Chen

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

Accurate monocular metric depth estimation (MMDE) is crucial to solving downstream tasks in 3D perception and modeling. However, the remarkable accuracy of recent MMDE methods is confined to their training domains. These methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Luigi Piccinelli , Yung-Hsu Yang , Christos Sakaridis , Mattia Segu , Siyuan Li , Luc Van Gool , Fisher Yu

Self-supervised depth estimation from monocular sequences relies on the joint learning of a depth and a pose network. Despite abundant research done to improve the depth network, efforts on the pose remain limited. In this context, even…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Changxuan Li , Nadine Berner , Nassir Navab , Federico Tombari , Stefano Gasperini

It is a classical compute vision problem to obtain real scene depth maps by using a monocular camera, which has been widely concerned in recent years. However, training this model usually requires a large number of artificially labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang

In classical computer vision, rectification is an integral part of multi-view depth estimation. It typically includes epipolar rectification and lens distortion correction. This process simplifies the depth estimation significantly, and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Varun Ravi Kumar , Senthil Yogamani , Markus Bach , Christian Witt , Stefan Milz , Patrick Mader