English
Related papers

Related papers: $S^3$Net: Semantic-Aware Self-supervised Depth Est…

200 papers

We propose SUB-Depth, a universal multi-task training framework for self-supervised monocular depth estimation (SDE). Depth models trained with SUB-Depth outperform the same models trained in a standard single-task SDE framework. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Hang Zhou , Sarah Taylor , David Greenwood , Michal Mackiewicz

An event camera is a novel vision sensor that can capture per-pixel brightness changes and output a stream of asynchronous ``events''. It has advantages over conventional cameras in those scenes with high-speed motions and challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Junyu Zhu , Lina Liu , Bofeng Jiang , Feng Wen , Hongbo Zhang , Wanlong Li , Yong Liu

Monocular depth estimation plays a crucial role in 3D recognition and understanding. One key limitation of existing approaches lies in their lack of structural information exploitation, which leads to inaccurate spatial layout,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Tian Chen , Shijie An , Yuan Zhang , Chongyang Ma , Huayan Wang , Xiaoyan Guo , Wen Zheng

Deep learning has attained remarkable success in many 3D visual recognition tasks, including shape classification, object detection, and semantic segmentation. However, many of these results rely on manually collecting densely annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Fernando Julio Cendra , Lan Ma , Jiajun Shen , Xiaojuan Qi

Self-supervised depth estimation from monocular cameras in diverse outdoor conditions, such as daytime, rain, and nighttime, is challenging due to the difficulty of learning universal representations and the severe lack of labeled…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Weilong Yan , Ming Li , Haipeng Li , Shuwei Shao , Robby T. Tan

Predicting depth from a single image is an attractive research topic since it provides one more dimension of information to enable machines to better perceive the world. Recently, deep learning has emerged as an effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Jun Liu , Qing Li , Rui Cao , Wenming Tang , Guoping Qiu

Due to difficulties in acquiring ground truth depth of equirectangular (360) images, the quality and quantity of equirectangular depth data today is insufficient to represent the various scenes in the world. Therefore, 360 depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Ilwi Yun , Hyuk-Jae Lee , Chae Eun Rhee

Self-supervised monocular depth estimation is an attractive solution that does not require hard-to-source depth labels for training. Convolutional neural networks (CNNs) have recently achieved great success in this task. However, their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Chaoqiang Zhao , Youmin Zhang , Matteo Poggi , Fabio Tosi , Xianda Guo , Zheng Zhu , Guan Huang , Yang Tang , Stefano Mattoccia

In the recent years, many methods demonstrated the ability of neural networks to learn depth and pose changes in a sequence of images, using only self-supervision as the training signal. Whilst the networks achieve good performance, the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Robert McCraith , Lukas Neumann , Andrea Vedaldi

Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Clément Godard , Oisin Mac Aodha , Gabriel J. Brostow

Monocular depth estimation aims to recover the depth information of 3D scenes from 2D images. Recent work has made significant progress, but its reliance on large-scale datasets and complex decoders has limited its efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Zeyu Ren , Zeyu Zhang , Wukai Li , Qingxiang Liu , Hao Tang

Monocular depth estimation plays a critical role in various computer vision and robotics applications such as localization, mapping, and 3D object detection. Recently, learning-based algorithms achieve huge success in depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Dongseok Shim , H. Jin Kim

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Robert McCraith , Lukas Neumann , Andrew Zisserman , Andrea Vedaldi

The field of self-supervised monocular depth estimation has seen huge advancements in recent years. Most methods assume stereo data is available during training but usually under-utilize it and only treat it as a reference signal. We…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Matan Goldman , Tal Hassner , Shai Avidan

Obtaining accurate depth measurements out of a single image represents a fascinating solution to 3D sensing. CNNs led to considerable improvements in this field, and recent trends replaced the need for ground-truth labels with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Matteo Poggi , Fabio Tosi , Stefano Mattoccia

Monocular depth estimation from a single image is an ill-posed problem for computer vision due to insufficient reliable cues as the prior knowledge. Besides the inter-frame supervision, namely stereo and adjacent frames, extensive prior…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Zhengyang Lu , Ying Chen

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn

Classical monocular Simultaneous Localization And Mapping (SLAM) and the recently emerging convolutional neural networks (CNNs) for monocular depth prediction represent two largely disjoint approaches towards building a 3D map of the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Lokender Tiwari , Pan Ji , Quoc-Huy Tran , Bingbing Zhuang , Saket Anand , Manmohan Chandraker

Semantic segmentation and stereo matching are two essential components of 3D environmental perception systems for autonomous driving. Nevertheless, conventional approaches often address these two problems independently, employing separate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zhiyuan Wu , Yi Feng , Chuang-Wei Liu , Fisher Yu , Qijun Chen , Rui Fan