English
Related papers

Related papers: SUB-Depth: Self-distillation and Uncertainty Boost…

200 papers

Recently, self-supervised monocular depth estimation has gained popularity with numerous applications in autonomous driving and robotics. However, existing solutions primarily seek to estimate depth from immediate visual features, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Youhong Wang , Yunji Liang , Hao Xu , Shaohui Jiao , Hongkai Yu

We present a method for jointly training the estimation of depth, ego-motion, and a dense 3D translation field of objects relative to the scene, with monocular photometric consistency being the sole source of supervision. We show that this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Hanhan Li , Ariel Gordon , Hang Zhao , Vincent Casser , Anelia Angelova

Self-supervised monocular depth estimation has gathered notable interest since it can liberate training from dependency on depth annotations. In monocular video training case, recent methods only conduct view synthesis between existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinfeng Liu , Lingtong Kong , Bo Li , Zerong Wang , Hong Gu , Jinwei Chen

Monocular depth estimation is very challenging because clues to the exact depth are incomplete in a single RGB image. To overcome the limitation, deep neural networks rely on various visual hints such as size, shade, and texture extracted…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Kyuhong Shim , Jiyoung Kim , Gusang Lee , Byonghyo Shim

We present a novel approach designed to address the complexities posed by challenging, out-of-distribution data in the single-image depth estimation task. Starting with images that facilitate depth prediction due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Fabio Tosi , Pierluigi Zama Ramirez , Matteo Poggi

Monocular depth estimation plays a critical role in various computer vision and robotics applications such as localization, mapping, and 3D object detection. Recently, learning-based algorithms achieve huge success in depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Dongseok Shim , H. Jin Kim

We introduce submodel co-training, a regularization method related to co-training, self-distillation and stochastic depth. Given a neural network to be trained, for each sample we implicitly instantiate two altered networks, ``submodels'',…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Hugo Touvron , Matthieu Cord , Maxime Oquab , Piotr Bojanowski , Jakob Verbeek , Hervé Jégou

Depth Estimation has wide reaching applications in the field of Computer vision such as target tracking, augmented reality, and self-driving cars. The goal of Monocular Depth Estimation is to predict the depth map, given a 2D monocular RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mayank Poddar , Akash Mishra , Mohit Kewlani , Haoyang Pei

For the task of simultaneous monocular depth and visual odometry estimation, we propose learning self-supervised transformer-based models in two steps. Our first step consists in a generic pretraining to learn 3D geometry, using cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Boris Chidlovskii , Leonid Antsfeld

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

By training over large-scale datasets, zero-shot monocular depth estimation (MDE) methods show robust performance in the wild but often suffer from insufficient detail. Although recent diffusion-based MDE approaches exhibit a superior…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xiang Zhang , Bingxin Ke , Hayko Riemenschneider , Nando Metzger , Anton Obukhov , Markus Gross , Konrad Schindler , Christopher Schroers

In monocular depth estimation, unsupervised domain adaptation has recently been explored to relax the dependence on large annotated image-based depth datasets. However, this comes at the cost of training multiple models or requiring complex…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Amir El-Ghoussani , Julia Hornauer , Gustavo Carneiro , Vasileios Belagiannis

Self-supervised depth estimation, which solely requires monocular image sequence as input, has become increasingly popular and promising in recent years. Current research primarily focuses on enhancing the prediction accuracy of the models.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xi Zhang , Yaru Xue , Shaocheng Jia , Xin Pei

Unsupervised learning based depth estimation methods have received more and more attention as they do not need vast quantities of densely labeled data for training which are touch to acquire. In this paper, we propose a novel unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Lingtao Zhou , Jiaojiao Fang , Guizhong Liu

Deep metric learning aims to learn features relying on the consistency or divergence of class labels. However, in monocular depth estimation, the absence of a natural definition of class poses challenges in the leveraging of deep metric…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chunpu Liu , Guanglei Yang , Wangmeng Zuo , Tianyi Zan

Recently, self-supervised learning technology has been applied to calculate depth and ego-motion from monocular videos, achieving remarkable performance in autonomous driving scenarios. One widely adopted assumption of depth and ego-motion…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Shuwei Shao , Zhongcai Pei , Weihai Chen , Wentao Zhu , Xingming Wu , Dianmin Sun , Baochang Zhang

This research paper presents an innovative multi-task learning framework that allows concurrent depth estimation and semantic segmentation using a single camera. The proposed approach is based on a shared encoder-decoder architecture, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pardis Taghavi , Reza Langari , Gaurav Pandey

In this paper, we deal with the problem of monocular depth estimation for fisheye cameras in a self-supervised manner. A known issue of self-supervised depth estimation is that it suffers in low-light/over-exposure conditions and in large…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Qingan Yan , Pan Ji , Nitin Bansal , Yuxin Ma , Yuan Tian , Yi Xu

Self-supervised monocular depth estimation (SS-MDE) has the potential to scale to vast quantities of data. Unfortunately, existing approaches limit themselves to the automotive domain, resulting in models incapable of generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jaime Spencer , Chris Russell , Simon Hadfield , Richard Bowden

Monocular depth inference is a fundamental problem for scene perception of robots. Specific robots may be equipped with a camera plus an optional depth sensor of any type and located in various scenes of different scales, whereas recent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Haotian Wang , Meng Yang , Nanning Zheng