English
Related papers

Related papers: Learning depth from monocular video sequences

200 papers

3D object detection from monocular images is an ill-posed problem due to the projective entanglement of depth and scale. To overcome this ambiguity, we present a novel self-supervised method for textured 3D shape reconstruction and pose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Deniz Beker , Hiroharu Kato , Mihai Adrian Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon

Monocular depth estimation aims at predicting depth from a single image or video. Recently, self-supervised methods draw much attention since they are free of depth annotations and achieve impressive performance on several daytime…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Kun Wang , Zhenyu Zhang , Zhiqiang Yan , Xiang Li , Baobei Xu , Jun Li , Jian Yang

In this paper we consider the problem of single monocular image depth estimation. It is a challenging problem due to its ill-posedness nature and has found wide application in industry. Previous efforts belongs roughly to two families:…

Computer Vision and Pattern Recognition · Computer Science 2018-01-16 Yiran Wu , Sihao Ying , Lianmin Zheng

Supervised learning methods to infer (hypothesize) depth of a scene from a single image require costly per-pixel ground-truth. We follow a geometric approach that exploits abundant stereo imagery to learn a model to hypothesize scene…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Alex Wong , Byung-Woo Hong , Stefano Soatto

This paper addresses the importance of full-image supervision for monocular depth estimation. We propose a semi-supervised architecture, which combines both unsupervised framework of using image consistency and supervised framework of dense…

Computer Vision and Pattern Recognition · Computer Science 2020-01-31 Bei Wang , Jianping An

Autonomous cars need continuously updated depth information. Thus far, depth is mostly estimated independently for a single frame at a time, even if the method starts from video input. Our method produces a time series of depth maps, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Vaishakh Patil , Wouter Van Gansbeke , Dengxin Dai , Luc Van Gool

We present a novel method for predicting accurate depths from monocular images with high efficiency. This optimal efficiency is achieved by exploiting wavelet decomposition, which is integrated in a fully differentiable encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Michaël Ramamonjisoa , Michael Firman , Jamie Watson , Vincent Lepetit , Daniyar Turmukhambetov

Spatial scene understanding, including monocular depth estimation, is an important problem in various applications, such as robotics and autonomous driving. While improvements in unsupervised monocular depth estimation have potentially…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

Monocular image-based 3D reconstruction of faces is a long-standing problem in computer vision. Since image data is a 2D projection of a 3D face, the resulting depth ambiguity makes the problem ill-posed. Most existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ayush Tewari , Florian Bernard , Pablo Garrido , Gaurav Bharaj , Mohamed Elgharib , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Monocular Depth Estimation is usually treated as a supervised and regression problem when it actually is very similar to semantic segmentation task since they both are fundamentally pixel-level classification tasks. We applied depth…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Azeez Oluwafemi , Yang Zou , B. V. K. Vijaya Kumar

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

We propose MAMo, a novel memory and attention frame-work for monocular video depth estimation. MAMo can augment and improve any single-image depth estimation networks into video depth estimation models, enabling them to take advantage of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Rajeev Yasarla , Hong Cai , Jisoo Jeong , Yunxiao Shi , Risheek Garrepalli , Fatih Porikli

Single-view depth prediction is a fundamental problem in computer vision. Recently, deep learning methods have led to significant progress, but such methods are limited by the available training data. Current datasets based on 3D sensors…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Zhengqi Li , Noah Snavely

Monocular depth estimators can be trained with various forms of self-supervision from binocular-stereo data to circumvent the need for high-quality laser scans or other ground-truth data. The disadvantage, however, is that the photometric…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Jamie Watson , Michael Firman , Gabriel J. Brostow , Daniyar Turmukhambetov

Previous monocular depth estimation methods take a single view and directly regress the expected results. Though recent advances are made by applying geometrically inspired loss functions during training, the inference procedure does not…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Yue Luo , Jimmy Ren , Mude Lin , Jiahao Pang , Wenxiu Sun , Hongsheng Li , Liang Lin

Depth Estimation has wide reaching applications in the field of Computer vision such as target tracking, augmented reality, and self-driving cars. The goal of Monocular Depth Estimation is to predict the depth map, given a 2D monocular RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mayank Poddar , Akash Mishra , Mohit Kewlani , Haoyang Pei

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Learning to predict scene depth and camera motion from RGB inputs only is a challenging task. Most existing learning based methods deal with this task in a supervised manner which require ground-truth data that is expensive to acquire. More…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yunxiao Shi , Jing Zhu , Yi Fang , Kuochin Lien , Junli Gu

Self-supervised depth learning from monocular images normally relies on the 2D pixel-wise photometric relation between temporally adjacent image frames. However, they neither fully exploit the 3D point-wise geometric correspondences, nor…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Kaichen Zhou , Lanqing Hong , Changhao Chen , Hang Xu , Chaoqiang Ye , Qingyong Hu , Zhenguo Li

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn