English
Related papers

Related papers: How do neural networks see depth in single images?

200 papers

Monocular depth estimation has drawn widespread attention from the vision community due to its broad applications. In this paper, we propose a novel physics (geometry)-driven deep learning framework for monocular depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Shuwei Shao , Zhongcai Pei , Weihai Chen , Xingming Wu , Zhengguo Li

Monocular depth estimation is scale-ambiguous, and thus requires scale supervision to produce metric predictions. Even so, the resulting models will be geometry-specific, with learned scales that cannot be directly transferred across…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Vitor Guizilini , Igor Vasiljevic , Dian Chen , Rares Ambrus , Adrien Gaidon

Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach, that requires a lot of ground truths. Previous works have successfully improved the accuracy of depth…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Noriaki Hirose , Shun Taguchi , Keisuke Kawano , Satoshi Koide

Monocular depth estimation (MDE) aims to transform an RGB image of a scene into a pixelwise depth map from the same camera view. It is fundamentally ill-posed due to missing information: any single image can have been taken from many…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Dylan Auty , Krystian Mikolajczyk

In monocular depth estimation, disturbances in the image context, like moving objects or reflecting materials, can easily lead to erroneous predictions. For that reason, uncertainty estimates for each pixel are necessary, in particular for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Julia Hornauer , Vasileios Belagiannis

The ability to accurately estimate depth information is crucial for many autonomous applications to recognize the surrounded environment and predict the depth of important objects. One of the most recently used techniques is monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Ahmed Zaitoon , Hossam El Din Abd El Munim , Hazem Abbas

Monocular depth estimation can play an important role in addressing the issue of deriving scene geometry from 2D images. It has been used in a variety of industries, including robots, self-driving cars, scene comprehension, 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ruilin Ma , Shiyao Chen , Qin Zhang

We consider the problem of depth estimation from a single monocular image in this work. It is a challenging task as no reliable depth cues are available, e.g., stereo correspondences, motions, etc. Previous efforts have been focusing on…

Computer Vision and Pattern Recognition · Computer Science 2015-10-01 Fayao Liu , Chunhua Shen , Guosheng Lin

Self-supervised monocular depth estimation is an attractive solution that does not require hard-to-source depth labels for training. Convolutional neural networks (CNNs) have recently achieved great success in this task. However, their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Chaoqiang Zhao , Youmin Zhang , Matteo Poggi , Fabio Tosi , Xianda Guo , Zheng Zhu , Guan Huang , Yang Tang , Stefano Mattoccia

Depth estimation and 3D object detection are critical for scene understanding but remain challenging to perform with a single image due to the loss of 3D information during image capture. Recent models using deep neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Julie Chang , Gordon Wetzstein

Despite significant progress made in the past few years, challenges remain for depth estimation using a single monocular image. First, it is nontrivial to train a metric-depth prediction model that can generalize well to diverse scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Simon Chen , Yifan Liu , Chunhua Shen

Predicting depth is an essential component in understanding the 3D geometry of a scene. While for stereo images local correspondence suffices for estimation, finding depth relations from a single image is less straightforward, requiring…

Computer Vision and Pattern Recognition · Computer Science 2014-06-10 David Eigen , Christian Puhrsch , Rob Fergus

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

There have been attempts to detect 3D objects by fusion of stereo camera images and LiDAR sensor data or using LiDAR for pre-training and only monocular images for testing, but there have been less attempts to use only monocular image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Curie Kim , Ue-Hwan Kim , Jong-Hwan Kim

Monocular depth estimation, similar to other image-based tasks, is prone to erroneous predictions due to ambiguities in the image, for example, caused by dynamic objects or shadows. For this reason, pixel-wise uncertainty assessment is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Julia Hornauer , Amir El-Ghoussani , Vasileios Belagiannis

Estimating depth from a monocular image is an ill-posed problem: when the camera projects a 3D scene onto a 2D plane, depth information is inherently and permanently lost. Nevertheless, recent work has shown impressive results in estimating…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Jagpreet Chawla , Nikhil Thakurdesai , Anuj Godase , Md Reza , David Crandall , Soon-Heung Jung

Self-supervised monocular depth estimation (MDE) has gained popularity for obtaining depth predictions directly from videos. However, these methods often produce scale invariant results, unless additional training signals are provided.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Gasser Elazab , Torben Gräber , Michael Unterreiner , Olaf Hellwich

The ability to predict depth from a single image - using recent advances in CNNs - is of increasing interest to the vision community. Unsupervised strategies to learning are particularly appealing as they can utilize much larger and varied…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Chaoyang Wang , Jose Miguel Buenaposada , Rui Zhu , Simon Lucey

Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Chao Fan , Zhenyu Yin , Yue Li , Feiqing Zhang

Monocular depth estimation plays a crucial role in 3D recognition and understanding. One key limitation of existing approaches lies in their lack of structural information exploitation, which leads to inaccurate spatial layout,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Tian Chen , Shijie An , Yuan Zhang , Chongyang Ma , Huayan Wang , Xiaoyan Guo , Wen Zheng