English
Related papers

Related papers: Self-supervised Learning for Single View Depth and…

200 papers

In this article, we tackle the problem of depth estimation from single monocular images. Compared with depth estimation using multiple images such as stereo depth perception, depth from monocular images is much more challenging. Prior work…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Fayao Liu , Chunhua Shen , Guosheng Lin , Ian Reid

Monocular depth estimation has drawn widespread attention from the vision community due to its broad applications. In this paper, we propose a novel physics (geometry)-driven deep learning framework for monocular depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Shuwei Shao , Zhongcai Pei , Weihai Chen , Xingming Wu , Zhengguo Li

We consider the problem of depth estimation from a single monocular image in this work. It is a challenging task as no reliable depth cues are available, e.g., stereo correspondences, motions, etc. Previous efforts have been focusing on…

Computer Vision and Pattern Recognition · Computer Science 2015-10-01 Fayao Liu , Chunhua Shen , Guosheng Lin

Single image surface normal estimation and depth estimation are closely related problems as the former can be calculated from the latter. However, the surface normals computed from the output of depth estimation methods are significantly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gwangbin Bae , Ignas Budvytis , Roberto Cipolla

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Rui Wang , Stephen M. Pizer , Jan-Michael Frahm

In this paper we address three different computer vision tasks using a single basic architecture: depth prediction, surface normal estimation, and semantic labeling. We use a multiscale convolutional network that is able to adapt easily to…

Computer Vision and Pattern Recognition · Computer Science 2015-12-18 David Eigen , Rob Fergus

There has been tremendous research progress in estimating the depth of a scene from a monocular camera image. Existing methods for single-image depth prediction are exclusively based on deep neural networks, and their training can be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Ali Jahani Amiri , Shing Yan Loo , Hong Zhang

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

Single-view depth estimation suffers from the problem that a network trained on images from one camera does not generalize to images taken with a different camera model. Thus, changing the camera model requires collecting an entirely new…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Jose M. Facil , Benjamin Ummenhofer , Huizhong Zhou , Luis Montesano , Thomas Brox , Javier Civera

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jie Xiang , Yun Wang , Lifeng An , Haiyang Liu , Jian Liu

While conventional depth estimation can infer the geometry of a scene from a single RGB image, it fails to estimate scene regions that are occluded by foreground objects. This limits the use of depth prediction in augmented and virtual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Helisa Dhamo , Keisuke Tateno , Iro Laina , Nassir Navab , Federico Tombari

Over the past few years, monocular depth estimation and completion have been paid more and more attention from the computer vision community because of their widespread applications. In this paper, we introduce novel physics…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Shuwei Shao , Zhongcai Pei , Weihai Chen , Peter C. Y. Chen , Zhengguo Li

Reconstructing a 3D surface from colonoscopy video is challenging due to illumination and reflectivity variation in the video frame that can cause defective shape predictions. Aiming to overcome this challenge, we utilize the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Shuxian Wang , Yubo Zhang , Sarah K. McGill , Julian G. Rosenman , Jan-Michael Frahm , Soumyadip Sengupta , Stephen M. Pizer

Supervised learning depth estimation methods can achieve good performance when trained on high-quality ground-truth, like LiDAR data. However, LiDAR can only generate sparse 3D maps which causes losing information. Obtaining high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Hao Xing , Yifan Cao , Maximilian Biber , Mingchuan Zhou , Darius Burschka

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Jianrong Wang , Ge Zhang , Zhenyu Wu , XueWei Li , Li Liu

Convolutional Neural Networks (CNNs) need large amounts of data with ground truth annotation, which is a challenging problem that has limited the development and fast deployment of CNNs for many computer vision tasks. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Long Chen , Wen Tang , Nigel John

Monocular depth estimation is known as an ill-posed task in which objects in a 2D image usually do not contain sufficient information to predict their depth. Thus, it acts differently from other tasks (e.g., classification and segmentation)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wencheng Han , Junbo Yin , Jianbing Shen

Classical monocular Simultaneous Localization And Mapping (SLAM) and the recently emerging convolutional neural networks (CNNs) for monocular depth prediction represent two largely disjoint approaches towards building a 3D map of the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Lokender Tiwari , Pan Ji , Quoc-Huy Tran , Bingbing Zhuang , Saket Anand , Manmohan Chandraker