English
Related papers

Related papers: Learning Depth With Very Sparse Supervision

200 papers

Modern robotic manipulation primarily relies on visual observations in a 2D color space for skill learning but suffers from poor generalization. In contrast, humans, living in a 3D world, depend more on physical properties-such as distance,…

We present a method for predicting dense depth in scenarios where both a monocular camera and people in the scene are freely moving. Existing methods for recovering depth for dynamic, non-rigid objects from monocular video impose strong…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Zhengqi Li , Tali Dekel , Forrester Cole , Richard Tucker , Noah Snavely , Ce Liu , William T. Freeman

In this paper, we propose a new unsupervised feature learning framework, namely Deep Sparse Coding (DeepSC), that extends sparse coding to a multi-layer architecture for visual object recognition tasks. The main innovation of the framework…

Machine Learning · Computer Science 2013-12-23 Yunlong He , Koray Kavukcuoglu , Yun Wang , Arthur Szlam , Yanjun Qi

Self-supervised depth learning from monocular images normally relies on the 2D pixel-wise photometric relation between temporally adjacent image frames. However, they neither fully exploit the 3D point-wise geometric correspondences, nor…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Kaichen Zhou , Lanqing Hong , Changhao Chen , Hang Xu , Chaoqiang Ye , Qingyong Hu , Zhenguo Li

Dense depth map capture is challenging in existing active sparse illumination based depth acquisition techniques, such as LiDAR. Various techniques have been proposed to estimate a dense depth map based on fusion of the sparse depth map…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Qiqin Dai , Fengqiang Li , Oliver Cossairt , Aggelos K Katsaggelos

In this paper we propose a method for estimating depth from a single image using a coarse to fine approach. We argue that modeling the fine depth details is easier after a coarse depth map has been computed. We express a global (coarse)…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Mohammad Haris Baig , Lorenzo Torresani

Depth perception is paramount to tackle real-world problems, ranging from autonomous driving to consumer applications. For the latter, depth estimation from a single image represents the most versatile solution, since a standard camera is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Filippo Aleotti , Giulio Zaccaroni , Luca Bartolomei , Matteo Poggi , Fabio Tosi , Stefano Mattoccia

Unsupervised methods have showed promising results on monocular depth estimation. However, the training data must be captured in scenes without moving objects. To push the envelope of accuracy, recent methods tend to increase their model…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Tak-Wai Hui

Obstacle Detection is a central problem for any robotic system, and critical for autonomous systems that travel at high speeds in unpredictable environment. This is often achieved through scene depth estimation, by various means. When fast…

Robotics · Computer Science 2016-07-22 Michele Mancini , Gabriele Costante , Paolo Valigi , Thomas A. Ciarfuglia

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

Deep neural networks have been very successful in image estimation applications such as compressive-sensing and image restoration, as a means to estimate images from partial, blurry, or otherwise degraded measurements. These networks are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Zhihao Xia , Ayan Chakrabarti

Real-time estimation of actual object depth is an essential module for various autonomous system tasks such as 3D reconstruction, scene understanding and condition assessment. During the last decade of machine learning, extensive deployment…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Christoph Angermann , Matthias Schwab , Markus Haltmeier , Christian Laubichler , Steinbjörn Jónsson

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires monocular endoscopic videos…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Xingtong Liu , Ayushi Sinha , Masaru Ishii , Gregory D. Hager , Austin Reiter , Russell H. Taylor , Mathias Unberath

For the best human-robot interaction experience, the robot's navigation policy should take into account personal preferences of the user. In this paper, we present a learning framework complemented by a perception pipeline to train a depth…

Robotics · Computer Science 2023-08-01 Jorge de Heuvel , Nathan Corral , Benedikt Kreis , Jacobus Conradi , Anne Driemel , Maren Bennewitz

Metric depth prediction from monocular videos suffers from bad generalization between datasets and requires supervised depth data for scale-correct training. Self-supervised training using multi-view reconstruction can benefit from large…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Xiaohu Liu , Sascha Hornauer , Fabien Moutarde , Jialiang Lu

A key challenge of learning a visual representation for the 3D high fidelity geometry of dressed humans lies in the limited availability of the ground truth data (e.g., 3D scanned models), which results in the performance degradation of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Yasamin Jafarian , Hyun Soo Park

Most current single image camera calibration methods rely on specific image features or user input, and cannot be applied to natural images captured in uncontrolled settings. We propose directly inferring camera calibration parameters from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yannick Hold-Geoffroy , Kalyan Sunkavalli , Jonathan Eisenmann , Matt Fisher , Emiliano Gambaretto , Sunil Hadap , Jean-François Lalonde

Estimating the distance to objects is crucial for autonomous vehicles when using depth sensors is not possible. In this case, the distance has to be estimated from on-board mounted RGB cameras, which is a complex task especially in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Michaël Fonder , Damien Ernst , Marc Van Droogenbroeck

Self-supervised surround-view depth estimation enables dense, low-cost 3D perception with a 360{\deg} field of view from multiple minimally overlapping images. Yet, most existing methods suffer from depth estimates that are inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Samer Abualhanud , Christian Grannemann , Max Mehltretter

With the development of computational intelligence algorithms, unsupervised monocular depth and pose estimation framework, which is driven by warped photometric consistency, has shown great performance in the daytime scenario. While in some…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Chaoqiang Zhao , Yang Tang , Qiyu Sun