English
Related papers

Related papers: Self-supervised Sparse-to-Dense: Self-supervised D…

200 papers

We present a method for inferring dense depth maps from images and sparse depth measurements by leveraging synthetic data to learn the association of sparse point clouds with dense natural shapes, and using the image as evidence to validate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Alex Wong , Safa Cicek , Stefano Soatto

Single-view depth estimation can be remarkably effective if there is enough ground-truth depth data for supervised training. However, there are scenarios, especially in medicine in the case of endoscopies, where such data cannot be…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Javier Rodríguez-Puigvert , Víctor M. Batlle , J. M. M. Montiel , Ruben Martinez-Cantin , Pascal Fua , Juan D. Tardós , Javier Civera

In this paper we consider the problem of estimating a dense depth map from a set of sparse LiDAR points. We use techniques from compressed sensing and the recently developed Alternating Direction Neural Networks (ADNNs) to create a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Nathaniel Chodosh , Chaoyang Wang , Simon Lucey

Holistic scene understanding is pivotal for the performance of autonomous machines. In this paper we propose a new end-to-end model for performing semantic segmentation and depth completion jointly. The vast majority of recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Juan Pablo Lagos , Esa Rahtu

We propose a non-learning depth completion method for a sparse depth map captured using a light detection and ranging (LiDAR) sensor guided by a pair of stereo images. Generally, conventional stereo-aided depth completion methods have two…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yasuhiro Yao , Ryoichi Ishikawa , Shingo Ando , Kana Kurata , Naoki Ito , Jun Shimamura , Takeshi Oishi

Dense depth perception is critical for autonomous driving and other robotics applications. However, modern LiDAR sensors only provide sparse depth measurement. It is thus necessary to complete the sparse LiDAR data, where a synchronized…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Jie Tang , Fei-Peng Tian , Wei Feng , Jian Li , Ping Tan

Estimating depth from a single RGB images is a fundamental task in computer vision, which is most directly solved using supervised deep learning. In the field of unsupervised learning of depth from a single RGB image, depth is not given…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Shir Gur , Lior Wolf

Recent supervised multi-view depth estimation networks have achieved promising results. Similar to all supervised approaches, these networks require ground-truth data during training. However, collecting a large amount of multi-view depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Jiayu Yang , Jose M. Alvarez , Miaomiao Liu

The goal of our work is to complete the depth channel of an RGB-D image. Commodity-grade depth cameras often fail to sense depth for shiny, bright, transparent, and distant surfaces. To address this problem, we train a deep network that…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Yinda Zhang , Thomas Funkhouser

Self-supervised monocular depth estimation has emerged as a promising method because it does not require groundtruth depth maps during training. As an alternative for the groundtruth depth map, the photometric loss enables to provide…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jaehoon Choi , Dongki Jung , Donghwan Lee , Changick Kim

In recent years, self-supervised methods for monocular depth estimation has rapidly become an significant branch of depth estimation task, especially for autonomous driving applications. Despite the high overall precision achieved, current…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Feng Xue , Guirong Zhuo , Ziyuan Huang , Wufei Fu , Zhuoyue Wu , Marcelo H. Ang

Nighttime self-supervised monocular depth estimation has received increasing attention in recent years. However, using night images for self-supervision is unreliable because the photometric consistency assumption is usually violated in the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haolin Yang , Chaoqiang Zhao , Lu Sheng , Yang Tang

We revisit the problem of visual depth estimation in the context of autonomous vehicles. Despite the progress on monocular depth estimation in recent years, we show that the gap between monocular and stereo depth accuracy remains large$-$a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Nikolai Smolyanskiy , Alexey Kamenev , Stan Birchfield

Image-based depth estimation has gained significant attention in recent research on computer vision for autonomous vehicles in intelligent transportation systems. This focus stems from its cost-effectiveness and wide range of potential…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Elton F. de S. Soares , Carlos Alberto V. Campos

Monocular depth estimation plays a fundamental role in computer vision. Due to the costly acquisition of depth ground truth, self-supervised methods that leverage adjacent frames to establish a supervisory signal have emerged as the most…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhong Liu , Ran Li , Shuwei Shao , Xingming Wu , Weihai Chen

We consider the case in which a robot has to navigate in an unknown environment but does not have enough on-board power or payload to carry a traditional depth sensor (e.g., a 3D lidar) and thus can only acquire a few (point-wise) depth…

Robotics · Computer Science 2017-10-17 Fangchang Ma , Luca Carlone , Ulas Ayaz , Sertac Karaman

Unsupervised depth completion and estimation methods are trained by minimizing reconstruction error. Block artifacts from resampling, intensity saturation, and occlusions are amongst the many undesirable by-products of common data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yangchao Wu , Tian Yu Liu , Hyoungseob Park , Stefano Soatto , Dong Lao , Alex Wong

For the task of simultaneous monocular depth and visual odometry estimation, we propose learning self-supervised transformer-based models in two steps. Our first step consists in a generic pretraining to learn 3D geometry, using cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Boris Chidlovskii , Leonid Antsfeld

Road segmentation is a critical task for autonomous driving systems, requiring accurate and robust methods to classify road surfaces from various environmental data. Our work introduces an innovative approach that integrates LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Tao Ni , Xin Zhan , Tao Luo , Wenbin Liu , Zhan Shi , JunBo Chen

In this paper, we present a system for incrementally reconstructing a dense 3D model of the geometry of an outdoor environment using a single monocular camera attached to a moving vehicle. Dense models provide a rich representation of the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Louis Gallagher , Varun Ravi Kumar , Senthil Yogamani , John B. McDonald