English
Related papers

Related papers: MonoDiffusion: Self-Supervised Monocular Depth Est…

200 papers

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Denoising diffusion probabilistic models have transformed image generation with their impressive fidelity and diversity. We show that they also excel in estimating optical flow and monocular depth, surprisingly, without task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Saurabh Saxena , Charles Herrmann , Junhwa Hur , Abhishek Kar , Mohammad Norouzi , Deqing Sun , David J. Fleet

We present a novel approach designed to address the complexities posed by challenging, out-of-distribution data in the single-image depth estimation task. Starting with images that facilitate depth prediction due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Fabio Tosi , Pierluigi Zama Ramirez , Matteo Poggi

Self-supervised learning for depth estimation uses geometry in image sequences for supervision and shows promising results. Like many computer vision tasks, depth network performance is determined by the capability to learn accurate spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Hang Zhou , David Greenwood , Sarah Taylor

Depth estimation from a single image represents a fascinating, yet challenging problem with countless applications. Recent works proved that this task could be learned without direct supervision from ground truth labels leveraging image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Fabio Tosi , Filippo Aleotti , Matteo Poggi , Stefano Mattoccia

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires monocular endoscopic videos…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Xingtong Liu , Ayushi Sinha , Masaru Ishii , Gregory D. Hager , Austin Reiter , Russell H. Taylor , Mathias Unberath

Self-supervised paradigms for monocular depth estimation are very appealing since they do not require ground truth annotations at all. Despite the astonishing results yielded by such methodologies, learning to reason about the uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Matteo Poggi , Filippo Aleotti , Fabio Tosi , Stefano Mattoccia

Monocular depth estimation aims at estimating a pixelwise depth map for a single image, which has wide applications in scene understanding and autonomous driving. Existing supervised and unsupervised methods face great challenges.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Xiaoyang Guo , Hongsheng Li , Shuai Yi , Jimmy Ren , Xiaogang Wang

Recent techniques in self-supervised monocular depth estimation are approaching the performance of supervised methods, but operate in low resolution only. We show that high resolution is key towards high-fidelity self-supervised monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Sudeep Pillai , Rares Ambrus , Adrien Gaidon

In stereo-matching knowledge distillation methods of the self-supervised monocular depth estimation, the stereo-matching network's knowledge is distilled into a monocular depth network through pseudo-depth maps. In these methods, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Woonghyun Ka , Jae Young Lee , Jaehyun Choi , Junmo Kim

Nowadays, the majority of state of the art monocular depth estimation techniques are based on supervised deep learning models. However, collecting RGB images with associated depth maps is a very time consuming procedure. Therefore, recent…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Andrea Pilzer , Stéphane Lathuilière , Nicu Sebe , Elisa Ricci

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

Self-supervised monocular depth estimation is a salient task for 3D scene understanding. Learned jointly with monocular ego-motion estimation, several methods have been proposed to predict accurate pixel-wise depth without using labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Hemang Chawla , Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

Depth completion involves predicting dense depth maps from sparse LiDAR inputs. However, sparse depth annotations from sensors limit the availability of dense supervision, which is necessary for learning detailed geometric features. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yingping Liang , Yutao Hu , Wenqi Shao , Ying Fu

While methods for monocular depth estimation have made significant strides on standard benchmarks, zero-shot metric depth estimation remains unsolved. Challenges include the joint modeling of indoor and outdoor scenes, which often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Saurabh Saxena , Junhwa Hur , Charles Herrmann , Deqing Sun , David J. Fleet

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Robert McCraith , Lukas Neumann , Andrew Zisserman , Andrea Vedaldi

Self-supervised monocular depth prediction provides a cost-effective solution to obtain the 3D location of each pixel. However, the existing approaches usually lead to unsatisfactory accuracy, which is critical for autonomous robots. In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ziyue Feng , Longlong Jing , Peng Yin , Yingli Tian , Bing Li

Monocular depth estimators can be trained with various forms of self-supervision from binocular-stereo data to circumvent the need for high-quality laser scans or other ground-truth data. The disadvantage, however, is that the photometric…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Jamie Watson , Michael Firman , Gabriel J. Brostow , Daniyar Turmukhambetov

Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (HR) ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Jialei Xu , Yuanchao Bai , Xianming Liu , Junjun Jiang , Xiangyang Ji

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires sequential data from…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Xingtong Liu , Ayushi Sinha , Mathias Unberath , Masaru Ishii , Gregory Hager , Russell H. Taylor , Austin Reiter