English
Related papers

Related papers: Learning Occlusion-Aware Coarse-to-Fine Depth Map …

200 papers

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires sequential data from…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Xingtong Liu , Ayushi Sinha , Mathias Unberath , Masaru Ishii , Gregory Hager , Russell H. Taylor , Austin Reiter

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

In this paper we present a novel self-supervised method to anticipate the depth estimate for a future, unobserved real-world urban scene. This work is the first to explore self-supervised learning for estimation of monocular depth of future…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Sauradip Nag , Nisarg Shah , Anran Qi , Raghavendra Ramachandra

We propose a learning-based method that solves monocular stereo and can be extended to fuse depth information from multiple target frames. Given two unconstrained images from a monocular camera with known intrinsic calibration, our network…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Kaixuan Wang , Shaojie Shen

Recent advances in monocular 3D detection leverage a depth estimation network explicitly as an intermediate stage of the 3D detection network. Depth map approaches yield more accurate depth to objects than other methods thanks to the depth…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Youngseok Kim , Sanmin Kim , Sangmin Sim , Jun Won Choi , Dongsuk Kum

Self-supervised paradigms for monocular depth estimation are very appealing since they do not require ground truth annotations at all. Despite the astonishing results yielded by such methodologies, learning to reason about the uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Matteo Poggi , Filippo Aleotti , Fabio Tosi , Stefano Mattoccia

Monocular depth estimation is an especially important task in robotics and autonomous driving, where 3D structural information is essential. However, extreme lighting conditions and complex surface objects make it difficult to predict depth…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Minhyeok Lee , Sangwon Hwang , Chaewon Park , Sangyoun Lee

The dense depth estimation of a 3D scene has numerous applications, mainly in robotics and surveillance. LiDAR and radar sensors are the hardware solution for real-time depth estimation, but these sensors produce sparse depth maps and are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Alwyn Mathew , Aditya Prakash Patra , Jimson Mathew

Depth estimation plays an important role in the robotic perception system. Self-supervised monocular paradigm has gained significant attention since it can free training from the reliance on depth annotations. Despite recent advancements,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Jinfeng Liu , Lingtong Kong , Jie Yang , Wei Liu

Monocular depth estimation is a highly challenging problem that is often addressed with deep neural networks. While these are able to use recognition of image features to predict reasonably looking depth maps the result often has low metric…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Patrik Persson , Linn Öström , Carl Olsson

Monocular depth estimation is a crucial task to measure distance relative to a camera, which is important for applications, such as robot navigation and self-driving. Traditional frame-based methods suffer from performance drops due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Tianbo Pan , Zidong Cao , Lin Wang

Despite significant progress in monocular depth estimation in the wild, recent state-of-the-art methods cannot be used to recover accurate 3D scene shape due to an unknown depth shift induced by shift-invariant reconstruction losses used in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Long Mai , Simon Chen , Chunhua Shen

Although deep neural networks have been widely applied to computer vision problems, extending them into multiview depth estimation is non-trivial. In this paper, we present MVDepthNet, a convolutional network to solve the depth estimation…

Robotics · Computer Science 2018-07-24 Kaixuan Wang , Shaojie Shen

Conventional self-supervised monocular depth prediction methods are based on a static environment assumption, which leads to accuracy degradation in dynamic scenes due to the mismatch and occlusion problems introduced by object motions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ziyue Feng , Liang Yang , Longlong Jing , Haiyan Wang , YingLi Tian , Bing Li

Occlusions play an important role in disparity and optical flow estimation, since matching costs are not available in occluded areas and occlusions indicate depth or motion boundaries. Moreover, occlusions are relevant for motion…

Computer Vision and Pattern Recognition · Computer Science 2018-08-09 Eddy Ilg , Tonmoy Saikia , Margret Keuper , Thomas Brox

Self-supervised monocular depth estimation has been widely investigated to estimate depth images and relative poses from RGB images. This framework is attractive for researchers because the depth and pose networks can be trained from just…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Noriaki Hirose , Kosuke Tahara

While monocular depth estimation (MDE) is an important problem in computer vision, it is difficult due to the ambiguity that results from the compression of a 3D scene into only 2 dimensions. It is common practice in the field to treat it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Dylan Auty , Krystian Mikolajczyk

Learning to predict scene depth from RGB inputs is a challenging task both for indoor and outdoor robot navigation. In this work we address unsupervised learning of scene depth and robot ego-motion where supervision is provided by monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Monocular depth estimation aims at predicting depth from a single image or video. Recently, self-supervised methods draw much attention since they are free of depth annotations and achieve impressive performance on several daytime…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Kun Wang , Zhenyu Zhang , Zhiqiang Yan , Xiang Li , Baobei Xu , Jun Li , Jian Yang

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi