English
Related papers

Related papers: Unsupervised Learning of Monocular Depth and Ego-M…

200 papers

Self-supervised deep learning-based 3D scene understanding methods can overcome the difficulty of acquiring the densely labeled ground-truth and have made a lot of advances. However, occlusions and moving objects are still some of the major…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jiaojiao Fang , Guizhong Liu

In recent years, unsupervised deep learning approaches have received significant attention to estimate the depth and visual odometry (VO) from unlabelled monocular image sequences. However, their performance is limited in challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yasin Almalioglu , Angel Santamaria-Navarro , Benjamin Morrell , Ali-akbar Agha-mohammadi

Self-supervised monocular depth estimation presents a powerful method to obtain 3D scene information from single camera images, which is trainable on arbitrary image sequences without requiring depth labels, e.g., from a LiDAR sensor. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Marvin Klingner , Jan-Aike Termöhlen , Jonas Mikolajczyk , Tim Fingscheidt

The ability to accurately estimate depth information is crucial for many autonomous applications to recognize the surrounded environment and predict the depth of important objects. One of the most recently used techniques is monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Ahmed Zaitoon , Hossam El Din Abd El Munim , Hazem Abbas

Monocular depth estimation has drawn widespread attention from the vision community due to its broad applications. In this paper, we propose a novel physics (geometry)-driven deep learning framework for monocular depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Shuwei Shao , Zhongcai Pei , Weihai Chen , Xingming Wu , Zhengguo Li

Monocular depth estimators can be trained with various forms of self-supervision from binocular-stereo data to circumvent the need for high-quality laser scans or other ground-truth data. The disadvantage, however, is that the photometric…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Jamie Watson , Michael Firman , Gabriel J. Brostow , Daniyar Turmukhambetov

Perceiving 3D information is of paramount importance in many applications of computer vision. Recent advances in monocular depth estimation have shown that gaining such knowledge from a single camera input is possible by training deep…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sai Shyam Chanduri , Zeeshan Khan Suri , Igor Vozniak , Christian Müller

Recently unsupervised learning of depth from videos has made remarkable progress and the results are comparable to fully supervised methods in outdoor scenes like KITTI. However, there still exist great challenges when directly applying…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Junsheng Zhou , Yuwang Wang , Kaihuai Qin , Wenjun Zeng

Autonomous cars need continuously updated depth information. Thus far, depth is mostly estimated independently for a single frame at a time, even if the method starts from video input. Our method produces a time series of depth maps, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Vaishakh Patil , Wouter Van Gansbeke , Dengxin Dai , Luc Van Gool

Single-view depth estimation refers to the ability to derive three-dimensional information per pixel from a single two-dimensional image. Single-view depth estimation is an ill-posed problem because there are multiple depth solutions that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Javier Rodriguez-Puigvert

Monocular depth estimation is known as an ill-posed task in which objects in a 2D image usually do not contain sufficient information to predict their depth. Thus, it acts differently from other tasks (e.g., classification and segmentation)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wencheng Han , Junbo Yin , Jianbing Shen

In this paper, we proposed an unsupervised learning method for estimating the optical flow between video frames, especially to solve the occlusion problem. Occlusion is caused by the movement of an object or the movement of the camera,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Jianfeng Li , Junqiao Zhao , Tiantian Feng , Chen Ye , Lu Xiong

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Estimating the motion of the camera together with the 3D structure of the scene from a monocular vision system is a complex task that often relies on the so-called scene rigidity assumption. When observing a dynamic environment, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Seokju Lee , Francois Rameau , Fei Pan , In So Kweon

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (SLAM) with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Rui Wang , Stephen M. Pizer , Jan-Michael Frahm

Depth estimation provides essential information to perform autonomous driving and driver assistance. Especially, Monocular Depth Estimation is interesting from a practical point of view, since using a single camera is cheaper than many…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Akhil Gurram , Onay Urfalioglu , Ibrahim Halfaoui , Fahd Bouzaraa , Antonio M. Lopez

Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised manner, without…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Hao Qu , Lilian Zhang , Xiaoping Hu , Xiaofeng He , Xianfei Pan , Changhao Chen

Learning depth and camera ego-motion from raw unlabeled RGB video streams is seeing exciting progress through self-supervision from strong geometric cues. To leverage not only appearance but also scene geometry, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Rares Ambrus , Vitor Guizilini , Jie Li , Sudeep Pillai , Adrien Gaidon

In the current monocular depth research, the dominant approach is to employ unsupervised training on large datasets, driven by warped photometric consistency. Such approaches lack robustness and are unable to generalize to challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jaime Spencer , Richard Bowden , Simon Hadfield