English
Related papers

Related papers: Unsupervised Learning of Monocular Depth and Ego-M…

200 papers

Nighttime self-supervised monocular depth estimation has received increasing attention in recent years. However, using night images for self-supervision is unreliable because the photometric consistency assumption is usually violated in the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haolin Yang , Chaoqiang Zhao , Lu Sheng , Yang Tang

In this paper, we introduce a novel training method for making any monocular depth network learn absolute scale and estimate metric road-scene depth just from regular training data, i.e., driving videos. We refer to this training framework…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Genki Kinoshita , Ko Nishino

Monocular depth estimation is an extensively studied computer vision problem with a vast variety of applications. Deep learning-based methods have demonstrated promise for both supervised and unsupervised depth estimation from monocular…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Richard Chen , Faisal Mahmood , Alan Yuille , Nicholas J. Durr

Given stereo or egomotion image pairs, a popular and successful method for unsupervised learning of monocular depth estimation is to measure the quality of image reconstructions resulting from the learned depth predictions. Continued…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Chen Ziwen , Zixuan Guo , Jerod Weinman

Monocular 3D object detection poses a significant challenge due to the lack of depth information in RGB images. Many existing methods strive to enhance the object depth estimation performance by allocating additional parameters for object…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Wonhyeok Choi , Mingyu Shin , Sunghoon Im

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Learning-based depth estimation has witnessed recent progress in multiple directions; from self-supervision using monocular video to supervised methods offering highest accuracy. Complementary to supervision, further boosts to performance…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yannick Verdié , Jifei Song , Barnabé Mas , Benjamin Busam , Aleš Leonardis , Steven McDonagh

Self-supervised monocular methods can efficiently learn depth information of weakly textured surfaces or reflective objects. However, the depth accuracy is limited due to the inherent ambiguity in monocular geometric modeling. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Xiaofeng Wang , Zheng Zhu , Guan Huang , Xu Chi , Yun Ye , Ziwei Chen , Xingang Wang

Event cameras are neuromorphically inspired sensors that sparsely and asynchronously report brightness changes. Their unique characteristics of high temporal resolution, high dynamic range, and low power consumption make them well-suited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Haitao Meng , Chonghao Zhong , Sheng Tang , Lian JunJia , Wenwei Lin , Zhenshan Bing , Yi Chang , Gang Chen , Alois Knoll

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

This paper presents a novel method, MaskMVS, to solve depth estimation for unstructured multi-view image-pose pairs. In the plane-sweep procedure, the depth planes are sampled by histogram matching that ensures covering the depth range of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Yuxin Hou , Arno Solin , Juho Kannala

Over the past few years, self-supervised monocular depth estimation that does not depend on ground-truth during the training phase has received widespread attention. Most efforts focus on designing different types of network architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Shuwei Shao , Zhongcai Pei , Weihai Chen , Dingchi Sun , Peter C. Y. Chen , Zhengguo Li

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

We present a model for the joint estimation of disparity and motion. The model is based on learning about the interrelations between images from multiple cameras, multiple frames in a video, or the combination of both. We show that learning…

Computer Vision and Pattern Recognition · Computer Science 2013-12-17 Kishore Konda , Roland Memisevic

Dynamic scenes that contain both object motion and egomotion are a challenge for monocular visual odometry (VO). Another issue with monocular VO is the scale ambiguity, i.e. these methods cannot estimate scene depth and camera motion in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Hirak J Kashyap , Charless Fowlkes , Jeffrey L Krichmar

Solving depth estimation with monocular cameras enables the possibility of widespread use of cameras as low-cost depth estimation sensors in applications such as autonomous driving and robotics. However, learning such a scalable depth…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Bin Cheng , Inderjot Singh Saggu , Raunak Shah , Gaurav Bansal , Dinesh Bharadia

The field of self-supervised monocular depth estimation has seen huge advancements in recent years. Most methods assume stereo data is available during training but usually under-utilize it and only treat it as a reference signal. We…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Matan Goldman , Tal Hassner , Shai Avidan

Convolutional neural networks (CNNs) have emerged as the state-of-the-art in multiple vision tasks including depth estimation. However, memory and computing power requirements remain as challenges to be tackled in these models. Monocular…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Sara Elkerdawy , Hong Zhang , Nilanjan Ray

Unsupervised monocular depth learning generally relies on the photometric relation among temporally adjacent images. Most of previous works use both mean absolute error (MAE) and structure similarity index measure (SSIM) with conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yijun Cao , Fuya Luo , Yongjie Li