English
Related papers

Related papers: Deep Planar Parallax for Monocular Depth Estimatio…

200 papers

In this work we present a self-supervised learning framework to simultaneously train two Convolutional Neural Networks (CNNs) to predict depth and surface normals from a single image. In contrast to most existing frameworks which represent…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Huangying Zhan , Chamara Saroj Weerasekera , Ravi Garg , Ian Reid

In the current monocular depth research, the dominant approach is to employ unsupervised training on large datasets, driven by warped photometric consistency. Such approaches lack robustness and are unable to generalize to challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jaime Spencer , Richard Bowden , Simon Hadfield

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi

Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Clément Godard , Oisin Mac Aodha , Gabriel J. Brostow

Deep neural networks are applied to a wide range of problems in recent years. In this work, Convolutional Neural Network (CNN) is applied to the problem of determining the depth from a single camera image (monocular depth). Eight different…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 S. Bazrafkan , H. Javidnia , J. Lemley , P. Corcoran

Self-supervised depth estimation from monocular sequences relies on the joint learning of a depth and a pose network. Despite abundant research done to improve the depth network, efforts on the pose remain limited. In this context, even…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Changxuan Li , Nadine Berner , Nassir Navab , Federico Tombari , Stefano Gasperini

Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jie Xiang , Yun Wang , Lifeng An , Haiyang Liu , Jian Liu

Depth estimation from images serves as the fundamental step of 3D perception for autonomous driving and is an economical alternative to expensive depth sensors like LiDAR. The temporal photometric constraints enables self-supervised depth…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yi Wei , Linqing Zhao , Wenzhao Zheng , Zheng Zhu , Yongming Rao , Guan Huang , Jiwen Lu , Jie Zhou

Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nan Yang , Rui Wang , Jörg Stückler , Daniel Cremers

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

With the rapid advancements in autonomous driving and robot navigation, there is a growing demand for lifelong learning models capable of estimating metric (absolute) depth. Lifelong learning approaches potentially offer significant cost…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Junjie Hu , Chenyou Fan , Liguang Zhou , Qing Gao , Honghai Liu , Tin Lun Lam

Estimating depth from a single image represents an attractive alternative to more traditional approaches leveraging multiple cameras. In this field, deep learning yielded outstanding results at the cost of needing large amounts of data…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Lorenzo Andraghetti , Panteleimon Myriokefalitakis , Pier Luigi Dovesi , Belen Luque , Matteo Poggi , Alessandro Pieropan , Stefano Mattoccia

Monocular depth estimation is a recurring subject in the field of computer vision. Its ability to describe scenes via a depth map while reducing the constraints related to the formulation of perspective geometry tends to favor its use.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Marc Blanchon , Désiré Sidibé , Olivier Morel , Ralph Seulin , Daniel Braun , Fabrice Meriaudeau

Previous monocular depth estimation methods take a single view and directly regress the expected results. Though recent advances are made by applying geometrically inspired loss functions during training, the inference procedure does not…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Yue Luo , Jimmy Ren , Mude Lin , Jiahao Pang , Wenxiu Sun , Hongsheng Li , Liang Lin

The capabilities of monocular depth estimation (MDE) models are limited by the availability of sufficient and diverse datasets. In the case of MDE models for autonomous driving, this issue is exacerbated by the linearity of the captured…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Casimir Feldmann , Niall Siegenheim , Nikolas Hars , Lovro Rabuzin , Mert Ertugrul , Luca Wolfart , Marc Pollefeys , Zuria Bauer , Martin R. Oswald

In this work, we propose a method that combines unsupervised deep learning predictions for optical flow and monocular disparity with a model based optimization procedure for instantaneous camera pose. Given the flow and disparity…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Alex Zihao Zhu , Wenxin Liu , Ziyun Wang , Vijay Kumar , Kostas Daniilidis

Estimating depth from a monocular image is an ill-posed problem: when the camera projects a 3D scene onto a 2D plane, depth information is inherently and permanently lost. Nevertheless, recent work has shown impressive results in estimating…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Jagpreet Chawla , Nikhil Thakurdesai , Anuj Godase , Md Reza , David Crandall , Soon-Heung Jung

Recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance. However, they require costly ground truth annotations during training. To cope with this issue, in this paper we present…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Andrea Pilzer , Stéphane Lathuilière , Dan Xu , Mihai Marian Puscas , Elisa Ricci , Nicu Sebe

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

Autonomous vehicle navigation is a key challenge in artificial intelligence, requiring robust and accurate decision-making processes. This research introduces a new end-to-end method that exploits multimodal information from a single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Fouad Makiyeh , Mark Bastourous , Anass Bairouk , Wei Xiao , Mirjana Maras , Tsun-Hsuan Wangb , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus