English
Related papers

Related papers: How Far Can I Go ? : A Self-Supervised Approach fo…

200 papers

In this paper, we tackle the problem of estimating the depth of a scene from a monocular video sequence. In particular, we handle challenging scenarios, such as non-translational camera motion and dynamic scenes, where traditional structure…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Miaomiao Liu , Mathieu Salzmann , Xuming He

We present a fully data-driven method to compute depth from diverse monocular video sequences that contain large amounts of non-rigid objects, e.g., people. In order to learn reconstruction cues for non-rigid scenes, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Chaoyang Wang , Simon Lucey , Federico Perazzi , Oliver Wang

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Rui Wang , Stephen M. Pizer , Jan-Michael Frahm

The ability to predict depth from a single image - using recent advances in CNNs - is of increasing interest to the vision community. Unsupervised strategies to learning are particularly appealing as they can utilize much larger and varied…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Chaoyang Wang , Jose Miguel Buenaposada , Rui Zhu , Simon Lucey

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Learning to reconstruct depths in a single image by watching unlabeled videos via deep convolutional network (DCN) is attracting significant attention in recent years. In this paper, we introduce a surface normal representation for…

Computer Vision and Pattern Recognition · Computer Science 2017-11-13 Zhenheng Yang , Peng Wang , Wei Xu , Liang Zhao , Ramakant Nevatia

This paper addresses the importance of full-image supervision for monocular depth estimation. We propose a semi-supervised architecture, which combines both unsupervised framework of using image consistency and supervised framework of dense…

Computer Vision and Pattern Recognition · Computer Science 2020-01-31 Bei Wang , Jianping An

Self-supervised monocular depth estimation is of significant importance with applications spanning across autonomous driving and robotics. However, the reliance on self-supervision introduces a strong static-scene assumption, thereby posing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yue-Jiang Dong , Yuan-Chen Guo , Ying-Tian Liu , Fang-Lue Zhang , Song-Hai Zhang

We propose a general self-supervised learning approach for spatial perception tasks, such as estimating the pose of an object relative to the robot, from onboard sensor readings. The model is learned from training episodes, by relying on: a…

Robotics · Computer Science 2021-07-20 Mirko Nava , Antonio Paolillo , Jérôme Guzzi , Luca Maria Gambardella , Alessandro Giusti

We present a novel algorithm for self-supervised monocular depth completion. Our approach is based on training a neural network that requires only sparse depth measurements and corresponding monocular video sequences without dense depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

Portraits or selfie images taken from a close distance typically suffer from perspective distortion. In this paper, we propose an end-to-end deep learning-based rectification pipeline to mitigate the effects of perspective distortion. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Ahmed Alhawwary , Janne Mustaniemi , Phong Nguyen-Ha , Janne Heikkilä

Despite advancements in self-supervised monocular depth estimation, challenges persist in dynamic scenarios due to the dependence on assumptions about a static world. In this paper, we present Manydepth2, to achieve precise depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Kaichen Zhou , Jia-Wang Bian , Jian-Qing Zheng , Jiaxing Zhong , Qian Xie , Niki Trigoni , Andrew Markham

Depth estimation is a challenging task of 3D reconstruction to enhance the accuracy sensing of environment awareness. This work brings a new solution with a set of improvements, which increase the quantitative and qualitative understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Armin Masoumian , Hatem A. Rashwan , Saddam Abdulwahab , Julian Cristiano , Domenec Puig

Self-supervised prediction is a powerful mechanism to learn representations that capture the underlying structure of the data. Despite recent progress, the self-supervised video prediction task is still challenging. One of the critical…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Hafez Farazi , Sven Behnke

Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jie Xiang , Yun Wang , Lifeng An , Haiyang Liu , Jian Liu

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

Category-level 3D pose estimation is a fundamentally important problem in computer vision and robotics, e.g. for embodied agents or to train 3D generative models. However, so far methods that estimate the category-level object pose require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Leonhard Sommer , Artur Jesslen , Eddy Ilg , Adam Kortylewski

Monocular depth estimation has improved significantly in recent years, driven by increasingly powerful models and large-scale training data. Predicted depth is increasingly used as an input signal for downstream tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Viktor Kocur , Sithu Aung , Gabrielle Flood , Yaqing Ding , Lukas Bujnak , Torsten Sattler , Zuzana Kukelova

Depth information is important for autonomous systems to perceive environments and estimate their own state. Traditional depth estimation methods, like structure from motion and stereo vision matching, are built on feature correspondences…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Chaoqiang Zhao , Qiyu Sun , Chongzhen Zhang , Yang Tang , Feng Qian