English
Related papers

Related papers: Semantics-Driven Unsupervised Learning for Monocul…

200 papers

Self-supervised monocular depth estimation has been a subject of intense study in recent years, because of its applications in robotics and autonomous driving. Much of the recent work focuses on improving depth estimation by increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Kieran Saunders , George Vogiatzis , Luis J. Manso

Self-supervised monocular depth estimation methods aim to be used in critical applications such as autonomous vehicles for environment analysis. To circumvent the potential imperfections of these approaches, a quantification of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Rémi Marsal , Florian Chabot , Angelique Loesch , William Grolleau , Hichem Sahbi

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (SLAM) with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

Self-supervised monocular scene flow estimation, aiming to understand both 3D structures and 3D motions from two temporally consecutive monocular images, has received increasing attention for its simple and economical sensor setup. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zijie Jiang , Masatoshi Okutomi

Self-supervised learning of depth and ego-motion from unlabeled monocular video has acquired promising results and drawn extensive attention. Most existing methods jointly train the depth and pose networks by photometric consistency of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Jiaojiao Fang , Guizhong Liu

Depth estimation plays an important role in the robotic perception system. Self-supervised monocular paradigm has gained significant attention since it can free training from the reliance on depth annotations. Despite recent advancements,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Jinfeng Liu , Lingtong Kong , Jie Yang , Wei Liu

While many visual ego-motion algorithm variants have been proposed in the past decade, learning based ego-motion estimation methods have seen an increasing attention because of its desirable properties of robustness to image noise and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Guangyao Zhai , Liang Liu , Linjian Zhang , Yong Liu

Learning depth and optical flow via deep neural networks by watching videos has made significant progress recently. In this paper, we jointly solve the two tasks by exploiting the underlying geometric rules within stereo videos.…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Yang Wang , Zhenheng Yang , Peng Wang , Yi Yang , Chenxu Luo , Wei Xu

The question of whether pre-training on geometric tasks is viable for downstream transfer to semantic tasks is important for two reasons, one practical and the other scientific. If the answer is positive, we may be able to reduce…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Dong Lao , Fengyu Yang , Daniel Wang , Hyoungseob Park , Samuel Lu , Alex Wong , Stefano Soatto

The advent of deep learning has brought an impressive advance to monocular depth estimation, e.g., supervised monocular depth estimation has been thoroughly investigated. However, the large amount of the RGB-to-depth dataset may not be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Fei Lu , Hyeonwoo Yu , Jean Oh

We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dipan Mandal , Abhilash Jain

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

Monocular depth estimation involves predicting depth from a single RGB image and plays a crucial role in applications such as autonomous driving, robotic navigation, 3D reconstruction, etc. Recent advancements in learning-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Jingming Xia , Guanqun Cao , Guang Ma , Yiben Luo , Qinzhao Li , John Oyekan

In autonomous driving, monocular sequences contain lots of information. Monocular depth estimation, camera ego-motion estimation and optical flow estimation in consecutive frames are high-profile concerns recently. By analyzing tasks above,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Guangming Wang , Chi Zhang , Hesheng Wang , Jingchuan Wang , Yong Wang , Xinlei Wang

We address the problem of discovering part segmentations of articulated objects without supervision. In contrast to keypoints, part segmentations provide information about part localizations on the level of individual pixels. Capturing both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Sandro Braun , Patrick Esser , Björn Ommer

Self-supervised methods have showed promising results on depth estimation task. However, previous methods estimate the target depth map and camera ego-motion simultaneously, underusing multi-frame correlation information and ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Songchun Zhang , Chunhui Zhao

The ability to accurately estimate depth information is crucial for many autonomous applications to recognize the surrounded environment and predict the depth of important objects. One of the most recently used techniques is monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Ahmed Zaitoon , Hossam El Din Abd El Munim , Hazem Abbas

Accurate real depth annotations are difficult to acquire, needing the use of special devices such as a LiDAR sensor. Self-supervised methods try to overcome this problem by processing video or stereo sequences, which may not always be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Adrian Lopez-Rodriguez , Krystian Mikolajczyk

In this paper, we propose a novel self-supervised learning model for estimating continuous ego-motion from video. Our model learns to estimate camera motion by watching RGBD or RGB video streams and determining translational and rotation…

Computational Geometry · Computer Science 2018-06-28 Minhaeng Lee , Charless C. Fowlkes

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi