English
Related papers

Related papers: Unsupervised Learning of Depth and Ego-Motion from…

200 papers

We introduce a convolutional neural network model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. Panoramic depth estimation is an important technology for applications such as virtual reality, 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Alisha Sharma , Ryan Nett , Jonathan Ventura

We present a novel approach for unsupervised learning of depth and ego-motion from monocular video. Unsupervised learning removes the need for separate supervisory signals (depth or ego-motion ground truth, or multi-view video). Prior work…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Reza Mahjourian , Martin Wicke , Anelia Angelova

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

Learning-based, single-view depth estimation often generalizes poorly to unseen datasets. While learning-based, two-frame depth estimation solves this problem to some extent by learning to match features across frames, it performs poorly at…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Rui Wang , Jan-Michael Frahm , Stephen M. Pizer

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Unsupervised learning based depth estimation methods have received more and more attention as they do not need vast quantities of densely labeled data for training which are touch to acquire. In this paper, we propose a novel unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Lingtao Zhou , Jiaojiao Fang , Guizhong Liu

We propose a semantics-driven unsupervised learning approach for monocular depth and ego-motion estimation from videos in this paper. Recent unsupervised learning methods employ photometric errors between synthetic view and actual image as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Xiaobin Wei , Jianjiang Feng , Jie Zhou

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

Self-supervised learning has emerged as a powerful tool for depth and ego-motion estimation, leading to state-of-the-art results on benchmark datasets. However, one significant limitation shared by current methods is the assumption of a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Sudeep Pillai , Wolfram Burgard , Greg Shakhnarovich , Adrien Gaidon

Understanding how images of objects and scenes behave in response to specific ego-motions is a crucial aspect of proper visual development, yet existing visual learning methods are conspicuously disconnected from the physical source of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Dinesh Jayaraman , Kristen Grauman

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabeled monocular video.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Jiquan Zhong , Shijie Zhao , Wenhua Wu , Zhe Liu , Hesheng Wang

Learning to predict scene depth from RGB inputs is a challenging task both for indoor and outdoor robot navigation. In this work we address unsupervised learning of scene depth and robot ego-motion where supervision is provided by monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Keyang Zhou , Kailun Yang , Kaiwei Wang

We present an approach which takes advantage of both structure and semantics for unsupervised monocular learning of depth and ego-motion. More specifically, we model the motion of individual objects and learn their 3D motion vector jointly…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Depth estimation in surgical video plays a crucial role in many image-guided surgery procedures. However, it is difficult and time consuming to create depth map ground truth datasets in surgical videos due in part to inconsistent brightness…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Ange Lou , Jack Noble

We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly to prior work, our…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Ariel Gordon , Hanhan Li , Rico Jonschkowski , Anelia Angelova

Depth estimation is a challenging task of 3D reconstruction to enhance the accuracy sensing of environment awareness. This work brings a new solution with a set of improvements, which increase the quantitative and qualitative understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Armin Masoumian , Hatem A. Rashwan , Saddam Abdulwahab , Julian Cristiano , Domenec Puig

As 360{\deg} cameras become prevalent in many autonomous systems (e.g., self-driving cars and drones), efficient 360{\deg} perception becomes more and more important. We propose a novel self-supervised learning approach for predicting the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Fu-En Wang , Hou-Ning Hu , Hsien-Tzu Cheng , Juan-Ting Lin , Shang-Ta Yang , Meng-Li Shih , Hung-Kuo Chu , Min Sun

In this paper, we propose a novel self-supervised learning model for estimating continuous ego-motion from video. Our model learns to estimate camera motion by watching RGBD or RGB video streams and determining translational and rotation…

Computational Geometry · Computer Science 2018-06-28 Minhaeng Lee , Charless C. Fowlkes

Depth estimation from images serves as the fundamental step of 3D perception for autonomous driving and is an economical alternative to expensive depth sensors like LiDAR. The temporal photometric constraints enables self-supervised depth…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yi Wei , Linqing Zhao , Wenzhao Zheng , Zheng Zhu , Yongming Rao , Guan Huang , Jiwen Lu , Jie Zhou
‹ Prev 1 2 3 10 Next ›