English
Related papers

Related papers: Neural Ray Surfaces for Self-Supervised Learning o…

200 papers

Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Dongseok Shim , H. Jin Kim

Learning-based, single-view depth estimation often generalizes poorly to unseen datasets. While learning-based, two-frame depth estimation solves this problem to some extent by learning to match features across frames, it performs poorly at…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Rui Wang , Jan-Michael Frahm , Stephen M. Pizer

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

In this work, we propose a camera self-calibration algorithm for generic cameras with arbitrary non-linear distortions. We jointly learn the geometry of the scene and the accurate camera parameters without any calibration objects. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yoonwoo Jeong , Seokjun Ahn , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

Unsupervised learning of depth and ego-motion from unlabelled monocular videos has recently drawn great attention, which avoids the use of expensive ground truth in the supervised one. It achieves this by using the photometric errors…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Hualie Jiang , Laiyan Ding , Zhenglong Sun , Rui Huang

In this work we present a self-supervised learning framework to simultaneously train two Convolutional Neural Networks (CNNs) to predict depth and surface normals from a single image. In contrast to most existing frameworks which represent…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Huangying Zhan , Chamara Saroj Weerasekera , Ravi Garg , Ian Reid

Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised manner, without…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Hao Qu , Lilian Zhang , Xiaoping Hu , Xiaofeng He , Xianfei Pan , Changhao Chen

Unsupervised learning based depth estimation methods have received more and more attention as they do not need vast quantities of densely labeled data for training which are touch to acquire. In this paper, we propose a novel unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Lingtao Zhou , Jiaojiao Fang , Guizhong Liu

While learning based depth estimation from images/videos has achieved substantial progress, there still exist intrinsic limitations. Supervised methods are limited by a small amount of ground truth or labeled data and unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Haofei Xu , Jianmin Zheng , Jianfei Cai , Juyong Zhang

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires sequential data from…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Xingtong Liu , Ayushi Sinha , Mathias Unberath , Masaru Ishii , Gregory Hager , Russell H. Taylor , Austin Reiter

Single-view depth estimation refers to the ability to derive three-dimensional information per pixel from a single two-dimensional image. Single-view depth estimation is an ill-posed problem because there are multiple depth solutions that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Javier Rodriguez-Puigvert

A commonly observed failure mode of Neural Radiance Field (NeRF) is fitting incorrect geometries when given an insufficient number of input views. One potential reason is that standard volumetric rendering does not enforce the constraint…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Kangle Deng , Andrew Liu , Jun-Yan Zhu , Deva Ramanan

Depth estimation is a critical topic for robotics and vision-related tasks. In monocular depth estimation, in comparison with supervised learning that requires expensive ground truth labeling, self-supervised methods possess great potential…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Jinchang Zhang , Praveen Kumar Reddy , Xue-Iuan Wong , Yiannis Aloimonos , Guoyu Lu

We present a convolutional neural network for joint 3D shape prediction and viewpoint estimation from a single input image. During training, our network gets the learning signal from a silhouette of an object in the input image - a form of…

Robotics · Computer Science 2019-10-18 Oier Mees , Maxim Tatarchenko , Thomas Brox , Wolfram Burgard

We propose a semantics-driven unsupervised learning approach for monocular depth and ego-motion estimation from videos in this paper. Recent unsupervised learning methods employ photometric errors between synthetic view and actual image as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Xiaobin Wei , Jianjiang Feng , Jie Zhou

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

For ego-motion estimation, the feature representation of the scenes is crucial. Previous methods indicate that both the low-level and semantic feature-based methods can achieve promising results. Therefore, the incorporation of hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Xiaochuan Yin , Chengju Liu

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabeled monocular video.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Jiquan Zhong , Shijie Zhao , Wenhua Wu , Zhe Liu , Hesheng Wang

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim