中文
相关论文

相关论文: Depth from Videos in the Wild: Unsupervised Monocu…

200 篇论文

Spatial scene understanding, including monocular depth estimation, is an important problem in various applications, such as robotics and autonomous driving. While improvements in unsupervised monocular depth estimation have potentially…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

We present an algorithm for reconstructing dense, geometrically consistent depth for all pixels in a monocular video. We leverage a conventional structure-from-motion reconstruction to establish geometric constraints on pixels in the video.…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Xuan Luo , Jia-Bin Huang , Richard Szeliski , Kevin Matzen , Johannes Kopf

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

计算机视觉与模式识别 · 计算机科学 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

While learning based depth estimation from images/videos has achieved substantial progress, there still exist intrinsic limitations. Supervised methods are limited by a small amount of ground truth or labeled data and unsupervised methods…

计算机视觉与模式识别 · 计算机科学 2019-05-24 Haofei Xu , Jianmin Zheng , Jianfei Cai , Juyong Zhang

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

计算机视觉与模式识别 · 计算机科学 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler

Autonomous cars need continuously updated depth information. Thus far, depth is mostly estimated independently for a single frame at a time, even if the method starts from video input. Our method produces a time series of depth maps, which…

计算机视觉与模式识别 · 计算机科学 2020-07-29 Vaishakh Patil , Wouter Van Gansbeke , Dengxin Dai , Luc Van Gool

We present a novel method to train machine learning algorithms to estimate scene depths from a single image, by using the information provided by a camera's aperture as supervision. Prior works use a depth sensor's outputs or images of the…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Pratul P. Srinivasan , Rahul Garg , Neal Wadhwa , Ren Ng , Jonathan T. Barron

In the recent years, many methods demonstrated the ability of neural networks to learn depth and pose changes in a sequence of images, using only self-supervision as the training signal. Whilst the networks achieve good performance, the…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Robert McCraith , Lukas Neumann , Andrea Vedaldi

Supervised learning based methods for monocular depth estimation usually require large amounts of extensively annotated training data. In the case of aerial imagery, this ground truth is particularly difficult to acquire. Therefore, in this…

计算机视觉与模式识别 · 计算机科学 2020-08-18 Max Hermann , Boitumelo Ruf , Martin Weinmann , Stefan Hinz

Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estimation explore the…

计算机视觉与模式识别 · 计算机科学 2018-04-06 Huangying Zhan , Ravi Garg , Chamara Saroj Weerasekera , Kejie Li , Harsh Agarwal , Ian Reid

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (SLAM) with…

计算机视觉与模式识别 · 计算机科学 2022-03-11 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

Unsupervised monocular depth estimation has received widespread attention because of its capability to train without ground truth. In real-world scenarios, the images may be blurry or noisy due to the influence of weather conditions and…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Runze Liu , Dongchen Zhu , Guanghui Zhang , Yue Xu , Wenjun Shi , Xiaolin Zhang , Lei Wang , Jiamao Li

We propose a depth map inference system from monocular videos based on a novel dataset for navigation that mimics aerial footage from gimbal stabilized monocular camera in rigid scenes. Unlike most navigation datasets, the lack of rotation…

计算机视觉与模式识别 · 计算机科学 2018-09-13 Clément Pinard , Laure Chevalley , Antoine Manzanera , David Filliat

We propose a monocular depth estimator SC-Depth, which requires only unlabelled videos for training and enables the scale-consistent prediction at inference time. Our contributions include: (i) we propose a geometry consistency loss, which…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Jia-Wang Bian , Huangying Zhan , Naiyan Wang , Zhichao Li , Le Zhang , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Unsupervised depth learning takes the appearance difference between a target view and a view synthesized from its adjacent frame as supervisory signal. Since the supervisory signal only comes from images themselves, the resolution of…

计算机视觉与模式识别 · 计算机科学 2019-10-22 Junsheng Zhou , Yuwang Wang , Kaihuai Qin , Wenjun Zeng

We consider the problem of next frame prediction from video input. A recurrent convolutional neural network is trained to predict depth from monocular video input, which, along with the current video image and the camera trajectory, can…

机器学习 · 计算机科学 2017-06-14 Reza Mahjourian , Martin Wicke , Anelia Angelova

It is an exciting task to recover the scene's 3d-structure and camera pose from the video sequence. Most of the current solutions divide it into two parts, monocular depth recovery and camera pose estimation. The monocular depth recovery is…

计算机视觉与模式识别 · 计算机科学 2018-05-24 YanTong Wu , Yang Liu

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

Autonomous vehicles and robots need to operate over a wide variety of scenarios in order to complete tasks efficiently and safely. Multi-camera self-supervised monocular depth estimation from videos is a promising way to reason about the…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Takayuki Kanai , Igor Vasiljevic , Vitor Guizilini , Adrien Gaidon , Rares Ambrus