English
Related papers

Related papers: Depth from Videos in the Wild: Unsupervised Monocu…

200 papers

We present a fully data-driven method to compute depth from diverse monocular video sequences that contain large amounts of non-rigid objects, e.g., people. In order to learn reconstruction cues for non-rigid scenes, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Chaoyang Wang , Simon Lucey , Federico Perazzi , Oliver Wang

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

Depth estimation in surgical video plays a crucial role in many image-guided surgery procedures. However, it is difficult and time consuming to create depth map ground truth datasets in surgical videos due in part to inconsistent brightness…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Ange Lou , Jack Noble

This paper studies unsupervised monocular depth prediction problem. Most of existing unsupervised depth prediction algorithms are developed for outdoor scenarios, while the depth prediction work in the indoor environment is still very…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Yinglong Feng , Shuncheng Wu , Okan Köpüklü , Xueyang Kang , Federico Tombari

This work is based on a questioning of the quality metrics used by deep neural networks performing depth prediction from a single image, and then of the usability of recently published works on unsupervised learning of depth from videos. To…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Clément Pinard , Laure Chevalley , Antoine Manzanera , David Filliat

In this paper we present a novel self-supervised method to anticipate the depth estimate for a future, unobserved real-world urban scene. This work is the first to explore self-supervised learning for estimation of monocular depth of future…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Sauradip Nag , Nisarg Shah , Anran Qi , Raghavendra Ramachandra

We present a method for predicting dense depth in scenarios where both a monocular camera and people in the scene are freely moving. Existing methods for recovering depth for dynamic, non-rigid objects from monocular video impose strong…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Zhengqi Li , Tali Dekel , Forrester Cole , Richard Tucker , Noah Snavely , Ce Liu , William T. Freeman

Unsupervised monocular depth estimation techniques have demonstrated encouraging results but typically assume that the scene is static. These techniques suffer when trained on dynamical scenes, where apparent object motion can equally be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yihong Sun , Bharath Hariharan

Learning single image depth estimation model from monocular video sequence is a very challenging problem. In this paper, we propose a novel training loss which enables us to include more images for supervision during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhenwei Luo

In this paper, we tackle the problem of estimating the depth of a scene from a monocular video sequence. In particular, we handle challenging scenarios, such as non-translational camera motion and dynamic scenes, where traditional structure…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Miaomiao Liu , Mathieu Salzmann , Xuming He

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu

Monocular depth estimation aims at predicting depth from a single image or video. Recently, self-supervised methods draw much attention since they are free of depth annotations and achieve impressive performance on several daytime…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Kun Wang , Zhenyu Zhang , Zhiqiang Yan , Xiang Li , Baobei Xu , Jun Li , Jian Yang

Monocular depth estimation has been increasingly adopted in robotics and autonomous driving for its ability to infer scene geometry from a single camera. In self-supervised monocular depth estimation frameworks, the network jointly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Tae-Wook Um , Ki-Hyeon Kim , Hyun-Duck Choi , Hyo-Sung Ahn

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estimation require…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Mertalp Ocal , Armin Mustafa

Unsupervised learning from visual data is one of the most difficult challenges in computer vision, being a fundamental task for understanding how visual recognition works. From a practical point of view, learning from unsupervised visual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabeled monocular video.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Jiquan Zhong , Shijie Zhao , Wenhua Wu , Zhe Liu , Hesheng Wang

Learning to predict scene depth and camera motion from RGB inputs only is a challenging task. Most existing learning based methods deal with this task in a supervised manner which require ground-truth data that is expensive to acquire. More…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yunxiao Shi , Jing Zhu , Yi Fang , Kuochin Lien , Junli Gu

We propose a semantics-driven unsupervised learning approach for monocular depth and ego-motion estimation from videos in this paper. Recent unsupervised learning methods employ photometric errors between synthetic view and actual image as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Xiaobin Wei , Jianjiang Feng , Jie Zhou