中文
相关论文

相关论文: Depth from Videos in the Wild: Unsupervised Monocu…

200 篇论文

Learning depth and optical flow via deep neural networks by watching videos has made significant progress recently. In this paper, we jointly solve the two tasks by exploiting the underlying geometric rules within stereo videos.…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Yang Wang , Zhenheng Yang , Peng Wang , Yi Yang , Chenxu Luo , Wei Xu

Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities…

计算机视觉与模式识别 · 计算机科学 2017-04-14 Clément Godard , Oisin Mac Aodha , Gabriel J. Brostow

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network.…

计算机视觉与模式识别 · 计算机科学 2020-06-29 Jianrong Wang , Ge Zhang , Zhenyu Wu , XueWei Li , Li Liu

Whole understanding of the surroundings is paramount to autonomous systems. Recent works have shown that deep neural networks can learn geometry (depth) and motion (optical flow) from a monocular video without any explicit supervision from…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Fabio Tosi , Filippo Aleotti , Pierluigi Zama Ramirez , Matteo Poggi , Samuele Salti , Luigi Di Stefano , Stefano Mattoccia

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

计算机视觉与模式识别 · 计算机科学 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Estimating depth from single RGB images and videos is of widespread interest due to its applications in many areas, including autonomous driving, 3D reconstruction, digital entertainment, and robotics. More than 500 deep learning-based…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Uchitha Rajapaksha , Ferdous Sohel , Hamid Laga , Dean Diepeveen , Mohammed Bennamoun

Recently unsupervised learning of depth from videos has made remarkable progress and the results are comparable to fully supervised methods in outdoor scenes like KITTI. However, there still exist great challenges when directly applying…

计算机视觉与模式识别 · 计算机科学 2019-10-22 Junsheng Zhou , Yuwang Wang , Kaihuai Qin , Wenjun Zeng

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

计算机视觉与模式识别 · 计算机科学 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

We introduce a convolutional neural network model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. Panoramic depth estimation is an important technology for applications such as virtual reality, 3D…

计算机视觉与模式识别 · 计算机科学 2020-08-20 Alisha Sharma , Jonathan Ventura

For ego-motion estimation, the feature representation of the scenes is crucial. Previous methods indicate that both the low-level and semantic feature-based methods can achieve promising results. Therefore, the incorporation of hierarchical…

计算机视觉与模式识别 · 计算机科学 2019-08-06 Xiaochuan Yin , Chengju Liu

We introduce a convolutional neural network model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. Panoramic depth estimation is an important technology for applications such as virtual reality, 3D…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Alisha Sharma , Ryan Nett , Jonathan Ventura

We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires monocular endoscopic videos…

计算机视觉与模式识别 · 计算机科学 2019-10-31 Xingtong Liu , Ayushi Sinha , Masaru Ishii , Gregory D. Hager , Austin Reiter , Russell H. Taylor , Mathias Unberath

As an agent moves through the world, the apparent motion of scene elements is (usually) inversely proportional to their depth. It is natural for a learning agent to associate image patterns with the magnitude of their displacement over…

计算机视觉与模式识别 · 计算机科学 2018-04-03 Huaizu Jiang , Erik Learned-Miller , Gustav Larsson , Michael Maire , Greg Shakhnarovich

We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our technical contributions are three-fold. First, we…

计算机视觉与模式识别 · 计算机科学 2020-04-09 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

We present a novel algorithm for self-supervised monocular depth completion. Our approach is based on training a neural network that requires only sparse depth measurements and corresponding monocular video sequences without dense depth…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

Deep learning techniques have enabled rapid progress in monocular depth estimation, but their quality is limited by the ill-posed nature of the problem and the scarcity of high quality datasets. We estimate depth from a single camera by…

计算机视觉与模式识别 · 计算机科学 2019-08-15 Rahul Garg , Neal Wadhwa , Sameer Ansari , Jonathan T. Barron

Depth estimation is critical for any robotic system. In the past years estimation of depth from monocular images have shown great improvement, however, in the underwater environment results are still lagging behind due to appearance changes…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Shlomi Amitai , Itzik Klein , Tali Treibitz

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

计算机视觉与模式识别 · 计算机科学 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

计算机视觉与模式识别 · 计算机科学 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

Self-supervised monocular depth estimation methods aim to be used in critical applications such as autonomous vehicles for environment analysis. To circumvent the potential imperfections of these approaches, a quantification of the…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Rémi Marsal , Florian Chabot , Angelique Loesch , William Grolleau , Hichem Sahbi