English
Related papers

Related papers: Revisit Self-supervised Depth Estimation with Loca…

200 papers

In this paper, we tackle the accurate and consistent Structure from Motion (SfM) problem, in particular camera registration, far exceeding the memory of a single computer in parallel. Different from the previous methods which drastically…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Siyu Zhu , Tianwei Shen , Lei Zhou , Runze Zhang , Jinglu Wang , Tian Fang , Long Quan

In this paper we tackle the problem of learning Structure-from-Motion (SfM) through the use of graph attention networks. SfM is a classic computer vision problem that is solved though iterative minimization of reprojection errors, referred…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Lucas Brynte , José Pedro Iglesias , Carl Olsson , Fredrik Kahl

Depth estimation from a single image in the wild remains a challenging problem. One main obstacle is the lack of high-quality training data for images in the wild. In this paper we propose a method to automatically generate such data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Weifeng Chen , Shengyi Qian , Jia Deng

Typical Structure-from-Motion (SfM) pipelines rely on finding correspondences across images, recovering the projective structure of the observed scene and upgrading it to a metric frame using camera self-calibration constraints. Solving…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Rui Gong , Danda Pani Paudel , Ajad Chhatkuli , Luc Van Gool

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data. In this paper, we address the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tianwei Shen , Lei Zhou , Zixin Luo , Yao Yao , Shiwei Li , Jiahui Zhang , Tian Fang , Long Quan

Camera calibration is integral to robotics and computer vision algorithms that seek to infer geometric properties of the scene from visual input streams. In practice, calibration is a laborious procedure requiring specialized data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Jiading Fang , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Greg Shakhnarovich , Adrien Gaidon , Matthew R. Walter

Previous methods on estimating detailed human depth often require supervised training with `ground truth' depth data. This paper presents a self-supervised method that can be trained on YouTube videos without known depth, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Feitong Tan , Hao Zhu , Zhaopeng Cui , Siyu Zhu , Marc Pollefeys , Ping Tan

It is an exciting task to recover the scene's 3d-structure and camera pose from the video sequence. Most of the current solutions divide it into two parts, monocular depth recovery and camera pose estimation. The monocular depth recovery is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 YanTong Wu , Yang Liu

We consider the problem of simultaneously estimating a dense depth map and camera pose for a large set of images of an indoor scene. While classical SfM pipelines rely on a two-step approach where cameras are first estimated using a bundle…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Benjamin Graham , David Novotny

Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Chao Fan , Zhenyu Yin , Yue Li , Feiqing Zhang

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Depth estimation in surgical video plays a crucial role in many image-guided surgery procedures. However, it is difficult and time consuming to create depth map ground truth datasets in surgical videos due in part to inconsistent brightness…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Ange Lou , Jack Noble

This paper presents a neural incremental Structure-from-Motion (SfM) approach, Level-S$^2$fM, which estimates the camera poses and scene geometry from a set of uncalibrated images by learning coordinate MLPs for the implicit surfaces and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuxi Xiao , Nan Xue , Tianfu Wu , Gui-Song Xia

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

Structure-from-Motion (SfM), a task aiming at jointly recovering camera poses and 3D geometry of a scene given a set of images, remains a hard problem with still many open challenges despite decades of significant progress. The traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bardienus Duisterhof , Lojze Zust , Philippe Weinzaepfel , Vincent Leroy , Yohann Cabon , Jerome Revaud

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

Learning to predict scene depth and camera motion from RGB inputs only is a challenging task. Most existing learning based methods deal with this task in a supervised manner which require ground-truth data that is expensive to acquire. More…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yunxiao Shi , Jing Zhu , Yi Fang , Kuochin Lien , Junli Gu

Consumer-level depth cameras and depth sensors embedded in mobile devices enable numerous applications, such as AR games and face identification. However, the quality of the captured depth is sometimes insufficient for 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Akhmedkhan Shabanov , Ilya Krotov , Nikolay Chinaev , Vsevolod Poletaev , Sergei Kozlukov , Igor Pasechnik , Bulat Yakupov , Artsiom Sanakoyeu , Vadim Lebedev , Dmitry Ulyanov

Image-based 3D reconstruction is one of the most important tasks in Computer Vision with many solutions proposed over the last few decades. The objective is to extract metric information i.e. the geometry of scene objects directly from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Qiao Chen , Charalambos Poullis

Recently, self-supervised monocular depth estimation has gained popularity with numerous applications in autonomous driving and robotics. However, existing solutions primarily seek to estimate depth from immediate visual features, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Youhong Wang , Yunji Liang , Hao Xu , Shaohui Jiao , Hongkai Yu