English
Related papers

Related papers: DevNet: Self-supervised Monocular Depth Learning v…

200 papers

We present a method for jointly training the estimation of depth, ego-motion, and a dense 3D translation field of objects relative to the scene, with monocular photometric consistency being the sole source of supervision. We show that this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Hanhan Li , Ariel Gordon , Hang Zhao , Vincent Casser , Anelia Angelova

This paper introduces a fully deep learning approach to monocular SLAM, which can perform simultaneous localization using a neural network for learning visual odometry (L-VO) and dense 3D mapping. Dense 2D flow and a depth image are…

Robotics · Computer Science 2018-07-26 Cheng Zhao , Li Sun , Pulak Purkait , Tom Duckett , Rustam Stolkin

Deep approaches to predict monocular depth and ego-motion have grown in recent years due to their ability to produce dense depth from monocular images. The main idea behind them is to optimize the photometric consistency over image…

Robotics · Computer Science 2019-01-08 Vignesh Prasad , Dipanjan Das , Brojeshwar Bhowmick

Monocular 3D detection is a challenging task due to the lack of accurate 3D information. Existing approaches typically rely on geometry constraints and dense depth estimates to facilitate the learning, but often fail to fully exploit the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Liang Peng , Junkai Xu , Haoran Cheng , Zheng Yang , Xiaopei Wu , Wei Qian , Wenxiao Wang , Boxi Wu , Deng Cai

Incrementally recovering 3D dense structures from monocular videos is of paramount importance since it enables various robotics and AR applications. Feature volumes have recently been shown to enable efficient and accurate incremental dense…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Xingxing Zuo , Nan Yang , Nathaniel Merrill , Binbin Xu , Stefan Leutenegger

We study how autonomous robots can learn by themselves to improve their depth estimation capability. In particular, we investigate a self-supervised learning setup in which stereo vision depth estimates serve as targets for a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Diogo Martins , Kevin van Hecke , Guido de Croon

Monocular depth estimation plays a critical role in various computer vision and robotics applications such as localization, mapping, and 3D object detection. Recently, learning-based algorithms achieve huge success in depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Dongseok Shim , H. Jin Kim

Motivated by the astonishing capabilities of natural intelligent agents and inspired by theories from psychology, this paper explores the idea that perception gets coupled to 3D properties of the world via interaction with the environment.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Antonio Loquercio , Alexey Dosovitskiy , Davide Scaramuzza

Convolutional neural networks (CNN) have shown state-of-the-art results for low-level computer vision problems such as stereo and monocular disparity estimations, but still, have much room to further improve their performance in terms of…

Image and Video Processing · Electrical Eng. & Systems 2019-03-22 Juan Luis Gonzalez Bello , Munchurl Kim

Dense and accurate 3D mapping from a monocular sequence is a key technology for several applications and still an open research area. This paper leverages recent results on single-view CNN-based depth estimation and fuses them with…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 José M. Fácil , Alejo Concha , Luis Montesano , Javier Civera

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn

Inferring the depth of images is a fundamental inverse problem within the field of Computer Vision since depth information is obtained through 2D images, which can be generated from infinite possibilities of observed real scenes. Benefiting…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Raul de Queiroz Mendes , Eduardo Godinho Ribeiro , Nicolas dos Santos Rosa , Valdir Grassi

Accurate monocular metric depth estimation (MMDE) is crucial to solving downstream tasks in 3D perception and modeling. However, the remarkable accuracy of recent MMDE methods is confined to their training domains. These methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Luigi Piccinelli , Yung-Hsu Yang , Christos Sakaridis , Mattia Segu , Siyuan Li , Luc Van Gool , Fisher Yu

Monocular multi-object detection and localization in 3D space has been proven to be a challenging task. The MoNet3D algorithm is a novel and effective framework that can predict the 3D position of each object in a monocular image and draw a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xichuan Zhou , Yicong Peng , Chunqiao Long , Fengbo Ren , Cong Shi

In this work we present a self-supervised learning framework to simultaneously train two Convolutional Neural Networks (CNNs) to predict depth and surface normals from a single image. In contrast to most existing frameworks which represent…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Huangying Zhan , Chamara Saroj Weerasekera , Ravi Garg , Ian Reid

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

Dense depth estimation from a single image is a key problem in computer vision, with exciting applications in a multitude of robotic tasks. Initially viewed as a direct regression problem, requiring annotated labels as supervision at…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Vitor Guizilini , Jie Li , Rares Ambrus , Sudeep Pillai , Adrien Gaidon

In this work we present FreDSNet, a deep learning solution which obtains semantic 3D understanding of indoor environments from single panoramas. Omnidirectional images reveal task-specific advantages when addressing scene understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Bruno Berenguel-Baeta , Jesus Bermudez-Cameo , Jose J. Guerrero

Monocular Depth Estimation (MDE) enables spatial understanding, 3D reconstruction, and autonomous navigation, yet deep learning approaches often predict only relative depth without a consistent metric scale. This limitation reduces…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Jiuling Zhang

3D reconstruction from a single image is a key problem in multiple applications ranging from robotic manipulation to augmented reality. Prior methods have tackled this problem through generative models which predict 3D reconstructions as…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Andrey Kurenkov , Jingwei Ji , Animesh Garg , Viraj Mehta , JunYoung Gwak , Christopher Choy , Silvio Savarese