English
Related papers

Related papers: CroMo: Cross-Modal Learning for Monocular Depth Es…

200 papers

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

Self-supervised monocular depth estimation is a salient task for 3D scene understanding. Learned jointly with monocular ego-motion estimation, several methods have been proposed to predict accurate pixel-wise depth without using labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Hemang Chawla , Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jie Xiang , Yun Wang , Lifeng An , Haiyang Liu , Jian Liu

This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods encounter limitations…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yunze Liu , Changxi Chen , Zifan Wang , Li Yi

Unsupervised deep learning methods have shown promising performance for single-image depth estimation. Since most of these methods use binocular stereo pairs for self-supervision, the depth range is generally limited. Small-baseline stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Saad Imran , Muhammad Umar Karim Khan , Sikander Bin Mukarram , Chong-Min Kyung

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

Deep learning techniques have enabled rapid progress in monocular depth estimation, but their quality is limited by the ill-posed nature of the problem and the scarcity of high quality datasets. We estimate depth from a single camera by…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Rahul Garg , Neal Wadhwa , Sameer Ansari , Jonathan T. Barron

Self-supervised monocular depth estimation has gathered notable interest since it can liberate training from dependency on depth annotations. In monocular video training case, recent methods only conduct view synthesis between existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinfeng Liu , Lingtong Kong , Bo Li , Zerong Wang , Hong Gu , Jinwei Chen

The ability to predict depth from a single image - using recent advances in CNNs - is of increasing interest to the vision community. Unsupervised strategies to learning are particularly appealing as they can utilize much larger and varied…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Chaoyang Wang , Jose Miguel Buenaposada , Rui Zhu , Simon Lucey

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

A thermal camera can robustly capture thermal radiation images under harsh light conditions such as night scenes, tunnels, and disaster scenarios. However, despite this advantage, neither depth nor ego-motion estimation research for the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Ukcheol Shin , Kyunghyun Lee , Seokju Lee , In So Kweon

Monocular depth estimation aims at estimating a pixelwise depth map for a single image, which has wide applications in scene understanding and autonomous driving. Existing supervised and unsupervised methods face great challenges.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Xiaoyang Guo , Hongsheng Li , Shuai Yi , Jimmy Ren , Xiaogang Wang

Learning single image depth estimation model from monocular video sequence is a very challenging problem. In this paper, we propose a novel training loss which enables us to include more images for supervision during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhenwei Luo

Depth Estimation has wide reaching applications in the field of Computer vision such as target tracking, augmented reality, and self-driving cars. The goal of Monocular Depth Estimation is to predict the depth map, given a 2D monocular RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mayank Poddar , Akash Mishra , Mohit Kewlani , Haoyang Pei

Underwater monocular depth estimation serves as the foundation for tasks such as 3D reconstruction of underwater scenes. However, due to the influence of light and medium, the underwater environment undergoes a distinctive imaging process,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jian Wang , Jing Wang , Shenghui Rong , Bo He

Spatial scene understanding, including monocular depth estimation, is an important problem in various applications, such as robotics and autonomous driving. While improvements in unsupervised monocular depth estimation have potentially…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

In many fields, self-supervised learning solutions are rapidly evolving and filling the gap with supervised approaches. This fact occurs for depth estimation based on either monocular or stereo, with the latter often providing a valid…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Filippo Aleotti , Fabio Tosi , Li Zhang , Matteo Poggi , Stefano Mattoccia

Estimating depth from single RGB images and videos is of widespread interest due to its applications in many areas, including autonomous driving, 3D reconstruction, digital entertainment, and robotics. More than 500 deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Uchitha Rajapaksha , Ferdous Sohel , Hamid Laga , Dean Diepeveen , Mohammed Bennamoun

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Depth estimation from a single image represents a fascinating, yet challenging problem with countless applications. Recent works proved that this task could be learned without direct supervision from ground truth labels leveraging image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Fabio Tosi , Filippo Aleotti , Matteo Poggi , Stefano Mattoccia