English
Related papers

Related papers: AVS-Net: Audio-Visual Scale Net for Self-supervise…

200 papers

Monocular visual odometry (VO) has attracted extensive research attention by providing real-time vehicle motion from cost-effective camera images. However, state-of-the-art optimization-based monocular VO methods suffer from the scale…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Sen Zhang , Jing Zhang , Dacheng Tao

Vision-based stair perception can help autonomous mobile robots deal with the challenge of climbing stairs, especially in unfamiliar environments. To address the problem that current monocular vision methods are difficult to model stairs…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Chen Wang , Zhongcai Pei , Shuang Qiu , Yachun Wang , Zhiyong Tang

Monocular depth prediction plays a crucial role in understanding 3D scene geometry. Although recent methods have achieved impressive progress in terms of evaluation metrics such as the pixel-wise relative error, most methods neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wei Yin , Yifan Liu , Chunhua Shen

We present an approach which takes advantage of both structure and semantics for unsupervised monocular learning of depth and ego-motion. More specifically, we model the motion of individual objects and learn their 3D motion vector jointly…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Relative-depth foundation models transfer well, yet monocular metric depth remains ill-posed due to unidentifiable global scale and heightened domain-shift sensitivity. Under a frozen-backbone calibration setting, we recover metric depth…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Mingxia Zhan , Li Zhang , Beibei Wang , Yingjie Wang , Zenglin Shi

Although depth extraction with passive sensors has seen remarkable improvement with deep learning, these approaches may fail to obtain correct depth if they are exposed to environments not observed during training. Online adaptation, where…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Muhammad Umar Karim Khan

Single-view depth estimation refers to the ability to derive three-dimensional information per pixel from a single two-dimensional image. Single-view depth estimation is an ill-posed problem because there are multiple depth solutions that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Javier Rodriguez-Puigvert

We introduce NimbleD, an efficient self-supervised monocular depth estimation learning framework that incorporates supervision from pseudo-labels generated by a large vision model. This framework does not require camera intrinsics, enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Albert Luginov , Muhammad Shahzad

Learning depth from a single image, as an important issue in scene understanding, has attracted a lot of attention in the past decade. The accuracy of the depth estimation has been improved from conditional Markov random fields,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Lei He , Guanghui Wang , Zhanyi Hu

Self-supervised monocular depth estimation has emerged as a promising method because it does not require groundtruth depth maps during training. As an alternative for the groundtruth depth map, the photometric loss enables to provide…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jaehoon Choi , Dongki Jung , Donghwan Lee , Changick Kim

Self-supervised monocular depth estimation has emerged as a promising approach since it does not rely on labeled training data. Most methods combine convolution and Transformer to model long-distance dependencies to estimate depth…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Xuezhi Xiang , Yao Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Motivated by the astonishing capabilities of natural intelligent agents and inspired by theories from psychology, this paper explores the idea that perception gets coupled to 3D properties of the world via interaction with the environment.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Antonio Loquercio , Alexey Dosovitskiy , Davide Scaramuzza

RGB-D tracking significantly improves the accuracy of object tracking. However, its dependency on real depth inputs and the complexity involved in multi-modal fusion limit its applicability across various scenarios. The utilization of depth…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenyu Wei , Yujie He , Zhanchuan Cai

Recent techniques in self-supervised monocular depth estimation are approaching the performance of supervised methods, but operate in low resolution only. We show that high resolution is key towards high-fidelity self-supervised monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Sudeep Pillai , Rares Ambrus , Adrien Gaidon

Inferring the depth of transparent or mirror (ToM) surfaces represents a hard challenge for either sensors, algorithms, or deep networks. We propose a simple pipeline for learning to estimate depth properly for such surfaces with neural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Alex Costanzino , Pierluigi Zama Ramirez , Matteo Poggi , Fabio Tosi , Stefano Mattoccia , Luigi Di Stefano

Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Dongseok Shim , H. Jin Kim

Neural networks have shown great success in extracting geometric information from color images. Especially, monocular depth estimation networks are increasingly reliable in real-world scenes. In this work we investigate the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Dominik Engel , Sebastian Hartwig , Timo Ropinski

We propose a method for metric-scale monocular depth estimation. Inferring depth from a single image is an ill-posed problem due to the loss of scale from perspective projection during the image formation process. Any scale chosen is a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziyao Zeng , Yangchao Wu , Hyoungseob Park , Daniel Wang , Fengyu Yang , Stefano Soatto , Dong Lao , Byung-Woo Hong , Alex Wong

Self-supervised depth estimation from monocular sequences relies on the joint learning of a depth and a pose network. Despite abundant research done to improve the depth network, efforts on the pose remain limited. In this context, even…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Changxuan Li , Nadine Berner , Nassir Navab , Federico Tombari , Stefano Gasperini

It is a classical compute vision problem to obtain real scene depth maps by using a monocular camera, which has been widely concerned in recent years. However, training this model usually requires a large number of artificially labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang