English
Related papers

Related papers: Repurposing Marigold for Zero-Shot Metric Depth Es…

200 papers

In the field of monocular depth estimation (MDE), many models with excellent zero-shot performance in general scenes emerge recently. However, these methods often fail in predicting non-Lambertian surfaces, such as transparent or mirror…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Junrui Zhang , Jiaqi Li , Yachuan Huang , Yiran Wang , Jinghong Zheng , Liao Shen , Zhiguo Cao

Monocular depth estimation (MDE) typically produces depth estimations that are defined up to an unknown scale or shift. When only sparse metric anchors are available, recovering accurate metric depth becomes challenging yet necessary for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuanyan Li , Matthias Althoff

This paper presents a methodology to predict metric depth from monocular RGB images and an inertial measurement unit (IMU). To enable collision avoidance during autonomous flight, prior works either leverage heavy sensors (e.g., LiDARs or…

Robotics · Computer Science 2025-09-11 Steven Yang , Xiaoyu Tian , Kshitij Goel , Wennie Tabib

Monocular Depth Estimation (MDE) aims to predict pixel-wise depth given a single RGB image. For both, the convolutional as well as the recent attention-based models, encoder-decoder-based architectures have been found to be useful due to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ashutosh Agarwal , Chetan Arora

By training over large-scale datasets, zero-shot monocular depth estimation (MDE) methods show robust performance in the wild but often suffer from insufficient detail. Although recent diffusion-based MDE approaches exhibit a superior…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xiang Zhang , Bingxin Ke , Hayko Riemenschneider , Nando Metzger , Anton Obukhov , Markus Gross , Konrad Schindler , Christopher Schroers

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Existing methods for scale-invariant monocular depth estimation (SI MDE) often struggle due to the complexity of the task, and limited and non-diverse datasets, hindering generalizability in real-world scenarios. This is while…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 S. Mahdi H. Miangoleh , Mahesh Reddy , Yağız Aksoy

Dense depth estimation from a single image is a key problem in computer vision, with exciting applications in a multitude of robotic tasks. Initially viewed as a direct regression problem, requiring annotated labels as supervision at…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Vitor Guizilini , Jie Li , Rares Ambrus , Sudeep Pillai , Adrien Gaidon

Monocular depth estimation (MDE) has widely applicable but remains highly challenging due to the inherently ill-posed nature of reconstructing 3D scenes from single 2D images. Modern Vision Foundation Models (VFMs), pre-trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Gongshu Wang , Zhirui Wang , Kan Yang

We present a foundation model for zero-shot metric monocular depth estimation. Our model, Depth Pro, synthesizes high-resolution depth maps with unparalleled sharpness and high-frequency details. The predictions are metric, with absolute…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Aleksei Bochkovskii , Amaël Delaunoy , Hugo Germain , Marcel Santos , Yichao Zhou , Stephan R. Richter , Vladlen Koltun

While methods for monocular depth estimation have made significant strides on standard benchmarks, zero-shot metric depth estimation remains unsolved. Challenges include the joint modeling of indoor and outdoor scenes, which often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Saurabh Saxena , Junhwa Hur , Charles Herrmann , Deqing Sun , David J. Fleet

Accurate 6D object pose estimation is a prerequisite for successfully completing robotic prehensile and non-prehensile manipulation tasks. At present, 6D pose estimation for robotic manipulation generally relies on depth sensors based on,…

Robotics · Computer Science 2025-06-23 Teng Guo , Baichuan Huang , Jingjin Yu

Monocular depth estimation is a rudimentary task in robotic perception. Recently, with the development of more accurate and robust neural network models and different types of datasets, monocular depth estimation has significantly improved…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zhichao Zheng , Henry Williams , Bruce A MacDonald

We propose PureCLIP-Depth, a completely prompt-free, decoder-free Monocular Depth Estimation (MDE) model that operates entirely within the Contrastive Language-Image Pre-training (CLIP) embedding space. Unlike recent models that rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ryutaro Miya , Kazuyoshi Fushinobu , Tatsuya Kawaguchi

Recent advances in monocular depth estimation methods (MDE) and their improved accuracy open new possibilities for their applications. In this paper, we investigate how monocular depth estimates can be used for relative pose estimation. In…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yaqing Ding , Viktor Kocur , Václav Vávra , Zuzana Berger Haladová , Jian Yang , Torsten Sattler , Zuzana Kukelova

Self-supervised monocular depth estimation (SSMDE) has gained attention in the field of deep learning as it estimates depth without requiring ground truth depth maps. This approach typically uses a photometric consistency loss between a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Wonhyeok Choi , Kyumin Hwang , Minwoo Choi , Kiljoon Han , Wonjoon Choi , Mingyu Shin , Sunghoon Im

Reconstructing accurate 3D scenes from images is a long-standing vision task. Due to the ill-posedness of the single-image reconstruction problem, most well-established methods are built upon multi-view geometry. State-of-the-art (SOTA)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Wei Yin , Chi Zhang , Hao Chen , Zhipeng Cai , Gang Yu , Kaixuan Wang , Xiaozhi Chen , Chunhua Shen

Monocular depth estimation (MDE) has been widely adopted in the perception systems of autonomous vehicles and mobile robots. However, existing approaches often struggle to maintain temporal consistency in depth estimation across consecutive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Leezy Han , Seunggyu Kim , Dongseok Shim , Hyeonbeom Lee

Monocular Depth Estimation (MDE) is performed to produce 3D information that can be used in downstream tasks such as those related to on-board perception for Autonomous Vehicles (AVs) or driver assistance. Therefore, a relevant arising…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Akhil Gurram , Antonio M. Lopez

Monocular depth estimation (MDE) from thermal images is a crucial technology for robotic systems operating in challenging conditions such as fog, smoke, and low light. The limited availability of labeled thermal data constrains the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Xingxing Zuo , Nikhil Ranganathan , Connor Lee , Georgia Gkioxari , Soon-Jo Chung