English
Related papers

Related papers: Zero-shot Monocular Metric Depth for Endoscopic Im…

200 papers

We formulate monocular depth estimation using denoising diffusion models, inspired by their recent successes in high fidelity image generation. To that end, we introduce innovations to address problems arising due to noisy, incomplete depth…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Saurabh Saxena , Abhishek Kar , Mohammad Norouzi , David J. Fleet

This work presents Depth Anything, a highly practical solution for robust monocular depth estimation. Without pursuing novel technical modules, we aim to build a simple yet powerful foundation model dealing with any images under any…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Lihe Yang , Bingyi Kang , Zilong Huang , Xiaogang Xu , Jiashi Feng , Hengshuang Zhao

Monocular depth estimation (MDE) for colonoscopy is hampered by the domain gap between simulated and real-world images. Existing image-to-image translation methods, which use depth as a posterior constraint, often produce structural…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Juan Yang , Yuyan Zhang , Han Jia , Bing Hu , Wanzhong Song

Endoscopy is the most widely used medical technique for cancer and polyp detection inside hollow organs. However, images acquired by an endoscope are frequently affected by illumination artefacts due to the enlightenment source orientation.…

Image and Video Processing · Electrical Eng. & Systems 2022-07-07 Axel Garcia-Vega , Ricardo Espinosa , Gilberto Ochoa-Ruiz , Thomas Bazin , Luis Eduardo Falcon-Morales , Dominique Lamarque , Christian Daul

While recent foundation models have enabled significant breakthroughs in monocular depth estimation, a clear path towards safe and reliable deployment in the real-world remains elusive. Metric depth estimation, which involves predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Steven Landgraf , Rongjun Qin , Markus Ulrich

Monocular depth estimation is a critical task for autonomous driving and many other computer vision applications. While significant progress has been made in this field, the effects of viewpoint shifts on depth estimation models remain…

It has long been an ill-posed problem to predict absolute depth maps from single images in real (unseen) indoor scenes. We observe that it is essentially due to not only the scale-ambiguous problem but also the focal-ambiguous problem that…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Chengrui Wei , Meng Yang , Lei He , Nanning Zheng

Reconstructing accurate 3D scenes from images is a long-standing vision task. Due to the ill-posedness of the single-image reconstruction problem, most well-established methods are built upon multi-view geometry. State-of-the-art (SOTA)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Wei Yin , Chi Zhang , Hao Chen , Zhipeng Cai , Gang Yu , Kaixuan Wang , Xiaozhi Chen , Chunhua Shen

While methods for monocular depth estimation have made significant strides on standard benchmarks, zero-shot metric depth estimation remains unsolved. Challenges include the joint modeling of indoor and outdoor scenes, which often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Saurabh Saxena , Junhwa Hur , Charles Herrmann , Deqing Sun , David J. Fleet

This work addresses the task of zero-shot monocular depth estimation. A recent advance in this field has been the idea of utilising Text-to-Image foundation models, such as Stable Diffusion. Foundation models provide a rich and generic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Denis Zavadski , Damjan Kalšan , Carsten Rother

Purpose: Surgical scene understanding plays a critical role in the technology stack of tomorrow's intervention-assisting systems in endoscopic surgeries. For this, tracking the endoscope pose is a key component, but remains challenging due…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Michel Hayoz , Christopher Hahne , Mathias Gallardo , Daniel Candinas , Thomas Kurmann , Maximilian Allan , Raphael Sznitman

Accurately estimating depth in 360-degree imagery is crucial for virtual reality, autonomous navigation, and immersive media applications. Existing depth estimation methods designed for perspective-view imagery fail when applied to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Ning-Hsu Wang , Yu-Lun Liu

Recent monocular foundation models excel at zero-shot depth estimation, yet their outputs are inherently relative rather than metric, limiting direct use in robotics and autonomous driving. We leverage the fact that relative depth preserves…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jaehyeon Cho , Jhonghyun An

Fisheye cameras are increasingly adopted in robotics for near-field manipulation, navigation, and immersive perception, yet indoor depth benchmarks with accurate ground truth are still missing. To address this, we introduce WideDepth - the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ilia Indyk , Ignat Penshin , Ivan Sosin , Maxim Monastyrny , Aleksei Valenkov , Ilya Makarov

Purpose: Monocular depth estimation (MDE) is vital for scene understanding in minimally invasive surgery (MIS). However, endoscopic video sequences are often contaminated by smoke, specular reflections, blur, and occlusions, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Muhammad Asad , Emanuele Colleoni , Pritesh Mehta , Nicolas Toussaint , Ricardo Sanchez-Matilla , Maria Robu , Faisal Bashir , Rahim Mohammadi , Imanol Luengo , Danail Stoyanov

Due to their text-to-image synthesis feature, diffusion models have recently seen a rise in visual perception tasks, such as depth estimation. The lack of good-quality datasets makes the extraction of a fine-grain semantic context…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Nischal Khanal , Shivanand Venkanna Sheshappanavar

Self-supervised monocular depth estimation (SSMDE) has gained attention in the field of deep learning as it estimates depth without requiring ground truth depth maps. This approach typically uses a photometric consistency loss between a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Wonhyeok Choi , Kyumin Hwang , Minwoo Choi , Kiljoon Han , Wonjoon Choi , Mingyu Shin , Sunghoon Im

Single-view depth estimation can be remarkably effective if there is enough ground-truth depth data for supervised training. However, there are scenarios, especially in medicine in the case of endoscopies, where such data cannot be…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Javier Rodríguez-Puigvert , Víctor M. Batlle , J. M. M. Montiel , Ruben Martinez-Cantin , Pascal Fua , Juan D. Tardós , Javier Civera

Monocular depth estimation is an important task with rapid progress, but how to evaluate it is not fully resolved, as evidenced by a lack of standardization in existing literature and a large selection of evaluation metrics whose trade-offs…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Siyang Wu , Jack Nugent , Willow Yang , Jia Deng

Monocular Depth Estimation (MDE) enables spatial understanding, 3D reconstruction, and autonomous navigation, yet deep learning approaches often predict only relative depth without a consistent metric scale. This limitation reduces…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Jiuling Zhang