English
Related papers

Related papers: Zero-shot Monocular Metric Depth for Endoscopic Im…

200 papers

Bokeh rendering and depth estimation share a fundamental optical connection, yet existing methods fail to fully exploit this reciprocity. Conventional bokeh pipelines rely heavily on noisy depth maps that inevitably introduce visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Hangwei Zhang , Armando Fortes , Tianyi Wei , Xingang Pan

We propose HYBRIDDEPTH, a robust depth estimation pipeline that addresses key challenges in depth estimation,including scale ambiguity, hardware heterogeneity, and generalizability. HYBRIDDEPTH leverages focal stack, data conveniently…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ashkan Ganj , Hang Su , Tian Guo

We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimation process including…

Image and Video Processing · Electrical Eng. & Systems 2022-01-13 Masahiro Oda , Hayato Itoh , Kiyohito Tanaka , Hirotsugu Takabatake , Masaki Mori , Hiroshi Natori , Kensaku Mori

Monocular depth estimation is critical for endoscopists to perform spatial perception and 3D navigation of surgical sites. However, most of the existing methods ignore the important geometric structural consistency, which inevitably leads…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yongming Yang , Shuwei Shao , Tao Yang , Peng Wang , Zhuo Yang , Chengdong Wu , Hao Liu

3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-guided surgery. A critical yet challenging step in this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Changhao Zhang , Matthew J. Clarkson , Mobarak I. Hoque

The recent development of \emph{foundation models} for monocular depth estimation such as Depth Anything paved the way to zero-shot monocular depth estimation. Since it returns an affine-invariant disparity map, the favored technique to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Rémi Marsal , Alexandre Chapoutot , Philippe Xu , David Filliat

Monocular depth estimation has improved significantly in recent years, driven by increasingly powerful models and large-scale training data. Predicted depth is increasingly used as an input signal for downstream tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Viktor Kocur , Sithu Aung , Gabrielle Flood , Yaqing Ding , Lukas Bujnak , Torsten Sattler , Zuzana Kukelova

Accurate monocular metric depth estimation (MMDE) is crucial to solving downstream tasks in 3D perception and modeling. However, the remarkable accuracy of recent MMDE methods is confined to their training domains. These methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Luigi Piccinelli , Christos Sakaridis , Yung-Hsu Yang , Mattia Segu , Siyuan Li , Wim Abbeloos , Luc Van Gool

Depth estimation is a crucial step for image-guided intervention in robotic surgery and laparoscopic imaging system. Since per-pixel depth ground truth is difficult to acquire for laparoscopic image data, it is rarely possible to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Baoru Huang , Jian-Qing Zheng , Anh Nguyen , Chi Xu , Ioannis Gkouzionis , Kunal Vyas , David Tuch , Stamatia Giannarou , Daniel S. Elson

Scene depth estimation from stereo and monocular imagery is critical for extracting 3D information for downstream tasks such as scene understanding. Recently, learning-based methods for depth estimation have received much attention due to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhaoshuo Li , Nathan Drenkow , Hao Ding , Andy S. Ding , Alexander Lu , Francis X. Creighton , Russell H. Taylor , Mathias Unberath

Monocular depth estimation (MDE) has widely applicable but remains highly challenging due to the inherently ill-posed nature of reconstructing 3D scenes from single 2D images. Modern Vision Foundation Models (VFMs), pre-trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Gongshu Wang , Zhirui Wang , Kan Yang

Low-overlap aerial imagery poses significant challenges to traditional photogrammetric methods, which rely heavily on high image overlap to produce accurate and complete mapping products. In this study, we propose a novel workflow based on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Jiageng Zhong , Qi Zhou , Ming Li , Armin Gruen , Xuan Liao

Monocular depth estimation is an ill-posed problem as the same 2D image can be projected from infinite 3D scenes. Although the leading algorithms in this field have reported significant improvement, they are essentially geared to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xiaodong Yang , Zhuang Ma , Zhiyu Ji , Zhe Ren

In this study, we address the key challenges concerning the accuracy and effectiveness of depth estimation for endoscopic imaging, with a particular emphasis on real-time inference and the impact of light reflections. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Yangke Li

We propose SharpDepth, a novel approach to monocular metric depth estimation that combines the metric accuracy of discriminative depth estimation methods (e.g., Metric3D, UniDepth) with the fine-grained boundary sharpness typically achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Duc-Hai Pham , Tung Do , Phong Nguyen , Binh-Son Hua , Khoi Nguyen , Rang Nguyen

Estimating depth from a single image is a challenging visual task. Compared to relative depth estimation, metric depth estimation attracts more attention due to its practical physical significance and critical applications in real-life…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Ruijie Zhu , Chuxin Wang , Ziyang Song , Li Liu , Tianzhu Zhang , Yongdong Zhang

Depth perception is crucial for spatial understanding and has traditionally been achieved through stereoscopic imaging. However, the precision of depth estimation using stereoscopic methods depends on the accurate calibration of binocular…

Robotics · Computer Science 2025-11-25 Muhamamd Ishfaq Hussain , Zubia Naz , Muhammad Aasim Rafique , Moongu Jeon

In recent years, the emergence of foundation models for depth prediction has led to remarkable progress, particularly in zero-shot monocular depth estimation. These models generate impressive depth predictions; however, their outputs are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Rizhao Fan , Tianfang Ma , Zhigen Li , Ning An , Jian Cheng

In endoscopic sinus surgery (ESS), intraoperative CT (iCT) offers valuable intraoperative assessment but is constrained by slow deployment and radiation exposure, limiting its clinical utility. Endoscope-based monocular 3D reconstruction is…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Pengcheng Chen , Wenhao Li , Nicole Gunderson , Jeremy Ruthberg , Randall Bly , Zhenglong Sun , Waleed M. Abuzeid , Eric J. Seibel

Depth perception is essential for a robot's spatial and geometric understanding of its environment, with many tasks traditionally relying on hardware-based depth sensors like RGB-D or stereo cameras. However, these sensors face practical…

Robotics · Computer Science 2025-08-01 Soofiyan Atar , Yuheng Zhi , Florian Richter , Michael Yip