English
Related papers

Related papers: Zero-shot Monocular Metric Depth for Endoscopic Im…

200 papers

Learning depth from a single image, as an important issue in scene understanding, has attracted a lot of attention in the past decade. The accuracy of the depth estimation has been improved from conditional Markov random fields,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Lei He , Guanghui Wang , Zhanyi Hu

In order to use the navigation system effectively, distance information sensors such as depth sensors are essential. Since depth sensors are difficult to use in endoscopy, many groups propose a method using convolutional neural networks. In…

Image and Video Processing · Electrical Eng. & Systems 2021-12-28 Bong Hyuk Jeong , Hang Keun Kim , Young Don Son

Endoscopic procedures are essential for diagnosing and treating internal diseases, and multi-modal large language models (MLLMs) are increasingly applied to assist in endoscopy analysis. However, current benchmarks are limited, as they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Shengyuan Liu , Boyun Zheng , Wenting Chen , Zhihao Peng , Zhenfei Yin , Jing Shao , Jiancong Hu , Yixuan Yuan

Depth estimation plays a pivotal role in advancing human-robot interactions, especially in indoor environments where accurate 3D scene reconstruction is essential for tasks like navigation and object handling. Monocular depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Siddiqui Muhammad Yasir , Hyunsik Ahn

Improved surgical skill is generally associated with improved patient outcomes, although assessment is subjective; labour-intensive; and requires domain specific expertise. Automated data driven metrics can alleviate these difficulties, as…

Modern cameras are equipped with a wide array of sensors that enable recording the geospatial context of an image. Taking advantage of this, we explore depth estimation under the assumption that the camera is geocalibrated, a problem we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Scott Workman , Hunter Blanton

In the field of monocular depth estimation (MDE), many models with excellent zero-shot performance in general scenes emerge recently. However, these methods often fail in predicting non-Lambertian surfaces, such as transparent or mirror…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Junrui Zhang , Jiaqi Li , Yachuan Huang , Yiran Wang , Jinghong Zheng , Liao Shen , Zhiguo Cao

Zero-shot depth estimation (DE) models exhibit strong generalization performance as they are trained on large-scale datasets. However, existing models struggle with high-resolution images due to the discrepancy in image resolutions of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Byeongjun Kwon , Munchurl Kim

Estimating the 3D world from 2D monocular images is a fundamental yet challenging task due to the labour-intensive nature of 3D annotations. To simplify label acquisition, this work proposes a novel approach that bridges 2D vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Sihao Lin , Daqi Liu , Ruochong Fu , Dongrui Liu , Andy Song , Hongwei Xie , Zhihui Li , Bing Wang , Xiaojun Chang

Endoscopes featuring a miniaturized design have significantly enhanced operational flexibility, portability, and diagnostic capability while substantially reducing the invasiveness of medical procedures. Recently, single-use endoscopes…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Yu Xing , Shishi Huang , Meng Lv , Guo Chen , Huailiang Wang , Lingzhi Sui

Monocular depth estimation in colonoscopy video aims to overcome the unusual lighting properties of the colonoscopic environment. One of the major challenges in this area is the domain gap between annotated but unrealistic synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Shuxian Wang , Akshay Paruchuri , Zhaoxi Zhang , Sarah McGill , Roni Sengupta

Depth estimation is a fundamental task in computer vision with diverse applications. Recent advancements in deep learning have led to powerful depth foundation models (DFMs), yet their evaluation remains challenging due to inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhenyu Li , Haotong Lin , Jiashi Feng , Peter Wonka , Bingyi Kang

We propose a method for metric-scale monocular depth estimation. Inferring depth from a single image is an ill-posed problem due to the loss of scale from perspective projection during the image formation process. Any scale chosen is a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziyao Zeng , Yangchao Wu , Hyoungseob Park , Daniel Wang , Fengyu Yang , Stefano Soatto , Dong Lao , Byung-Woo Hong , Alex Wong

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

The field of monocular depth estimation is continually evolving with the advent of numerous innovative models and extensions. However, research on monocular depth estimation methods specifically for underwater scenes remains limited,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wenxiang Gua , Lin Qia

Estimating a scene's depth to achieve collision avoidance against moving pedestrians is a crucial and fundamental problem in the robotic field. This paper proposes a novel, low complexity network architecture for fast and accurate human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shan An , Fangru Zhou , Mei Yang , Haogang Zhu , Changhong Fu , Konstantinos A. Tsintotas

Deep metric learning aims to learn features relying on the consistency or divergence of class labels. However, in monocular depth estimation, the absence of a natural definition of class poses challenges in the leveraging of deep metric…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chunpu Liu , Guanglei Yang , Wangmeng Zuo , Tianyi Zan

Despite their impressive performance in various surgical scene understanding tasks, deep learning-based methods are frequently hindered from deploying to real-world surgical applications for various causes. Particularly, data collection,…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 An Wang , Mobarakol Islam , Mengya Xu , Hongliang Ren

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Monocular depth inference is a fundamental problem for scene perception of robots. Specific robots may be equipped with a camera plus an optional depth sensor of any type and located in various scenes of different scales, whereas recent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Haotian Wang , Meng Yang , Nanning Zheng