English
Related papers

Related papers: ColonAdapter: Geometry Estimation Through Foundati…

200 papers

Accurate monocular depth estimation is critical in colonoscopy for lesion localization and navigation. Foundation models trained on natural images fail to generalize directly to colonoscopy. We identify the core issue not as a semantic gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaoxian Zhang , Minghai Shi , Lei Li

Three-dimensional (3D) scene understanding in colonoscopy presents significant challenges that necessitate automated methods for accurate depth estimation. However, existing depth estimation models for endoscopy struggle with temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Romain Hardy , Tyler Berzin , Pranav Rajpurkar

Visualizing colonoscopy is crucial for medical auxiliary diagnosis to prevent undetected polyps in areas that are not fully observed. Traditional feature-based and depth-based reconstruction approaches usually end up with undesirable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Zhenhua Wu , Yanlin Jin , Liangdong Qiu , Xiaoguang Han , Xiang Wan , Guanbin Li

One of the key elements of reconstructing a 3D mesh from a monocular video is generating every frame's depth map. However, in the application of colonoscopy video reconstruction, producing good-quality depth estimation is challenging.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Yubo Zhang , Jan-Michael Frahm , Samuel Ehrenstein , Sarah K. McGill , Julian G. Rosenman , Shuxian Wang , Stephen M. Pizer

Depth estimation is a foundational component for 3D reconstruction in minimally invasive endoscopic surgeries. However, existing monocular depth estimation techniques often exhibit limited performance to the varying illumination and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinning Yao , Bo Liu , Bojian Li , Jingjing Wang , Jinghua Yue , Fugen Zhou

Geometric estimation including depth estimation and scene reconstruction is a crucial technique for colonoscopy which can provide surgeons with 3D spatial perception and navigation. However, geometric ground truth in colonoscopy is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Liangjing Shao , Beilei Cui , Hongliang Ren

Scale-aware monocular depth estimation poses a significant challenge in computer-aided endoscopic navigation. However, existing depth estimation methods that do not consider the geometric priors struggle to learn the absolute scale from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Ruofeng Wei , Bin Li , Kai Chen , Yiyao Ma , Yunhui Liu , Qi Dou

Monocular depth estimation (MDE) for colonoscopy is hampered by the domain gap between simulated and real-world images. Existing image-to-image translation methods, which use depth as a posterior constraint, often produce structural…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Juan Yang , Yuyan Zhang , Han Jia , Bing Hu , Wanzhong Song

Reconstructing a 3D surface from colonoscopy video is challenging due to illumination and reflectivity variation in the video frame that can cause defective shape predictions. Aiming to overcome this challenge, we utilize the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Shuxian Wang , Yubo Zhang , Sarah K. McGill , Julian G. Rosenman , Jan-Michael Frahm , Soumyadip Sengupta , Stephen M. Pizer

Monocular depth estimation is critical for endoscopists to perform spatial perception and 3D navigation of surgical sites. However, most of the existing methods ignore the important geometric structural consistency, which inevitably leads…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yongming Yang , Shuwei Shao , Tao Yang , Peng Wang , Zhuo Yang , Chengdong Wu , Hao Liu

In this study, we address the challenge of 3D scene structure recovery from monocular depth estimation. While traditional depth estimation methods leverage labeled datasets to directly predict absolute depth, recent advancements advocate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chi Zhang , Wei Yin , Gang Yu , Zhibin Wang , Tao Chen , Bin Fu , Joey Tianyi Zhou , Chunhua Shen

Depth estimation is a cornerstone of 3D reconstruction and plays a vital role in minimally invasive endoscopic surgeries. However, most current depth estimation networks rely on traditional convolutional neural networks, which are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Bojian Li , Bo Liu , Xinning Yao , Jinghua Yue , Fugen Zhou

Depth estimation is a crucial step for image-guided intervention in robotic surgery and laparoscopic imaging system. Since per-pixel depth ground truth is difficult to acquire for laparoscopic image data, it is rarely possible to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Baoru Huang , Jian-Qing Zheng , Anh Nguyen , Chi Xu , Ioannis Gkouzionis , Kunal Vyas , David Tuch , Stamatia Giannarou , Daniel S. Elson

As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yinmin Zhang , Xinzhu Ma , Shuai Yi , Jun Hou , Zhihui Wang , Wanli Ouyang , Dan Xu

Geometric reconstruction and SLAM with endoscopic images have advanced significantly in recent years. In most medical fields, monocular endoscopes are employed, and the algorithms used are typically adaptations of those designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Raúl Iranzo , Víctor M. Batlle , Juan D. Tardós , José M. M. Montiel

Monocular depth estimation is an ill-posed problem as the same 2D image can be projected from infinite 3D scenes. Although the leading algorithms in this field have reported significant improvement, they are essentially geared to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xiaodong Yang , Zhuang Ma , Zhiyu Ji , Zhe Ren

3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-guided surgery. A critical yet challenging step in this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Changhao Zhang , Matthew J. Clarkson , Mobarak I. Hoque

Monocular depth estimation in colonoscopy video aims to overcome the unusual lighting properties of the colonoscopic environment. One of the major challenges in this area is the domain gap between annotated but unrealistic synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Shuxian Wang , Akshay Paruchuri , Zhaoxi Zhang , Sarah McGill , Roni Sengupta

Multi-view image diffusion models have significantly advanced open-domain 3D object generation. However, most existing models rely on 2D network architectures that lack inherent 3D biases, resulting in compromised geometric consistency. To…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Hansheng Chen , Bokui Shen , Yulin Liu , Ruoxi Shi , Linqi Zhou , Connor Z. Lin , Jiayuan Gu , Hao Su , Gordon Wetzstein , Leonidas Guibas

Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Victor M. Batlle , J. M. M. Montiel , Juan D. Tardos
‹ Prev 1 2 3 10 Next ›