English
Related papers

Related papers: A geometry-aware deep network for depth estimation…

200 papers

Deep learning techniques hold promise to develop dense topography reconstruction and pose estimation methods for endoscopic videos. However, currently available datasets do not support effective quantitative benchmarking. In this paper, we…

Depth estimation is a foundational component for 3D reconstruction in minimally invasive endoscopic surgeries. However, existing monocular depth estimation techniques often exhibit limited performance to the varying illumination and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinning Yao , Bo Liu , Bojian Li , Jingjing Wang , Jinghua Yue , Fugen Zhou

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Objective: Depth estimation is crucial for endoscopic navigation and manipulation, but obtaining ground-truth depth maps in real clinical scenarios, such as the colon, is challenging. This study aims to develop a robust framework that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sijia Du , Chengfeng Zhou , Suncheng Xiang , Jianwei Xu , Dahong Qian

Depth estimation is a cornerstone of 3D reconstruction and plays a vital role in minimally invasive endoscopic surgeries. However, most current depth estimation networks rely on traditional convolutional neural networks, which are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Bojian Li , Bo Liu , Xinning Yao , Jinghua Yue , Fugen Zhou

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Purpose: Monocular depth estimation (MDE) is vital for scene understanding in minimally invasive surgery (MIS). However, endoscopic video sequences are often contaminated by smoke, specular reflections, blur, and occlusions, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Muhammad Asad , Emanuele Colleoni , Pritesh Mehta , Nicolas Toussaint , Ricardo Sanchez-Matilla , Maria Robu , Faisal Bashir , Rahim Mohammadi , Imanol Luengo , Danail Stoyanov

Depth estimation is a challenging task of 3D reconstruction to enhance the accuracy sensing of environment awareness. This work brings a new solution with a set of improvements, which increase the quantitative and qualitative understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Armin Masoumian , Hatem A. Rashwan , Saddam Abdulwahab , Julian Cristiano , Domenec Puig

Video depth estimation is crucial in various applications, such as scene reconstruction and augmented reality. In contrast to the naive method of estimating depths from images, a more sophisticated approach uses temporal information,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Elena Kosheleva , Sunil Jaiswal , Faranak Shamsafar , Noshaba Cheema , Klaus Illgner-Fehns , Philipp Slusallek

Geometric estimation including depth estimation and scene reconstruction is a crucial technique for colonoscopy which can provide surgeons with 3D spatial perception and navigation. However, geometric ground truth in colonoscopy is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Liangjing Shao , Beilei Cui , Hongliang Ren

We present an algorithm for reconstructing dense, geometrically consistent depth for all pixels in a monocular video. We leverage a conventional structure-from-motion reconstruction to establish geometric constraints on pixels in the video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuan Luo , Jia-Bin Huang , Richard Szeliski , Kevin Matzen , Johannes Kopf

Monocular depth estimation can play an important role in addressing the issue of deriving scene geometry from 2D images. It has been used in a variety of industries, including robots, self-driving cars, scene comprehension, 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ruilin Ma , Shiyao Chen , Qin Zhang

Visual simultaneous localization and mapping (V-SLAM) is a fundamental capability for autonomous perception and navigation. However, endoscopic scenes violate the rigidity assumption due to persistent soft-tissue deformations, creating a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Jiwei Shan , Zeyu Cai , Yirui Li , Yongbo Chen , Lijun Han , Yun-hui Liu , Hesheng Wang , Shing Shin Cheng

Colorectal cancer is the third most common cause of cancer death worldwide. Optical colonoscopy is the gold standard for detecting colorectal cancer; however, about 25 percent of polyps are missed during the procedure. A vision-based…

Image and Video Processing · Electrical Eng. & Systems 2023-01-20 Alwyn Mathew , Ludovic Magerand , Emanuele Trucco , Luigi Manfredi

Endoscopic depth estimation is a critical technology for improving the safety and precision of minimally invasive surgery. It has attracted considerable attention from researchers in medical imaging, computer vision, and robotics. Over the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Ke Niu , Zeyun Liu , Xue Feng , Heng Li , Qika Lin , Kaize Shi

Multi-map Sparse Monocular visual Simultaneous Localization and Mapping applied to monocular endoscopic sequences has proven efficient to robustly recover tracking after the frequent losses in endoscopy due to motion blur, temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 X. Anadón , Javier Rodríguez-Puigvert , J. M. M. Montiel

In this study, we address the challenge of 3D scene structure recovery from monocular depth estimation. While traditional depth estimation methods leverage labeled datasets to directly predict absolute depth, recent advancements advocate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chi Zhang , Wei Yin , Gang Yu , Zhibin Wang , Tao Chen , Bin Fu , Joey Tianyi Zhou , Chunhua Shen

In this study, we address the key challenges concerning the accuracy and effectiveness of depth estimation for endoscopic imaging, with a particular emphasis on real-time inference and the impact of light reflections. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Yangke Li

Generating accurate 3D reconstructions from endoscopic video is a promising avenue for longitudinal radiation-free analysis of sinus anatomy and surgical outcomes. Several methods for monocular reconstruction have been proposed, yielding…

Monocular depth estimation (MDE) provides a useful tool for robotic perception, but its predictions are often uncertain and inaccurate in challenging environments such as surgical scenes where textureless surfaces, specular reflections, and…