English
Related papers

Related papers: EndoMUST: Monocular Depth Estimation for Robotic E…

200 papers

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Accurate endoscope pose estimation and 3D tissue surface reconstruction significantly enhances monocular minimally invasive surgical procedures by enabling accurate navigation and improved spatial awareness. However, monocular endoscope…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Muzammil Khan , Enzo Kerkhof , Matteo Fusaglia , Koert Kuhlmann , Theo Ruers , Françoise J. Siepel

In endoscopic sinus surgery (ESS), intraoperative CT (iCT) offers valuable intraoperative assessment but is constrained by slow deployment and radiation exposure, limiting its clinical utility. Endoscope-based monocular 3D reconstruction is…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Pengcheng Chen , Wenhao Li , Nicole Gunderson , Jeremy Ruthberg , Randall Bly , Zhenglong Sun , Waleed M. Abuzeid , Eric J. Seibel

Self-supervised monocular depth estimation (SSMDE) has gained attention in the field of deep learning as it estimates depth without requiring ground truth depth maps. This approach typically uses a photometric consistency loss between a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Wonhyeok Choi , Kyumin Hwang , Minwoo Choi , Kiljoon Han , Wonjoon Choi , Mingyu Shin , Sunghoon Im

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Depth estimation is a crucial step for image-guided intervention in robotic surgery and laparoscopic imaging system. Since per-pixel depth ground truth is difficult to acquire for laparoscopic image data, it is rarely possible to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Baoru Huang , Jian-Qing Zheng , Anh Nguyen , Chi Xu , Ioannis Gkouzionis , Kunal Vyas , David Tuch , Stamatia Giannarou , Daniel S. Elson

Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estimation explore the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Huangying Zhan , Ravi Garg , Chamara Saroj Weerasekera , Kejie Li , Harsh Agarwal , Ian Reid

Unsupervised depth completion and estimation methods are trained by minimizing reconstruction error. Block artifacts from resampling, intensity saturation, and occlusions are amongst the many undesirable by-products of common data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yangchao Wu , Tian Yu Liu , Hyoungseob Park , Stefano Soatto , Dong Lao , Alex Wong

Estimating depth from single RGB images and videos is of widespread interest due to its applications in many areas, including autonomous driving, 3D reconstruction, digital entertainment, and robotics. More than 500 deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Uchitha Rajapaksha , Ferdous Sohel , Hamid Laga , Dean Diepeveen , Mohammed Bennamoun

Metric depth estimation from visual sensors is crucial for robots to perceive, navigate, and interact with their environment. Traditional range imaging setups, such as stereo or structured light cameras, face hassles including calibration,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Blanca Lasheras-Hernandez , Klaus H. Strobl , Sergio Izquierdo , Tim Bodenmüller , Rudolph Triebel , Javier Civera

Self-supervised monocular depth estimation holds significant importance in the fields of autonomous driving and robotics. However, existing methods are typically trained and tested on standard datasets, overlooking the impact of various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziyang Song , Ruijie Zhu , Chuxin Wang , Jiacheng Deng , Jianfeng He , Tianzhu Zhang

Monocular depth estimation within the diffusion-denoising paradigm demonstrates impressive generalization ability but suffers from low inference speed. Recent methods adopt a single-step deterministic paradigm to improve inference…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Ziyang Song , Zerong Wang , Bo Li , Hao Zhang , Ruijie Zhu , Li Liu , Peng-Tao Jiang , Tianzhu Zhang

With the rapid advancements in autonomous driving and robot navigation, there is a growing demand for lifelong learning models capable of estimating metric (absolute) depth. Lifelong learning approaches potentially offer significant cost…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Junjie Hu , Chenyou Fan , Liguang Zhou , Qing Gao , Honghai Liu , Tin Lun Lam

Recently, learning-based robotic navigation systems have gained extensive research attention and made significant progress. However, the diversity of open-world scenarios poses a major challenge for the generalization of such systems to…

Robotics · Computer Science 2025-04-17 Xingwu Ji , Haochen Niu , Dexin Duan , Rendong Ying , Fei Wen , Peilin Liu

Monocular depth estimation can play an important role in addressing the issue of deriving scene geometry from 2D images. It has been used in a variety of industries, including robots, self-driving cars, scene comprehension, 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ruilin Ma , Shiyao Chen , Qin Zhang

Continuum robots are promising candidates for interactive tasks in medical and industrial applications due to their unique shape, compliance, and miniaturization capability. Accurate and real-time shape sensing is essential for such tasks…

In the last decade, numerous supervised deep learning approaches requiring large amounts of labeled data have been proposed for visual-inertial odometry (VIO) and depth map estimation. To overcome the data limitation, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Yasin Almalioglu , Mehmet Turan , Alp Eren Sari , Muhamad Risqi U. Saputra , Pedro P. B. de Gusmão , Andrew Markham , Niki Trigoni

Real-time ego-motion tracking for endoscope is a significant task for efficient navigation and robotic automation of endoscopy. In this paper, a novel framework is proposed to perform real-time ego-motion tracking for endoscope. Firstly, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Liangjing Shao , Benshuang Chen , Shuting Zhao , Xinrong Chen

Self-supervised monocular depth estimation has seen significant progress in recent years, especially in outdoor environments. However, depth prediction results are not satisfying in indoor scenes where most of the existing data are captured…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Runze Li , Pan Ji , Yi Xu , Bir Bhanu

Most geometric approaches to monocular Visual Odometry (VO) provide robust pose estimates, but sparse or semi-dense depth estimates. Off late, deep methods have shown good performance in generating dense depths and VO from monocular images…

Robotics · Computer Science 2018-12-21 Vignesh Prasad , Brojeshwar Bhowmick