English
Related papers

Related papers: ORBSLAM-based Endoscope Tracking and 3D Reconstruc…

200 papers

Medical endoscopy remains a challenging application for simultaneous localization and mapping (SLAM) due to the sparsity of image features and size constraints that prevent direct depth-sensing. We present a SLAM approach that incorporates…

Image and Video Processing · Electrical Eng. & Systems 2019-07-02 Richard J. Chen , Taylor L. Bobrow , Thomas Athey , Faisal Mahmood , Nicholas J. Durr

SLAM systems are mainly applied for robot navigation while research on feasibility for motion planning with SLAM for tasks like bin-picking, is scarce. Accurate 3D reconstruction of objects and environments is important for planning motion…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Sergey Triputen , Atmaraaj Gopal , Thomas Weber , Christian Hofert , Kristiaan Schreve , Matthias Ratsch

Monocular depth estimation is critical for endoscopists to perform spatial perception and 3D navigation of surgical sites. However, most of the existing methods ignore the important geometric structural consistency, which inevitably leads…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yongming Yang , Shuwei Shao , Tao Yang , Peng Wang , Zhuo Yang , Chengdong Wu , Hao Liu

The assumption of scene rigidity is typical in SLAM algorithms. Such a strong assumption limits the use of most visual SLAM systems in populated real-world environments, which are the target of several relevant applications like service…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Berta Bescos , José M. Fácil , Javier Civera , José Neira

Endoscopic surgery relies on two-dimensional views, posing challenges for surgeons in depth perception and instrument manipulation. While Monocular Visual Simultaneous Localization and Mapping (MVSLAM) has emerged as a promising solution,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 G. Manni , C. Lauretti , F. Prata , R. Papalia , L. Zollo , P. Soda

Neural implicit representations have recently demonstrated compelling results on dense Simultaneous Localization And Mapping (SLAM) but suffer from the accumulation of errors in camera tracking and distortion in the reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Youmin Zhang , Fabio Tosi , Stefano Mattoccia , Matteo Poggi

Efficient three-dimensional reconstruction and real-time visualization are critical in surgical scenarios such as endoscopy. In recent years, 3D Gaussian Splatting (3DGS) has demonstrated remarkable performance in efficient 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Taoyu Wu , Yiyi Miao , Zhuoxiao Li , Haocheng Zhao , Kang Dang , Jionglong Su , Limin Yu , Haoang Li

Tracking of rotation and translation of medical instruments plays a substantial role in many modern interventions. Traditional external optical tracking systems are often subject to line-of-sight issues, in particular when the region of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Benjamin Busam , Patrick Ruhkamp , Salvatore Virga , Beatrice Lentes , Julia Rackerseder , Nassir Navab , Christoph Hennersperger

Monocular visual simultaneous localization and mapping (V-SLAM) is nowadays an irreplaceable tool in mobile robotics and augmented reality, where it performs robustly. However, human colonoscopies pose formidable challenges like occlusions,…

Robotics · Computer Science 2024-05-28 Richard Elvira , Juan D. Tardós , José M. M. Montiel

Various datasets have been proposed for simultaneous localization and mapping (SLAM) and related problems. Existing datasets often include small environments, have incomplete ground truth, or lack important sensor data, such as depth and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Janne Mustaniemi , Juho Kannala , Esa Rahtu , Li Liu , Janne Heikkilä

Multi-map Sparse Monocular visual Simultaneous Localization and Mapping applied to monocular endoscopic sequences has proven efficient to robustly recover tracking after the frequent losses in endoscopy due to motion blur, temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 X. Anadón , Javier Rodríguez-Puigvert , J. M. M. Montiel

This letter introduces a novel framework for dense Visual Simultaneous Localization and Mapping (VSLAM) based on Gaussian Splatting. Recently, SLAM based on Gaussian Splatting has shown promising results. However, in monocular scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Pengcheng Zhu , Yaoming Zhuang , Baoquan Chen , Li Li , Chengdong Wu , Zhanlin Liu

Reconstruction of the soft tissues in robotic surgery from endoscopic stereo videos is important for many applications such as intra-operative navigation and image-guided robotic surgery automation. Previous works on this task mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yuehao Wang , Yonghao Long , Siu Hin Fan , Qi Dou

Reconstructing deformable endoscopic tissues is crucial for achieving robot-assisted surgery. However, 3D Gaussian Splatting-based approaches encounter challenges in achieving consistent tissue surface reconstruction, while existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yangsen Chen , Hao Wang

Reconstructing soft tissues from stereo endoscope videos is an essential prerequisite for many medical applications. Previous methods struggle to produce high-quality geometry and appearance due to their inadequate representations of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ruyi Zha , Xuelian Cheng , Hongdong Li , Mehrtash Harandi , Zongyuan Ge

Most SLAM algorithms are based on the assumption that the scene is static. However, in practice, most scenes are dynamic which usually contains moving objects, these methods are not suitable. In this paper, we introduce DymSLAM, a dynamic…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Chenjie Wang , Bin Luo , Yun Zhang , Qing Zhao , Lu Yin , Wei Wang , Xin Su , Yajun Wang , Chengyuan Li

In this paper we present NR-SLAM, a novel non-rigid monocular SLAM system founded on the combination of a Dynamic Deformation Graph with a Visco-Elastic deformation model. The former enables our system to represent the dynamics of the…

Robotics · Computer Science 2023-08-09 Juan J. Gomez Rodriguez , J. M. M Montiel , Juan D. Tardos

Accurately perceiving an object's pose and shape is essential for precise grasping and manipulation. Compared to common vision-based methods, tactile sensing offers advantages in precision and immunity to occlusion when tracking and…

Robotics · Computer Science 2026-02-17 Hung-Jui Huang , Mohammad Amin Mirzaee , Michael Kaess , Wenzhen Yuan

3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-guided surgery. A critical yet challenging step in this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Changhao Zhang , Matthew J. Clarkson , Mobarak I. Hoque

Reconstructing deformable surgical scenes from endoscopic videos is challenging and clinically important. Recent state-of-the-art methods based on implicit neural representations or 3D Gaussian splatting have made notable progress. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Jiwei Shan , Zeyu Cai , Cheng-Tai Hsieh , Yirui Li , Hao Liu , Lijun Han , Hesheng Wang , Shing Shin Cheng