English
Related papers

Related papers: Learning How To Robustly Estimate Camera Pose in E…

200 papers

Video depth estimation is crucial in various applications, such as scene reconstruction and augmented reality. In contrast to the naive method of estimating depths from images, a more sophisticated approach uses temporal information,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Elena Kosheleva , Sunil Jaiswal , Faranak Shamsafar , Noshaba Cheema , Klaus Illgner-Fehns , Philipp Slusallek

In this work, we investigate laparoscopic camera motion automation through imitation learning from retrospective videos of laparoscopic interventions. A novel method is introduced that learns to augment a surgeon's behavior in image space…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Martin Huber , Sebastien Ourselin , Christos Bergeles , Tom Vercauteren

Monocular depth estimation is critical for endoscopists to perform spatial perception and 3D navigation of surgical sites. However, most of the existing methods ignore the important geometric structural consistency, which inevitably leads…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yongming Yang , Shuwei Shao , Tao Yang , Peng Wang , Zhuo Yang , Chengdong Wu , Hao Liu

Recovering structure and motion parameters given a image pair or a sequence of images is a well studied problem in computer vision. This is often achieved by employing Structure from Motion (SfM) or Simultaneous Localization and Mapping…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Thanuja Dharmasiri , Andrew Spek , Tom Drummond

Accurate spatial understanding is essential for image-guided surgery, augmented reality integration and context awareness. In minimally invasive procedures, where visual input is the sole intraoperative modality, establishing precise…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Alberto Rota , Elena De Momi

State-of-the-art research of traditional computer vision is increasingly leveraged in the surgical domain. A particular focus in computer-assisted surgery is to replace marker-based tracking systems for instrument localization with pure…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Jonas Hein , Nicola Cavalcanti , Daniel Suter , Lukas Zingg , Fabio Carrillo , Lilian Calvet , Mazda Farshad , Marc Pollefeys , Nassir Navab , Philipp Fürnstahl

Depth estimation from monocular endoscopic images presents significant challenges due to the complexity of endoscopic surgery, such as irregular shapes of human soft tissues, as well as variations in lighting conditions. Existing methods…

Image and Video Processing · Electrical Eng. & Systems 2025-02-07 Dawei Lu , Deqiang Xiao , Danni Ai , Jingfan Fan , Tianyu Fu , Yucong Lin , Hong Song , Xujiong Ye , Lei Zhang , Jian Yang

Monocular depth estimation and ego-motion estimation are significant tasks for scene perception and navigation in stable, accurate and efficient robot-assisted endoscopy. To tackle lighting variations and sparse textures in endoscopic…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Liangjing Shao , Linxin Bai , Chenkang Du , Xinrong Chen

Robotic-assisted surgery allows surgeons to conduct precise surgical operations with stereo vision and flexible motor control. However, the lack of 3D spatial perception limits situational awareness during procedures and hinders mastering…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Shang Zhao , Ce Wang , Qiyuan Wang , Yanzhe Liu , S Kevin Zhou

3-D pose estimation of instruments is a crucial step towards automatic scene understanding in robotic minimally invasive surgery. Although robotic systems can potentially directly provide joint values, this information is not commonly…

Robotics · Computer Science 2021-03-02 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Accurate depth perception is crucial for patient outcomes in endoscopic surgery, yet it is compromised by image distortions common in surgical settings. To tackle this issue, our study presents a benchmark for assessing the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 An Wang , Haochen Yin , Beilei Cui , Mengya Xu , Hongliang Ren

Estimating a scene reconstruction and the camera motion from in-body videos is challenging due to several factors, e.g. the deformation of in-body cavities or the lack of texture. In this paper we present Endo-Depth-and-Motion, a pipeline…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 David Recasens , José Lamarca , José M. Fácil , J. M. M. Montiel , Javier Civera

Endoscopy is the most widely used imaging technique for the diagnosis of cancerous lesions in hollow organs. However, endoscopic images are often affected by illumination artefacts: image parts may be over- or underexposed according to the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Axel Garcia-Vega , Ricardo Espinosa , Luis Ramirez-Guzman , Thomas Bazin , Luis Falcon-Morales , Gilberto Ochoa-Ruiz , Dominique Lamarque , Christian Daul

Feature matching and finding correspondences between endoscopic images is a key step in many clinical applications such as patient follow-up and generation of panoramic image from clinical sequences for fast anomalies localization.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Manel Farhat , Houda Chaabouni-Chouayakh , Achraf Ben-Hamadou

Over the last two decades, deep learning has transformed the field of computer vision. Deep convolutional networks were successfully applied to learn different vision tasks such as image classification, image segmentation, object detection…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Yoli Shavit , Ron Ferens

Recent advances in deep pose estimation models have proven to be effective in a wide range of applications such as health monitoring, sports, animations, and robotics. However, pose estimation models fail to generalize when facing images…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Vandad Davoodnia , Saeed Ghorbani , Ali Etemad

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Keyang Zhou , Kailun Yang , Kaiwei Wang

Real-time dense scene reconstruction during unstable camera motions is crucial for robotics, yet current RGB-D SLAM systems fail when cameras experience large viewpoint changes, fast motions, or sudden shaking. Classical optimization-based…

Robotics · Computer Science 2026-03-04 Siyan Dong , Zijun Wang , Lulu Cai , Yi Ma , Yanchao Yang

Depth estimation is a crucial step for image-guided intervention in robotic surgery and laparoscopic imaging system. Since per-pixel depth ground truth is difficult to acquire for laparoscopic image data, it is rarely possible to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Baoru Huang , Jian-Qing Zheng , Anh Nguyen , Chi Xu , Ioannis Gkouzionis , Kunal Vyas , David Tuch , Stamatia Giannarou , Daniel S. Elson

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kailing Wang , Chen Yang , Yuehao Wang , Sikuang Li , Yan Wang , Qi Dou , Xiaokang Yang , Wei Shen