English
Related papers

Related papers: Automatic Tool Landmark Detection for Stereo Visio…

200 papers

Automated data labeling techniques are crucial for accelerating the development of deep learning models, particularly in complex medical imaging applications. However, ensuring accuracy and efficiency remains challenging. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yu-Hsi Chen

Automated tracking of surgical tool keypoints in robotic surgery videos is an essential task for various downstream use cases such as skill assessment, expertise assessment, and the delineation of safety zones. In recent years, the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Bhargav Ghanekar , Lianne R. Johnson , Jacob L. Laughlin , Marcia K. O'Malley , Ashok Veeraraghavan

Surgical tool segmentation in endoscopic images is the first step towards pose estimation and (sub-)task automation in challenging minimally invasive surgical operations. While many approaches in the literature have shown great results…

Robotics · Computer Science 2019-02-14 Cristian da Costa Rocha , Nicolas Padoy , Benoit Rosa

Retinal surgery is a complex activity that can be challenging for a surgeon to perform effectively and safely. Image guided robot-assisted surgery is one of the promising solutions that bring significant surgical enhancement in treatment…

BACKGROUND AND OBJECTIVE: Patient positioning is a crucial step in radiation therapy, for which non-invasive methods have been developed based on surface reconstruction using optical 3D imaging. However, most solutions need expensive…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Hamid Sarmadi , Rafael Muñoz-Salinas , M. Álvaro Berbís , Antonio Luna , Rafael Medina-Carnicer

Surgical automation requires precise guidance and understanding of the scene. Current methods in the literature rely on bulky depth cameras to create maps of the anatomy, however this does not translate well to space-limited clinical…

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Purpose: Accurate detection and 6D pose estimation of surgical instruments are crucial for many computer-assisted interventions. However, supervised methods lack flexibility for new or unseen tools and require extensive annotated data. This…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jonas Hein , Lilian Calvet , Matthias Seibold , Siyu Tang , Marc Pollefeys , Philipp Fürnstahl

Detection of surgical instruments plays a key role in ensuring patient safety in minimally invasive surgery. In this paper, we present a novel method for 2D vision-based recognition and pose estimation of surgical instruments that…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Thomas Kurmann , Pablo Marquez Neila , Xiaofei Du , Pascal Fua , Danail Stoyanov , Sebastian Wolf , Raphael Sznitman

Positioning patients for scanning and interventional procedures is a critical task that requires high precision and accuracy. The conventional workflow involves manually adjusting the patient support to align the center of the target body…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhongpai Gao , Abhishek Sharma , Meng Zheng , Benjamin Planche , Terrence Chen , Ziyan Wu

Histological analysis plays a crucial role in understanding tissue structure and pathology. While recent advancements in registration methods have improved 2D histological analysis, they often struggle to preserve critical 3D spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Juming Xiong , Ruining Deng , Jialin Yue , Siqi Lu , Junlin Guo , Marilyn Lionts , Tianyuan Yao , Can Cui , Junchao Zhu , Chongyu Qu , Mengmeng Yin , Haichun Yang , Yuankai Huo

Robotic platforms provide consistent and precise tool positioning that significantly enhances retinal microsurgery. Integrating such systems with intraoperative optical coherence tomography (iOCT) enables image-guided robotic interventions,…

Video understanding of robot-assisted surgery (RAS) videos is an active research area. Modeling the gestures and skill level of surgeons presents an interesting problem. The insights drawn may be applied in effective skill acquisition,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Duygu Sarikaya , Jason J. Corso , Khurshid A. Guru

Real-time tool segmentation from endoscopic videos is an essential part of many computer-assisted robotic surgical systems and of critical importance in robotic surgical data science. We propose two novel deep learning architectures for…

Active stereo cameras that recover depth from structured light captures have become a cornerstone sensor modality for 3D scene reconstruction and understanding tasks across application domains. Existing active stereo cameras project a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Seung-Hwan Baek , Felix Heide

Endoluminal surgery offers a minimally invasive option for early-stage gastrointestinal and urinary tract cancers but is limited by surgical tools and a steep learning curve. Robotic systems, particularly continuum robots, provide flexible…

Achieving 3D spatial awareness is crucial for surgical robotic manipulation, where precise and delicate operations are required. Existing methods either explicitly reconstruct the surgical scene prior to manipulation, or enhance multi-view…

Robotics · Computer Science 2026-03-05 Yu Sheng , Lidian Wang , Xiaomeng Chu , Jiajun Deng , Min Cheng , Yanyong Zhang , Bei Hua , Houqiang Li , Jianmin Ji

This paper is focused on delivering a solution that can scan and reconstruct the 3D profile of a pipeline in real-time using a crawler robot. A structured infrared (IR) laser ring projector and a stereo camera system are used to generate…

Robotics · Computer Science 2019-07-30 Amal Gunatilake , Lasitha Piyathilaka , Sarath Kodagoda , Stephen Barclay , Dammika Vitanage

Real-time instrument tracking is a crucial requirement for various computer-assisted interventions. In order to overcome problems such as specular reflections and motion blur, we propose a novel method that takes advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Iro Laina , Nicola Rieke , Christian Rupprecht , Josué Page Vizcaíno , Abouzar Eslami , Federico Tombari , Nassir Navab

Vitreoretinal surgery is challenging even for expert surgeons owing to the delicate target tissues and the diminutive workspace in the retina. In addition to improved dexterity and accuracy, robot assistance allows for (partial) task…

Robotics · Computer Science 2022-04-29 Yuki Koyama , Murilo M. Marinho , Mamoru Mitsuishi , Kanako Harada