English
Related papers

Related papers: SurgPIS: Surgical-instrument-level Instances and P…

200 papers

Surgical instrument segmentation is recognised as a key enabler in providing advanced surgical assistance and improving computer-assisted interventions. In this work, we propose SegMatch, a semi-supervised learning method to reduce the need…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Meng Wei , Charlie Budd , Luis C. Garcia-Peraza-Herrera , Reuben Dorent , Miaojing Shi , Tom Vercauteren

Surgical image segmentation is essential for robot-assisted surgery and intraoperative guidance. However, existing methods are constrained to predefined categories, produce one-shot predictions without adaptive refinement, and lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ange Lou , Yamin Li , Qi Chang , Nan Xi , Luyuan Xie , Zichao Li , Tianyu Luan

Detection, tracking, and pose estimation of surgical instruments are crucial tasks for computer assistance during minimally invasive robotic surgery. In the majority of cases, the first step is the automatic segmentation of surgical tools.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Daniil Pakhomov , Vittal Premachandran , Max Allan , Mahdi Azizian , Nassir Navab

In this paper, we propose a novel text promptable surgical instrument segmentation approach to overcome challenges associated with diversity and differentiation of surgical instruments in minimally invasive surgeries. We redefine the task…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zijian Zhou , Oluwatosin Alabi , Meng Wei , Tom Vercauteren , Miaojing Shi

Recorded videos from surgeries have become an increasingly important information source for the field of medical endoscopy, since the recorded footage shows every single detail of the surgery. However, while video recording is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Sabrina Kletz , Klaus Schoeffmann , Jenny Benois-Pineau , Heinrich Husslein

Instance segmentation is a fundamental skill for many robotic applications. We propose a self-supervised method that uses grasp interactions to collect segmentation supervision for an instance segmentation model. When a robot grasps an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 YuXuan Liu , Xi Chen , Pieter Abbeel

Segmentation for tracking surgical instruments plays an important role in robot-assisted surgery. Segmentation of surgical instruments contributes to capturing accurate spatial information for tracking. In this paper, a novel network,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Zhen-Liang Ni , Gui-Bin Bian , Xiao-Liang Xie , Zeng-Guang Hou , Xiao-Hu Zhou , Yan-Jie Zhou

Surgical instrument segmentation is crucial in surgical scene understanding, thereby facilitating surgical safety. Existing algorithms directly detected all instruments of pre-defined categories in the input image, lacking the capability to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhen Chen , Zongming Zhang , Wenwu Guo , Xingjian Luo , Long Bai , Jinlin Wu , Hongliang Ren , Hongbin Liu

Surgical instrument segmentation -- in general a pixel classification task -- is fundamentally crucial for promoting cognitive intelligence in robot-assisted surgery (RAS). However, previous methods are struggling with discriminating…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Zixu Zhao , Yueming Jin , Pheng-Ann Heng

Localisation of surgical tools constitutes a foundational building block for computer-assisted interventional technologies. Works in this field typically focus on training deep learning models to perform segmentation tasks. Performance of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhe Han , Charlie Budd , Gongyu Zhang , Huanyu Tian , Christos Bergeles , Tom Vercauteren

Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Zhe Wang , Chang Yao

Semantic tool segmentation in surgical videos is important for surgical scene understanding and computer-assisted interventions as well as for the development of robotic automation. The problem is challenging because different illumination…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Emanuele Colleoni , Philip Edwards , Danail Stoyanov

Accurate segmentation of surgical instrument tip is an important task for enabling downstream applications in robotic surgery, such as surgical skill assessment, tool-tissue interaction and deformation modeling, as well as surgical…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jiaqi Liu , Yonghao Long , Kai Chen , Cheuk Hei Leung , Zerui Wang , Qi Dou

Precisely locating and segmenting medical instruments in images of minimally invasive surgeries, medical instrument segmentation, is an essential first step for several tasks in medical image processing. However, image degradations, small…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Christian Wilms , Alexander Michael Gerlach , Rüdiger Schmitz , Simone Frintrop

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang

Instance segmentation is essential for numerous computer vision applications, including robotics, human-computer interaction, and autonomous driving. Currently, popular models bring impressive performance in instance segmentation by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Cuong Manh Hoang

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

Traditionally, algorithms that learn to segment object instances in 2D images have heavily relied on large amounts of human-annotated data. Only recently, novel approaches have emerged tackling this problem in an unsupervised fashion.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Leon Sick , Dominik Engel , Sebastian Hartwig , Pedro Hermosilla , Timo Ropinski

Pseudo-labeling is significant for semi-supervised instance segmentation, which generates instance masks and classes from unannotated images for subsequent training. However, in existing pipelines, pseudo-labels that contain valuable…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Jie Hu , Chen Chen , Liujuan Cao , Shengchuan Zhang , Annan Shu , Guannan Jiang , Rongrong Ji