English
Related papers

Related papers: Concurrent Segmentation and Localization for Track…

200 papers

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

State-of-the-art research of traditional computer vision is increasingly leveraged in the surgical domain. A particular focus in computer-assisted surgery is to replace marker-based tracking systems for instrument localization with pure…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Jonas Hein , Nicola Cavalcanti , Daniel Suter , Lukas Zingg , Fabio Carrillo , Lilian Calvet , Mazda Farshad , Marc Pollefeys , Nassir Navab , Philipp Fürnstahl

Surgical instrument segmentation is recognised as a key enabler in providing advanced surgical assistance and improving computer-assisted interventions. In this work, we propose SegMatch, a semi-supervised learning method to reduce the need…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Meng Wei , Charlie Budd , Luis C. Garcia-Peraza-Herrera , Reuben Dorent , Miaojing Shi , Tom Vercauteren

Landmark Localization plays a very important role in processing medical images as well as in disease identification. However, In medical field, it's a challenging task because of the complexity of medical images and the high requirement of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Wanhong Huang , Chunxi Yang , TianHong Hou

Accurate segmentation of thin structures is critical for microsurgical scene understanding but remains challenging due to resolution loss, low contrast, and class imbalance. We propose Microsurgery Instrument Segmentation for Robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tae Kyeong Jeong , Garam Kim , Juyoun Park

Semantic segmentation of medical images with deep learning models is rapidly developed. In this study, we benchmarked state-of-the-art deep learning segmentation algorithms on our clinical stereotactic radiosurgery dataset, demonstrating…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Siang-Ruei Wu , Hao-Yun Chang , Florence T Su , Heng-Chun Liao , Wanju Tseng , Chun-Chih Liao , Feipei Lai , Feng-Ming Hsu , Furen Xiao

Medical instrument segmentation in 3D ultrasound is essential for image-guided intervention. However, to train a successful deep neural network for instrument segmentation, a large number of labeled images are required, which is expensive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Hongxu Yang , Caifeng Shan , R. Arthur Bouwman , Lukas R. C. Dekker , Alexander F. Kolen , Peter H. N. de With

Surgical instrument pose estimation provides crucial information for promising applications, including autonomous robotic surgery, skill assessment, and standardization of surgical workflow. However, this task remains highly challenging due…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Daiyun Shen , Shuojue Yang , Chang Han Low , Qian Li , Mengya Xu , Qi Dou , Yueming Jin

Data diversity and volume are crucial to the success of training deep learning models, while in the medical imaging field, the difficulty and cost of data collection and annotation are especially huge. Specifically in robotic surgery, data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 An Wang , Mobarakol Islam , Mengya Xu , Hongliang Ren

Surgical instrument segmentation is instrumental to minimally invasive surgeries and related applications. Most previous methods formulate this task as single-frame-based instance segmentation while ignoring the natural temporal and stereo…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Qiyuan Wang , Shang Zhao , Zikang Xu , S Kevin Zhou

In this paper a deep learning architecture is presented that can, in real time, detect the 2D locations of certain landmarks of physical tools, such as a hammer or screwdriver. To avoid the labor of manual labeling, the network is trained…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Bram Vanherle , Jeroen Put , Nick Michiels , Frank Van Reeth

Precisely locating and segmenting medical instruments in images of minimally invasive surgeries, medical instrument segmentation, is an essential first step for several tasks in medical image processing. However, image degradations, small…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Christian Wilms , Alexander Michael Gerlach , Rüdiger Schmitz , Simone Frintrop

Instance segmentation of surgical instruments is a long-standing research problem, crucial for the development of many applications for computer-assisted surgery. This problem is commonly tackled via fully-supervised training of deep…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Forecasting surgical instrument trajectories and predicting the next surgical action recently started to attract attention from the research community. Both these tasks are crucial for automation and assistance in endoscopy surgery. Given…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Sara Sangalli , Gary Sarwin , Ertunc Erdil , Alessandro Carretta , Victor Staartjes , Carlo Serra , Ender Konukoglu

Recorded videos from surgeries have become an increasingly important information source for the field of medical endoscopy, since the recorded footage shows every single detail of the surgery. However, while video recording is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Sabrina Kletz , Klaus Schoeffmann , Jenny Benois-Pineau , Heinrich Husslein

We study the task of semantic segmentation of surgical instruments in robotic-assisted surgery scenes. We propose the Instance-based Surgical Instrument Segmentation Network (ISINet), a method that addresses this task from an instance-based…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Cristina González , Laura Bravo-Sánchez , Pablo Arbelaez

Deep learning has led to state-of-the-art results for many medical imaging tasks, such as segmentation of different anatomical structures. With the increased numbers of deep learning publications and openly available code, the approach to…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Tom van Sonsbeek , Veronika Cheplygina

Purpose: Segmentation of surgical instruments in endoscopic videos is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Manish Sahu , Anirban Mukhopadhyay , Stefan Zachow

An accurate detection and tracking of devices such as guiding catheters in live X-ray image acquisitions is an essential prerequisite for endovascular cardiac interventions. This information is leveraged for procedural guidance, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Saahil Islam , Venkatesh N. Murthy , Dominik Neumann , Badhan Kumar Das , Puneet Sharma , Andreas Maier , Dorin Comaniciu , Florin C. Ghesu

Semantic image segmentation is one of fastest growing areas in computer vision with a variety of applications. In many areas, such as robotics and autonomous vehicles, semantic image segmentation is crucial, since it provides the necessary…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Georgios Takos