English
Related papers

Related papers: Microsurgical Instrument Segmentation for Robot-As…

200 papers

Detection of surgical instruments plays a key role in ensuring patient safety in minimally invasive surgery. In this paper, we present a novel method for 2D vision-based recognition and pose estimation of surgical instruments that…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Thomas Kurmann , Pablo Marquez Neila , Xiaofei Du , Pascal Fua , Danail Stoyanov , Sebastian Wolf , Raphael Sznitman

This paper proposes a novel approach to few-shot semantic segmentation for machinery with multiple parts that exhibit spatial and hierarchical relationships. Our method integrates the foundation models CLIPSeg and Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Michael Schwingshackl , Fabio Francisco Oberweger , Markus Murschitz

Medical image segmentation remains challenging due to the vast diversity of anatomical structures, imaging modalities, and segmentation tasks. While deep learning has made significant advances, current approaches struggle to generalize as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yunhe Gao , Di Liu , Zhuowei Li , Yunsheng Li , Dongdong Chen , Mu Zhou , Dimitris N. Metaxas

Medical Image Segmentation (MIS) stands as a cornerstone in medical image analysis, playing a pivotal role in precise diagnostics, treatment planning, and monitoring of various medical conditions. This paper presents a comprehensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Ahmed Kabil , Ghada Khoriba , Mina Yousef , Essam A. Rashed

Performance measures are an important tool for assessing and comparing different medical image segmentation algorithms. Unfortunately, the current measures have their weaknesses when it comes to assessing certain edge cases. These…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Dennis Hartmann , Verena Schmid , Philip Meyer , Iñaki Soto-Rey , Dominik Müller , Frank Kramer

Interactive image segmentation enables annotators to efficiently perform pixel-level annotation for segmentation tasks. However, the existing interactive segmentation pipeline suffers from inefficient computations of interactive models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 You Huang , Hao Yang , Ke Sun , Shengchuan Zhang , Liujuan Cao , Guannan Jiang , Rongrong Ji

Holistic surgical scene segmentation in robot-assisted surgery (RAS) enables surgical residents to identify various anatomical tissues, articulated tools, and critical structures, such as veins and vessels. Given the firm intraoperative…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Fatimaelzahraa Ahmed , Muraam Abdel-Ghani , Muhammad Arsalan , Mahmoud Ali , Abdulaziz Al-Ali , Shidin Balakrishnan

Real-time instrument tracking is a crucial requirement for various computer-assisted interventions. In order to overcome problems such as specular reflections and motion blur, we propose a novel method that takes advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Iro Laina , Nicola Rieke , Christian Rupprecht , Josué Page Vizcaíno , Abouzar Eslami , Federico Tombari , Nassir Navab

Training a computer vision system to segment a novel class typically requires collecting and painstakingly annotating lots of images with objects from that class. Few-shot segmentation techniques reduce the required number of images to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shreyas Chandgothia , Ardhendu Sekhar , Amit Sethi

Surgical instrument segmentation is a key component in developing context-aware operating rooms. Existing works on this task heavily rely on the supervision of a large amount of labeled data, which involve laborious and expensive human…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Daochang Liu , Yuhui Wei , Tingting Jiang , Yizhou Wang , Rulin Miao , Fei Shan , Ziyu Li

Accurate tracking of tissues and instruments in videos is crucial for Robotic-Assisted Minimally Invasive Surgery (RAMIS), as it enables the robot to comprehend the surgical scene with precise locations and interactions of tissues and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Bohan Zhan , Wang Zhao , Yi Fang , Bo Du , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

Medical Referring Image Segmentation (MRIS) involves segmenting target regions in medical images based on natural language descriptions. While achieving promising results, recent approaches usually involve complex design of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Xinyu Chen , Yiran Wang , Gaoyang Pang , Jiafu Hao , Chentao Yue , Luping Zhou , Yonghui Li

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

Applying deep learning (DL) for annotating surgical instruments in robot-assisted minimally invasive surgeries (MIS) represents a significant advancement in surgical technology. This systematic review examines 48 studies that and advanced…

Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Zhe Wang , Chang Yao

Data diversity and volume are crucial to the success of training deep learning models, while in the medical imaging field, the difficulty and cost of data collection and annotation are especially huge. Specifically in robotic surgery, data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 An Wang , Mobarakol Islam , Mengya Xu , Hongliang Ren

Evaluating surgeon skill has predominantly been a subjective task. Development of objective methods for surgical skill assessment are of increased interest. Recently, with technological advances such as robotic-assisted minimally invasive…

Machine Learning · Computer Science 2016-11-18 Mahtab J. Fard , Sattar Ameri , Ratna B. Chinnam , Abhilash K. Pandya , Michael D. Klein , R. Darin Ellis

Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on the availability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoxiao Wu , Xiaowei Chen , Zhenguo Gao , Shulei Qu , Yuanyuan Qiu