English
Related papers

Related papers: ToolTipNet: A Segmentation-Driven Deep Learning Ba…

200 papers

Adverse surgical outcomes are costly to patients and hospitals. Approaches to benchmark surgical care are often limited to gross measures across the entire procedure despite the performance of particular tasks being largely responsible for…

Computer Vision and Pattern Recognition · Computer Science 2018-06-04 Aneeq Zia , Andrew Hung , Irfan Essa , Anthony Jarc

Robot-assisted surgery has made great progress with the development of medical imaging and robotics technology. Medical scene understanding can greatly improve surgical performance while the semantic segmentation of the robotic instrument…

Robotics · Computer Science 2023-07-18 Yanjie Xia , Shaochen Wang , Zhen Kan

Accurate instrument pose estimation is a crucial step towards the future of robotic surgery, enabling applications such as autonomous surgical task execution. Vision-based methods for surgical instrument pose estimation provide a practical…

Minimally invasive surgery is a surgical intervention used to examine the organs inside the abdomen and has been widely used due to its effectiveness over open surgery. Due to the hardware improvements such as high definition cameras, this…

Image and Video Processing · Electrical Eng. & Systems 2021-08-04 Debesh Jha , Sharib Ali , Nikhil Kumar Tomar , Michael A. Riegler , Dag Johansen , Håvard D. Johansen , Pål Halvorsen

Robotic grasping, the ability of robots to reliably secure and manipulate objects of varying shapes, sizes and orientations, is a complex task that requires precise perception and control. Deep neural networks have shown remarkable success…

Robot pose estimation is a challenging and crucial task for vision-based surgical robotic automation. Typical robotic calibration approaches, however, are not applicable to surgical robots, such as the da Vinci Research Kit (dVRK), due to…

Robotics · Computer Science 2025-03-11 Zekai Liang , Zih-Yun Chiu , Florian Richter , Michael C. Yip

Accurate segmentation of thin structures is critical for microsurgical scene understanding but remains challenging due to resolution loss, low contrast, and class imbalance. We propose Microsurgery Instrument Segmentation for Robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tae Kyeong Jeong , Garam Kim , Juyoun Park

Real-time tool segmentation is an essential component in computer-assisted surgical systems. We propose a novel real-time automatic method based on Fully Convolutional Networks (FCN) and optical flow tracking. Our method exploits the…

Purpose: Accurate estimation of the position and orientation (pose) of surgical instruments is crucial for delicate minimally invasive temporal bone surgery. Current techniques lack in accuracy and/or line-of-sight constraints (conventional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 David Kügler , Jannik Sehring , Andrei Stefanov , Igor Stenin , Julia Kristin , Thomas Klenzner , Jörg Schipper , Anirban Mukhopadhyay

Recognition of individual components and keypoint detection supported by instance segmentation is crucial to analyze the behavior of agents on the scene. Such systems could be used for surveillance, self-driving cars, and also for medical…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 László Kopácsi , Áron Fóthi , András Lőrincz

Contactless fingerprint recognition systems offer a hygienic, user-friendly, and efficient alternative to traditional contact-based methods. However, their accuracy heavily relies on precise fingertip detection and segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Laurenz Ruzicka , Bernhard Kohn , Clemens Heitzinger

Precise instrument segmentation aid surgeons to navigate the body more easily and increase patient safety. While accurate tracking of surgical instruments in real-time plays a crucial role in minimally invasive computer-assisted surgeries,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Juan Carlos Angeles-Ceron , Gilberto Ochoa-Ruiz , Leonardo Chang , Sharib Ali

Robotic grasp should be carried out in a real-time manner by proper accuracy. Perception is the first and significant step in this procedure. This paper proposes an improved pipeline model trying to detect grasp as a rectangle…

Robotics · Computer Science 2024-03-12 Hamed Hosseini , Mehdi Tale Masouleh , Ahmad Kalhor

Accurate segmentation of surgical instruments in robotic-assisted surgery is critical for enabling context-aware computer-assisted interventions, such as tool tracking, workflow analysis, and autonomous decision-making. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Sara Ameli

Image segmentation plays an essential role in medicine for both diagnostic and interventional tasks. Segmentation approaches are either manual, semi-automated or fully-automated. Manual segmentation offers full control over the quality of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-21 Tomas Sakinis , Fausto Milletari , Holger Roth , Panagiotis Korfiatis , Petro Kostandy , Kenneth Philbrick , Zeynettin Akkus , Ziyue Xu , Daguang Xu , Bradley J. Erickson

Robot-assisted surgery has made significant progress, with instrument segmentation being a critical factor in surgical intervention quality. It serves as the building block to facilitate surgical robot navigation and surgical education for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hongqiu Wang , Lei Zhu , Guang Yang , Yike Guo , Shichen Zhang , Bo Xu , Yueming Jin

This work proves that semantic segmentation on minimally invasive surgical instruments can be improved by using training data that has been augmented through domain adaptation. The benefit of this method is twofold. Firstly, it suppresses…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Iñigo Azqueta-Gavaldon , Florian Fröhlich , Klaus Strobl , Rudolph Triebel

Segmentation of surgical instruments is crucial for enhancing surgeon performance and ensuring patient safety. Conventional techniques such as binary, semantic, and instance segmentation share a common drawback: they do not accommodate the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Ruohua Shi , Zhaochen Liu , Lingyu Duan , Tingting Jiang

Computer vision and robotics are being increasingly applied in medical interventions. Especially in interventions where extreme precision is required they could make a difference. One such application is robot-assisted retinal microsurgery.…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Thomas Probst , Kevis-Kokitsi Maninis , Ajad Chhatkuli , Mouloud Ourak , Emmanuel Vander Poorten , Luc Van Gool

Ultrasound-guided percutaneous needle insertion is a standard procedure employed in both biopsy and ablation in clinical practices. However, due to the complex interaction between tissue and instrument, the needle may deviate from the…