English
Related papers

Related papers: Identifying Surgical Instruments in Laparoscopy Us…

200 papers

Objective: To develop and validate a deep learning model for the identification of out-of-body images in endoscopic videos. Background: Surgical video analysis facilitates education and research. However, video recordings of endoscopic…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Joël L. Lavanchy , Armine Vardazaryan , Pietro Mascagni , AI4SafeChole Consortium , Didier Mutter , Nicolas Padoy

Introduction: Computer vision (CV) has had a transformative impact in biomedical fields such as radiology, dermatology, and pathology. Its real-world adoption in surgical applications, however, remains limited. We review the current…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Devanish N. Kamtam , Joseph B. Shrager , Satya Deepya Malla , Nicole Lin , Juan J. Cardona , Jake J. Kim , Clarence Hu

Recording surgery in operating rooms is an essential task for education and evaluation of medical treatment. However, recording the desired targets, such as the surgery field, surgical tools, or doctor's hands, is difficult because the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Ryo Hachiuma , Tomohiro Shimizu , Hideo Saito , Hiroki Kajita , Yoshifumi Takatsume

Accurate segmentation of surgical instrument tip is an important task for enabling downstream applications in robotic surgery, such as surgical skill assessment, tool-tissue interaction and deformation modeling, as well as surgical…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jiaqi Liu , Yonghao Long , Kai Chen , Cheuk Hei Leung , Zerui Wang , Qi Dou

Applying machine learning technologies, especially deep learning, into medical image segmentation is being widely studied because of its state-of-the-art performance and results. It can be a key step to provide a reliable basis for clinical…

Image and Video Processing · Electrical Eng. & Systems 2021-03-08 Ziyang Wang

Automated tracking of surgical tool keypoints in robotic surgery videos is an essential task for various downstream use cases such as skill assessment, expertise assessment, and the delineation of safety zones. In recent years, the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Bhargav Ghanekar , Lianne R. Johnson , Jacob L. Laughlin , Marcia K. O'Malley , Ashok Veeraraghavan

Instance segmentation is a fundamental skill for many robotic applications. We propose a self-supervised method that uses grasp interactions to collect segmentation supervision for an instance segmentation model. When a robot grasps an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 YuXuan Liu , Xi Chen , Pieter Abbeel

During laparoscopic surgery, context-aware assistance systems aim to alleviate some of the difficulties the surgeon faces. To ensure that the right information is provided at the right time, the current phase of the intervention has to be…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Sebastian Bodenstedt , Antonia Ohnemus , Darko Katic , Anna-Laura Wekerle , Martin Wagner , Hannes Kenngott , Beat Müller-Stich , Rüdiger Dillmann , Stefanie Speidel

Videos are prominent learning materials to prepare surgical trainees before they enter the operating room (OR). In this work, we explore techniques to enrich the video-based surgery learning experience. We propose Surgment, a system that…

Human-Computer Interaction · Computer Science 2024-06-27 Jingying Wang , Haoran Tang , Taylor Kantor , Tandis Soltani , Vitaliy Popov , Xu Wang

Surgical instrument segmentation is crucial in surgical scene understanding, thereby facilitating surgical safety. Existing algorithms directly detected all instruments of pre-defined categories in the input image, lacking the capability to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhen Chen , Zongming Zhang , Wenwu Guo , Xingjian Luo , Long Bai , Jinlin Wu , Hongliang Ren , Hongbin Liu

Robot-assisted surgery has made great progress with the development of medical imaging and robotics technology. Medical scene understanding can greatly improve surgical performance while the semantic segmentation of the robotic instrument…

Robotics · Computer Science 2023-07-18 Yanjie Xia , Shaochen Wang , Zhen Kan

The machine learning community has been overwhelmed by a plethora of deep learning based approaches. Many challenging computer vision tasks such as detection, localization, recognition and segmentation of objects in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Swarnendu Ghosh , Nibaran Das , Ishita Das , Ujjwal Maulik

Object detection or localization is an incremental step in progression from coarse to fine digital image inference. It not only provides the classes of the image objects, but also provides the location of the image objects which have been…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat

Image segmentation plays an essential role in medicine for both diagnostic and interventional tasks. Segmentation approaches are either manual, semi-automated or fully-automated. Manual segmentation offers full control over the quality of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-21 Tomas Sakinis , Fausto Milletari , Holger Roth , Panagiotis Korfiatis , Petro Kostandy , Kenneth Philbrick , Zeynettin Akkus , Ziyue Xu , Daguang Xu , Bradley J. Erickson

Localizing oneself during endoscopic procedures can be problematic due to the lack of distinguishable textures and landmarks, as well as difficulties due to the endoscopic device such as a limited field of view and challenging lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Gary Sarwin , Alessandro Carretta , Victor Staartjes , Matteo Zoli , Diego Mazzatenta , Luca Regli , Carlo Serra , Ender Konukoglu

SEGSRNet addresses the challenge of precisely identifying surgical instruments in low-resolution stereo endoscopic images, a common issue in medical imaging and robotic surgery. Our innovative framework enhances image clarity and…

Image and Video Processing · Electrical Eng. & Systems 2024-04-29 Mansoor Hayat , Supavadee Aramvith , Titipat Achakulvisut

Surgical instrument segmentation for robot-assisted surgery is needed for accurate instrument tracking and augmented reality overlays. Therefore, the topic has been the subject of a number of recent papers in the CAI community. Deep…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Megha Kalia , Tajwar Abrar Aleef , Nassir Navab , Septimiu E. Salcudean

Object detection and semantic segmentation are two main themes in object retrieval from high-resolution remote sensing images, which have recently achieved remarkable performance by surfing the wave of deep learning and, more notably,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Lichao Mou , Xiao Xiang Zhu

In minimally invasive surgery, surgical instrument localization is a crucial task for endoscopic videos, which enables various applications for improving surgical outcomes. However, annotating the instrument localization in endoscopic…

Image and Video Processing · Electrical Eng. & Systems 2024-06-24 Rongfeng Wei , Jinlin Wu , Xuexue Bai , Ming Feng , Zhen Lei , Hongbin Liu , Zhen Chen

Reliable recognition and localization of surgical instruments in endoscopic video recordings are foundational for a wide range of applications in computer- and robot-assisted minimally invasive surgery (RAMIS), including surgical training,…