English
Related papers

Related papers: Phase-Informed Tool Segmentation for Manual Small-…

200 papers

Tool tracking in surgical videos is essential for advancing computer-assisted interventions, such as skill assessment, safety zone estimation, and human-machine collaboration. However, the lack of context-rich datasets limits AI…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Chinedu Innocent Nwoye , Kareem Elgohary , Anvita Srinivas , Fauzan Zaid , Joël L. Lavanchy , Nicolas Padoy

Advances in surgical video analysis are transforming operating rooms into intelligent, data-driven environments. Computer-assisted systems support full surgical workflow, from preoperative planning to intraoperative guidance and…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Sahar Nasirihaghighi

To meet the growing demand for systematic surgical training, wet-lab environments have become indispensable platforms for hands-on practice in ophthalmology. Yet, traditional wet-lab training depends heavily on manual performance…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Negin Ghamsarian , Raphael Sznitman , Klaus Schoeffmann , Jens Kowal

The growing popularity of robotic minimally invasive surgeries has made deep learning-based surgical training a key area of research. A thorough understanding of the surgical scene components is crucial, which semantic segmentation models…

Image and Video Processing · Electrical Eng. & Systems 2025-10-31 Muraam Abdel-Ghani , Mahmoud Ali , Mohamed Ali , Fatmaelzahraa Ahmed , Muhammad Arsalan , Abdulaziz Al-Ali , Shidin Balakrishnan

Robot-assisted surgeries rely on accurate and real-time scene understanding to safely guide surgical instruments. However, segmentation models trained on static datasets face key limitations when deployed in these dynamic and evolving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Julia Hindel , Ema Mekic , Enamundram Naga Karthik , Rohit Mohan , Daniele Cattaneo , Maria Kalweit , Abhinav Valada

Surgical scene segmentation is essential for anatomy and instrument localization which can be further used to assess tissue-instrument interactions during a surgical procedure. In 2017, the Challenge on Automatic Tool Annotation for…

Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on the availability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Annotation of medical images, such as MRI and CT scans, is crucial for evaluating treatment efficacy and planning radiotherapy. However, the extensive workload of medical professionals limits their ability to annotate large image datasets,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Eichi Takaya , Shinnosuke Yamamoto

Surgical tool segmentation in endoscopic images is the first step towards pose estimation and (sub-)task automation in challenging minimally invasive surgical operations. While many approaches in the literature have shown great results…

Robotics · Computer Science 2019-02-14 Cristian da Costa Rocha , Nicolas Padoy , Benoit Rosa

Globally, cataract is a common eye disease and one of the leading causes of blindness and vision impairment. The traditional process of detecting cataracts involves eye examination using a slit-lamp microscope or ophthalmoscope by an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Pavani Tripathi , Yasmeena Akhter , Mahapara Khurshid , Aditya Lakra , Rohit Keshari , Mayank Vatsa , Richa Singh

We propose Masked-Attention Transformers for Surgical Instrument Segmentation (MATIS), a two-stage, fully transformer-based method that leverages modern pixel-wise attention mechanisms for instrument segmentation. MATIS exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Nicolás Ayobi , Alejandra Pérez-Rondón , Santiago Rodríguez , Pablo Arbeláez

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

Image Segmentation plays an essential role in computer vision and image processing with various applications from medical diagnosis to autonomous car driving. A lot of segmentation algorithms have been proposed for addressing specific…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Yi Liu , Lutao Chu , Guowei Chen , Zewu Wu , Zeyu Chen , Baohua Lai , Yuying Hao

Purpose: Machine learning models can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes of interest. Surgical workflow and instrument recognition tasks are…

Machine Learning · Computer Science 2024-02-06 Georgii Kostiuchik , Lalith Sharan , Benedikt Mayer , Ivo Wolf , Bernhard Preim , Sandy Engelhardt

Ophthalmic microsurgery is known to be a challenging operation, which requires very precise and dexterous manipulation. Image guided robot-assisted surgery (RAS) is a promising solution that brings significant improvements in outcomes and…

This paper investigates the automatic monitoring of tool usage during a surgery, with potential applications in report generation, surgical training and real-time decision support. Two surgeries are considered: cataract surgery, the most…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Hassan Al Hajj , Mathieu Lamard , Pierre-Henri Conze , Béatrice Cochener , Gwenolé Quellec

Acute and chronic wounds with varying etiologies burden the healthcare systems economically. The advanced wound care market is estimated to reach $22 billion by 2024. Wound care professionals provide proper diagnosis and treatment with…

Image and Video Processing · Electrical Eng. & Systems 2022-01-04 Chuanbo Wang , Amirreza Mahbod , Isabella Ellinger , Adrian Galdran , Sandeep Gopalakrishnan , Jeffrey Niezgoda , Zeyun Yu

The automatic analysis of the surgical process, from videos recorded during surgeries, could be very useful to surgeons, both for training and for acquiring new techniques. The training process could be optimized by automatically providing…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Katia Charrière , Gwenolé Quellec , Mathieu Lamard , David Martiano , Guy Cazuguel , Gouenou Coatrieux , Béatrice Cochener

Minimally invasive surgery is a surgical intervention used to examine the organs inside the abdomen and has been widely used due to its effectiveness over open surgery. Due to the hardware improvements such as high definition cameras, this…

Image and Video Processing · Electrical Eng. & Systems 2021-08-04 Debesh Jha , Sharib Ali , Nikhil Kumar Tomar , Michael A. Riegler , Dag Johansen , Håvard D. Johansen , Pål Halvorsen

We present CataractSAM-2, a domain-adapted extension of Meta's Segment Anything Model 2, designed for real-time semantic segmentation of cataract ophthalmic surgery videos with high accuracy. Positioned at the intersection of computer…