English
Related papers

Related papers: SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tr…

200 papers

Computer-assisted surgery research requires large, deeply annotated video datasets that capture clinical and technical variability. Existing cataract surgery resources lack the diversity and annotation depth required to train generalizable…

This paper presents DriveTrack, a new benchmark and data generation framework for long-range keypoint tracking in real-world videos. DriveTrack is motivated by the observation that the accuracy of state-of-the-art trackers depends strongly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Arjun Balasingam , Joseph Chandler , Chenning Li , Zhoutong Zhang , Hari Balakrishnan

Surgical tool detection is a fundamental task for understanding egocentric open surgery videos. However, detecting surgical tools presents significant challenges due to their highly imbalanced class distribution, similar shapes and similar…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Ryo Fujii , Hideo Saito , Hiroki Kajita

Minimally invasive surgery can benefit significantly from automated surgical tool detection, enabling advanced analysis and assistance. However, the limited availability of annotated data in surgical settings poses a challenge for training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments to visualize relevant intraoperative information. In conventional systems, instruments are typically tracked using fiducial…

Human-Computer Interaction · Computer Science 2026-03-10 Jiaming Zhang , Mingxu Liu , Hongchao Shu , Ruixing Liang , Yihao Liu , Ojas Taskar , Amir Kheradmand , Mehran Armand , Alejandro Martin-Gomez

Accurate and stable field-of-view (FoV) guidance is critical for safe and efficient minimally invasive surgery, yet existing approaches often conflate visual attention estimation with downstream camera control or rely on direct…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Rulin Zhou , Guankun Wang , An Wang , Yujie Ma , Lixin Ouyang , Bolin Cui , Junyan Li , Chaowei Zhu , Mingyang Li , Ming Chen , Xiaopin Zhong , Peng Lu , Jiankun Wang , Xianming Liu , Hongliang Ren

This paper introduces the ``SurgT: Surgical Tracking" challenge which was organised in conjunction with MICCAI 2022. There were two purposes for the creation of this challenge: (1) the establishment of the first standardised benchmark for…

This paper investigates the automatic monitoring of tool usage during a surgery, with potential applications in report generation, surgical training and real-time decision support. Two surgeries are considered: cataract surgery, the most…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Hassan Al Hajj , Mathieu Lamard , Pierre-Henri Conze , Béatrice Cochener , Gwenolé Quellec

Inaccurate tool localization is one of the main reasons for failures in automating surgical tasks. Imprecise robot kinematics and noisy observations caused by the poor visual acuity of an endoscopic camera make tool tracking challenging.…

Robotics · Computer Science 2024-04-02 Nikhil U. Shinde , Zih-Yun Chiu , Florian Richter , Jason Lim , Yuheng Zhi , Sylvia Herbert , Michael C. Yip

Semantic tool segmentation in surgical videos is important for surgical scene understanding and computer-assisted interventions as well as for the development of robotic automation. The problem is challenging because different illumination…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Emanuele Colleoni , Philip Edwards , Danail Stoyanov

The goal of this study was to develop new reliable open surgery suturing simulation system for training medical students in situation where resources are limited or in the domestic setup. Namely, we developed an algorithm for tools and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Adam Goldbraikh , Anne-Lise D'Angelo , Carla M. Pugh , Shlomi Laufer

Tissue tracking plays a critical role in various surgical navigation and extended reality (XR) applications. While current methods trained on large synthetic datasets achieve high tracking accuracy and generalize well to endoscopic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Mert Asim Karaoglu , Wenbo Ji , Ahmed Abbas , Nassir Navab , Benjamin Busam , Alexander Ladikos

Accurate point tracking in surgical environments remains challenging due to complex visual conditions, including smoke occlusion, specular reflections, and tissue deformation. While existing surgical tracking datasets provide coordinate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Rulin Zhou , Wenlong He , An Wang , Jianhang Zhang , Xuanhui Zeng , Xi Zhang , Chaowei Zhu , Haijun Hu , Hongliang Ren

Automated analysis of volumetric medical imaging on edge devices is severely constrained by the high memory and computational demands of 3D Convolutional Neural Networks (CNNs). This paper develops a lightweight computer vision framework…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Amirreza Parvahan , Mohammad Hoseyni , Javad Khoramdel , Amirhossein Nikoofard

Purpose: Machine learning models can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes of interest. Surgical workflow and instrument recognition tasks are…

Machine Learning · Computer Science 2024-02-06 Georgii Kostiuchik , Lalith Sharan , Benedikt Mayer , Ivo Wolf , Bernhard Preim , Sandy Engelhardt

Automatic tool detection from surgical imagery has a multitude of useful applications, such as real-time computer assistance for the surgeon. Using the successful residual network architecture, a system that can distinguish 21 different…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Jonas Prellberg , Oliver Kramer

Surgical workflow analysis is of importance for understanding onset and persistence of surgical phases and individual tool usage across surgery and in each phase. It is beneficial for clinical quality control and to hospital administrators…

Image and Video Processing · Electrical Eng. & Systems 2019-05-28 Shanka Subhra Mondal , Rachana Sathish , Debdoot Sheet

The automatic summarization of surgical videos is essential for enhancing procedural documentation, supporting surgical training, and facilitating post-operative analysis. This paper presents a novel method at the intersection of artificial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hugo Georgenthum , Cristian Cosentino , Fabrizio Marozzo , Pietro Liò

Automated surgical workflow analysis and understanding can assist surgeons to standardize procedures and enhance post-surgical assessment and indexing, as well as, interventional monitoring. Computer-assisted interventional (CAI) systems…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Odysseas Zisimopoulos , Evangello Flouty , Imanol Luengo , Petros Giataganas , Jean Nehme , Andre Chow , Danail Stoyanov

Deep neural networks are rapidly emerging as data analysis tools, often outperforming the conventional techniques used in complex microfluidic systems. One fundamental analysis frequently desired in microfluidic experiments is counting and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Mihir Durve , Adriano Tiribocchi , Fabio Bonaccorso , Andrea Montessori , Marco Lauricella , Michal Bogdan , Jan Guzowski , Sauro Succi