English
Related papers

Related papers: CholecTrack20: A Multi-Perspective Tracking Datase…

200 papers

Surgical procedures are inherently complex and risky, requiring extensive expertise and constant focus to navigate evolving intraoperative scenes. Computer-assisted systems such as surgical visual question answering (VQA) offer promises for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Shi Li , Vinkle Srivastav , Nicolas Chanel , Saurav Sharma , Nabani Banik , Lorenzo Arboit , Kun Yuan , Pietro Mascagni , Nicolas Padoy

A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Roy Hirsch , Regev Cohen , Mathilde Caron , Tomer Golany , Daniel Freedman , Ehud Rivlin

Surgical tool detection is a fundamental task for understanding egocentric open surgery videos. However, detecting surgical tools presents significant challenges due to their highly imbalanced class distribution, similar shapes and similar…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Ryo Fujii , Hideo Saito , Hiroki Kajita

Purpose: Machine learning models can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes of interest. Surgical workflow and instrument recognition tasks are…

Machine Learning · Computer Science 2024-02-06 Georgii Kostiuchik , Lalith Sharan , Benedikt Mayer , Ivo Wolf , Bernhard Preim , Sandy Engelhardt

Indexing endoscopic surgical videos is vital in surgical data science, forming the basis for systematic retrospective analysis and clinical performance evaluation. Despite its significance, current video analytics rely on manual indexing, a…

Image-based tracking of medical instruments is an integral part of surgical data science applications. Previous research has addressed the tasks of detecting, segmenting and tracking medical instruments based on laparoscopic video data.…

Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments to visualize relevant intraoperative information. In conventional systems, instruments are typically tracked using fiducial…

Human-Computer Interaction · Computer Science 2026-03-10 Jiaming Zhang , Mingxu Liu , Hongchao Shu , Ruixing Liang , Yihao Liu , Ojas Taskar , Amir Kheradmand , Mehran Armand , Alejandro Martin-Gomez

Surgical phase recognition is a basic component for different context-aware applications in computer- and robot-assisted surgery. In recent years, several methods for automatic surgical phase recognition have been proposed, showing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Isabel Funke , Dominik Rivoir , Stefanie Speidel

Inaccurate tool localization is one of the main reasons for failures in automating surgical tasks. Imprecise robot kinematics and noisy observations caused by the poor visual acuity of an endoscopic camera make tool tracking challenging.…

Robotics · Computer Science 2024-04-02 Nikhil U. Shinde , Zih-Yun Chiu , Florian Richter , Jason Lim , Yuheng Zhi , Sylvia Herbert , Michael C. Yip

Trocar ports are camera-fixed, pseudo-static structures that can persistently occlude laparoscopic views and attract disproportionate feature points due to specular, textured surfaces. This makes ports particularly detrimental to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Shunsuke Kikuchi , Atsushi Kouno , Hiroki Matsuzaki

This paper presents DriveTrack, a new benchmark and data generation framework for long-range keypoint tracking in real-world videos. DriveTrack is motivated by the observation that the accuracy of state-of-the-art trackers depends strongly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Arjun Balasingam , Joseph Chandler , Chenning Li , Zhoutong Zhang , Hari Balakrishnan

Articulated hand pose tracking is an under-explored problem that carries the potential for use in an extensive number of applications, especially in the medical domain. With a robust and accurate tracking system on surgical videos, the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Nathan Louis , Luowei Zhou , Steven J. Yule , Roger D. Dias , Milisa Manojlovich , Francis D. Pagani , Donald S. Likosky , Jason J. Corso

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Minimally invasive image-guided surgery heavily relies on vision. Deep learning models for surgical video analysis could therefore support visual tasks such as assessing the critical view of safety (CVS) in laparoscopic cholecystectomy…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Pietro Mascagni , Deepak Alapatt , Alain Garcia , Nariaki Okamoto , Armine Vardazaryan , Guido Costamagna , Bernard Dallemagne , Nicolas Padoy

Accurate tissue point tracking in endoscopic videos is critical for robotic-assisted surgical navigation and scene understanding, but remains challenging due to complex deformations, instrument occlusion, and the scarcity of dense…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Rulin Zhou , Wenlong He , An Wang , Qiqi Yao , Haijun Hu , Jiankun Wang , Xi Zhang an Hongliang Ren

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

This paper introduces the ``SurgT: Surgical Tracking" challenge which was organised in conjunction with MICCAI 2022. There were two purposes for the creation of this challenge: (1) the establishment of the first standardised benchmark for…

Analyzing surgical workflow is crucial for surgical assistance robots to understand surgeries. With the understanding of the complete surgical workflow, the robots are able to assist the surgeons in intra-operative events, such as by giving…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Yutong Ban , Guy Rosman , Thomas Ward , Daniel Hashimoto , Taisei Kondo , Hidekazu Iwaki , Ozanan Meireles , Daniela Rus

This technical report provides a detailed overview of Endoscapes, a dataset of laparoscopic cholecystectomy (LC) videos with highly intricate annotations targeted at automated assessment of the Critical View of Safety (CVS). Endoscapes…

Computer-assisted minimally invasive surgery has great potential in benefiting modern operating theatres. The video data streamed from the endoscope provides rich information to support context-awareness for next-generation intelligent…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Ziyi Wang , Bo Lu , Yonghao Long , Fangxun Zhong , Tak-Hong Cheung , Qi Dou , Yunhui Liu