English
Related papers

Related papers: ArthroPhase: A Novel Dataset and Method for Phase …

200 papers

Capitalizing on image-level pre-trained models for various downstream tasks has recently emerged with promising performance. However, the paradigm of "image pre-training followed by video fine-tuning" for high-dimensional video data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Shu Yang , Zhiyuan Cai , Luyang Luo , Ning Ma , Shuchang Xu , Hao Chen

Recognition of surgical activity is an essential component to develop context-aware decision support for the operating room. In this work, we tackle the recognition of fine-grained activities, modeled as action triplets <instrument, verb,…

Image and Video Processing · Electrical Eng. & Systems 2022-04-04 Chinedu Innocent Nwoye , Cristians Gonzalez , Tong Yu , Pietro Mascagni , Didier Mutter , Jacques Marescaux , Nicolas Padoy

Surgical phase recognition has become a crucial requirement in laparoscopic surgery, enabling various clinical applications like surgical risk forecasting. Current methods typically identify the surgical phase using individual frame-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Kaixiang Yang , Qiang Li , Zhiwei Wang

In minimally invasive surgery, surgical workflow segmentation from video analysis is a well studied topic. The conventional approach defines it as a multi-class classification problem, where individual video frames are attributed a surgical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yitong Zhang , Sophia Bano , Ann-Sophie Page , Jan Deprest , Danail Stoyanov , Francisco Vasconcelos

Purpose: Machine learning models can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes of interest. Surgical workflow and instrument recognition tasks are…

Machine Learning · Computer Science 2024-02-06 Georgii Kostiuchik , Lalith Sharan , Benedikt Mayer , Ivo Wolf , Bernhard Preim , Sandy Engelhardt

Surgical workflow analysis is essential in robot-assisted surgeries, yet the long duration of such procedures poses significant challenges for comprehensive video analysis. Recent approaches have predominantly relied on transformer models;…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Haoyang Wu , Tsun-Hsuan Wang , Mathias Lechner , Ramin Hasani , Jennifer A. Eckhoff , Paul Pak , Ozanan R. Meireles , Guy Rosman , Yutong Ban , Daniela Rus

Surgical tool presence detection and surgical phase recognition are two fundamental yet challenging tasks in surgical video analysis and also very essential components in various applications in modern operating rooms. While these two…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Yueming Jin , Huaxia Li , Qi Dou , Hao Chen , Jing Qin , Chi-Wing Fu , Pheng-Ann Heng

Advances in surgical video analysis are transforming operating rooms into intelligent, data-driven environments. Computer-assisted systems support full surgical workflow, from preoperative planning to intraoperative guidance and…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Sahar Nasirihaghighi

Real-time algorithms for automatically recognizing surgical phases are needed to develop systems that can provide assistance to surgeons, enable better management of operating room (OR) resources and consequently improve safety within the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Gaurav Yengera , Didier Mutter , Jacques Marescaux , Nicolas Padoy

This work presents a novel approach for the early recognition of the type of a laparoscopic surgery from its video. Early recognition algorithms can be beneficial to the development of 'smart' OR systems that can provide automatic…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Siddharth Kannan , Gaurav Yengera , Didier Mutter , Jacques Marescaux , Nicolas Padoy

Despite rapid commercialization of surgical robots, their autonomy and real-time decision-making remain limited in practice. To address this gap, we propose ArthroCut, an autonomous policy learning framework that upgrades knee arthroplasty…

Robotics · Computer Science 2026-03-05 Xu Lu , Yiling Zhang , Wenquan Cheng , Longfei Ma , Fang Chen , Hongen Liao

Most benchmarks for studying surgical interventions focus on a specific challenge instead of leveraging the intrinsic complementarity among different tasks. In this work, we present a new experimental framework towards holistic surgical…

Analyzing surgical workflow is crucial for surgical assistance robots to understand surgeries. With the understanding of the complete surgical workflow, the robots are able to assist the surgeons in intra-operative events, such as by giving…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Yutong Ban , Guy Rosman , Thomas Ward , Daniel Hashimoto , Taisei Kondo , Hidekazu Iwaki , Ozanan Meireles , Daniela Rus

Surgical workflow recognition has numerous potential medical applications, such as the automatic indexing of surgical video databases and the optimization of real-time operating room scheduling, among others. As a result, phase recognition…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Andru P. Twinanda , Sherif Shehata , Didier Mutter , Jacques Marescaux , Michel de Mathelin , Nicolas Padoy

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

Tissue awareness has a great demand to improve surgical accuracy in minimally invasive procedures. In arthroscopy, it is one of the challenging tasks due to surgical sites exhibit limited features and textures. Moreover, arthroscopic…

Image and Video Processing · Electrical Eng. & Systems 2024-09-04 Shahnewaz Ali , Ross Crawford , Frederic Maire , Assoc. Ajay K. Pandey

Anterior cruciate ligament (ACL) reconstruction necessitates months of rehabilitation, during which a clinician evaluates whether a patient is ready to return to sports or occupation. Due to their time- and cost-intensive nature, these…

Surgical phase recognition (SPR) is an integral component of surgical data science, enabling high-level surgical analysis. End-to-end trained neural networks that predict surgical phase directly from videos have shown excellent performance…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Hao Ding , Yuqian Zhang , Wenzheng Cheng , Xinyu Wang , Xu Lian , Chenhao Yu , Hongchao Shu , Ji Woong Kim , Axel Krieger , Mathias Unberath

Surgical workflow anticipation can give predictions on what steps to conduct or what instruments to use next, which is an essential part of the computer-assisted intervention system for surgery, e.g. workflow reasoning in robotic surgery.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Xiatian Zhang , Noura Al Moubayed , Hubert P. H. Shum