English
Related papers

Related papers: Surgeons vs. Computer Vision: A comparative analys…

200 papers

Automatic surgical phase recognition is a challenging and crucial task with the potential to improve patient safety and become an integral part of intra-operative decision-support systems. In this paper, we propose, for the first time in…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Tobias Czempiel , Magdalini Paschali , Matthias Keicher , Walter Simson , Hubertus Feussner , Seong Tae Kim , Nassir Navab

Phase recognition plays an essential role for surgical workflow analysis in computer assisted intervention. Transformer, originally proposed for sequential data modeling in natural language processing, has been successfully applied to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Xiaoyang Zou , Wenyong Liu , Junchen Wang , Rong Tao , Guoyan Zheng

Laparoscopic surgery constrains surgeons spatial awareness because procedures are performed through a monocular, two-dimensional (2D) endoscopic view. Conventional training methods using dry-lab models or recorded videos provide limited…

Human-Computer Interaction · Computer Science 2025-11-05 Songyang Liu , Yunpeng Tan , Shuai Li

Robot planning in partially observable domains is difficult, because a robot needs to estimate the current state and plan actions at the same time. When the domain includes many objects, reasoning about the objects and their relationships…

Robotics · Computer Science 2022-02-22 Saeid Amiri , Kishan Chandan , Shiqi Zhang

Video understanding of robot-assisted surgery (RAS) videos is an active research area. Modeling the gestures and skill level of surgeons presents an interesting problem. The insights drawn may be applied in effective skill acquisition,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Duygu Sarikaya , Jason J. Corso , Khurshid A. Guru

Surgical robotics holds much promise for improving patient safety and clinician experience in the Operating Room (OR). However, it also comes with new challenges, requiring strong team coordination and effective OR management. Automatic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Idris Hamoud , Muhammad Abdullah Jamal , Vinkle Srivastav , Didier Mutter , Nicolas Padoy , Omid Mohareri

Advances in surgical video analysis are transforming operating rooms into intelligent, data-driven environments. Computer-assisted systems support full surgical workflow, from preoperative planning to intraoperative guidance and…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Sahar Nasirihaghighi

Recent Artificial Intelligence (AI) models have matched or exceeded human experts in several benchmarks of biomedical task performance, but surgical benchmarks in particular are often missing from prominent medical benchmark suites. Since…

Surgical phase recognition from video is a technology that automatically classifies the progress of a surgical procedure and has a wide range of potential applications, including real-time surgical support, optimization of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Satoshi Kondo

Most benchmarks for studying surgical interventions focus on a specific challenge instead of leveraging the intrinsic complementarity among different tasks. In this work, we present a new experimental framework towards holistic surgical…

A major obstacle to building models for effective semantic segmentation, and particularly video semantic segmentation, is a lack of large and well annotated datasets. This bottleneck is particularly prohibitive in highly specialized and…

Explainable Artificial Intelligence (AI) in the form of an interpretable and semiautomatic approach to stage grading ocular pathologies such as Diabetic retinopathy, Hypertensive retinopathy, and other retinopathies on the backdrop of major…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Ayushi Raj Bhatt , Rajkumar Vaghashiya , Meghna Kulkarni , Dr Prakash Kamaraj

During arthroscopic surgeries, surgeons are faced with challenges like cognitive re-projection of the 2D screen output into the 3D operating site or navigation through highly similar tissue. Training of these cognitive processes takes much…

Human-Computer Interaction · Computer Science 2021-06-14 Benedikt Hosp , Myat Su Yin , peter Haddawy , Ratthapoom Watcharporas , paphon Sa-ngasoonsong , Enkelejda Kasneci

Surgical workflow anticipation is the task of predicting the timing of relevant surgical events from live video data, which is critical in Robotic-Assisted Surgery (RAS). Accurate predictions require the use of spatial information to model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Francis Xiatian Zhang , Jingjing Deng , Robert Lieck , Hubert P. H. Shum

A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Roy Hirsch , Regev Cohen , Mathilde Caron , Tomer Golany , Daniel Freedman , Ehud Rivlin

Recent advancements in machine learning (ML) and deep learning (DL), particularly through the introduction of Foundation Models (FMs), have significantly enhanced surgical scene understanding within minimally invasive surgery (MIS). This…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ufaq Khan , Umair Nawaz , Adnan Qayyum , Shazad Ashraf , Yutong Xie , Muhammad Haris Khan , Muhammad Bilal , Junaid Qadir

Accurate surgical phase recognition is essential for analyzing procedural workflows, supporting intraoperative decision-making, and enabling data-driven improvements in surgical education and performance evaluation. In this work, we present…

Modern surgical systems increasingly rely on intelligent scene understanding to improve intra-operative safety and situational awareness, with surgical scene segmentation playing a fundamental role in fine-grained surgical perception.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shihao Zou , Jingjing Li , Wei Ji , Jincai Huang , Kai Wang , Guo Dan , Weixin Si , Yi Pan

Surgical phase recognition (SPR) is a crucial element in the digital transformation of the modern operating theater. While SPR based on video sources is well-established, incorporation of interventional X-ray sequences has not yet been…

Machine Learning · Computer Science 2023-04-20 Benjamin D. Killeen , Han Zhang , Jan Mangulabnan , Mehran Armand , Russel H. Taylor , Greg Osgood , Mathias Unberath

Online surgical phase recognition (SPR) underpins context-aware operating-room systems and requires committing to a prediction at every frame from past context alone. Surgical video poses three demands that natural-video recognizers do not…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Sukju Oh , Sukkyu Sun