English
Related papers

Related papers: Towards Unified Surgical Skill Assessment

200 papers

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

Surgical workflow anticipation is the task of predicting the timing of relevant surgical events from live video data, which is critical in Robotic-Assisted Surgery (RAS). Accurate predictions require the use of spatial information to model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Francis Xiatian Zhang , Jingjing Deng , Robert Lieck , Hubert P. H. Shum

Robotic-assisted surgery (RAS) is established in clinical practice, and automated surgical skill assessment utilizing multimodal data offers transformative potential for surgical analytics and education. However, developing effective…

Most existing robotic surgery systems adopt a human-in-the-loop paradigm, often with the surgeon directly teleoperating the robotic system. Adding intelligence to these robots would enable higher-level control, such as supervised autonomy…

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Proficiency in microanastomosis is a critical surgical skill in neurosurgery, where the ability to precisely manipulate fine instruments is crucial to successful outcomes. These procedures require sustained attention, coordinated hand…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yan Meng , Daniel Donoho , Marcelle Altshuler , Omar Arnaout

Purpose: The objective of this investigation is to provide a comprehensive analysis of state-of-the-art methods for video-based assessment of surgical skill in the operating room. Methods: Using a data set of 99 videos of capsulorhexis, a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Sanchit Hira , Digvijay Singh , Tae Soo Kim , Shobhit Gupta , Gregory Hager , Shameema Sikder , S. Swaroop Vedula

Automatic surgical gesture recognition is fundamental for improving intelligence in robot-assisted surgery, such as conducting complicated tasks of surgery surveillance and skill evaluation. However, current methods treat each frame…

Artificial Intelligence · Computer Science 2020-02-21 Xiaojie Gao , Yueming Jin , Qi Dou , Pheng-Ann Heng

Background Analyzing kinematic and video data can help identify potentially erroneous motions that lead to sub-optimal surgeon performance and safety-critical events in robot-assisted surgery. Methods We develop a rubric for identifying…

Robotics · Computer Science 2023-01-20 Kay Hutchinson , Zongyu Li , Leigh A. Cantrell , Noah S. Schenkman , Homa Alemzadeh

Reusable skills have become a core substrate for improving agent capabilities, yet most existing skill packages encode reusable behavior primarily as textual prompts, executable code, or learned routines. For visual agents, however,…

Artificial Intelligence · Computer Science 2026-05-15 Kangning Zhang , Shuai Shao , Qingyao Li , Jianghao Lin , Lingyue Fu , Shijian Wang , Wenxiang Jiao , Yuan Lu , Weiwen Liu , Weinan Zhang , Yong Yu

To ensure satisfactory clinical outcomes, surgical skill assessment must be objective, time-efficient, and preferentially automated - none of which is currently achievable. Video-based assessment (VBA) is being deployed in intraoperative…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Erim Yanik , Uwe Kruger , Xavier Intes , Rahul Rahul , Suvranu De

For workers, the exposure to on-site hazards can result in fatalities and serious injuries. To improve safety outcomes, different approaches have been implemented for health and safety training in the construction sector, such as…

Computers and Society · Computer Science 2018-08-08 Yifan Gao , Vicente Gonzalez , Tak Wing Yiu

Surgical skill assessment is paramount for ensuring patient safety and enhancing surgical outcomes. This study addresses the need for efficient and objective evaluation methods by introducing ZEAL (surgical skill assessment with Zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Satoshi Kondo

Motivated by the current demand of clinical governance, surgical simulation is now a well-established modality for basic skills training and assessment. The practical deployment of the technique is a multi-disciplinary venture encompassing…

Human-Computer Interaction · Computer Science 2020-05-08 Mohamed A. ElHelw

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chathura Wimalasiri

Previous work on surgical skill assessment using intraoperative tool motion in the operating room (OR) has focused on highly-structured surgical tasks such as cholecystectomy. Further, these methods only considered generic motion metrics…

Computer Vision and Pattern Recognition · Computer Science 2014-12-22 Piyush Poddar , Narges Ahmidi , S. Swaroop Vedula , Lisa Ishii , Gregory D. Hager , Masaru Ishii

Medical image analysis typically includes several tasks such as enhancement, segmentation, and classification. Traditionally, these tasks are implemented using separate deep learning models for separate tasks, which is not efficient because…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ghada Zamzmi , Sivaramakrishnan Rajaraman , Sameer Antani

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

Robotic assembly systems traditionally require substantial manual engineering effort to integrate new tasks, adapt to new environments, and improve performance over time. This paper presents a framework for autonomous integration and…

Robotics · Computer Science 2026-03-16 Peiqi Yu , Philip Huang , Chaitanya Chawla , Guanya Shi , Jiaoyang Li , Changliu Liu