English
Related papers

Related papers: Towards Unified Surgical Skill Assessment

200 papers

The study proposes an advanced machine learning approach to predict spine surgery outcomes by incorporating oversampling techniques and grid search optimization. A variety of models including GaussianNB, ComplementNB, KNN, Decision Tree,…

Accurate vehicle trajectory prediction is essential for ensuring safety and efficiency in fully autonomous driving systems. While existing methods primarily focus on modeling observed motion patterns and interactions with other vehicles,…

Machine Learning · Computer Science 2025-07-15 Xinyi Ning , Zilin Bian , Dachuan Zuo , Semiha Ergan

Self-supervised, multi-modal learning has been successful in holistic representation of complex scenarios. This can be useful to consolidate information from multiple modalities which have multiple, versatile uses. Its application in…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Aniruddha Tamhane , Jie Ying Wu , Mathias Unberath

Assistive machines endow people with limited mobility the opportunity to live more independently. However, operating these machines poses risks to the safety of the human operator as well as the surrounding environment. Thus, proper user…

Human-Computer Interaction · Computer Science 2022-05-19 Mahdieh Nejati Javaremi , Sisilia Sinaga , Yuming Jin , Matthew L. Elwin , Brenna Argall

This paper presents a novel framework for simultaneously implementing localization and segmentation, which are two of the most important vision-based tasks for robotics. While the goals and techniques used for them were considered to be…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Kai Wang , Yimin Lin , Luowei Wang , Liming Han , Minjie Hua , Xiang Wang , Shiguo Lian , Bill Huang

Surgical workflow anticipation can give predictions on what steps to conduct or what instruments to use next, which is an essential part of the computer-assisted intervention system for surgery, e.g. workflow reasoning in robotic surgery.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Xiatian Zhang , Noura Al Moubayed , Hubert P. H. Shum

Video summarization methods are usually classified into shot-level or frame-level methods, which are individually used in a general way. This paper investigates the underlying complementarity between the frame-level and shot-level methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yubo An , Shenghui Zhao , Guoqiang Zhang

Automated vehicles need to be aware of the capabilities they currently possess. Skill graphs are directed acylic graphs in which a vehicle's capabilities and the dependencies between these capabilities are modeled. The skills a vehicle…

Artificial Intelligence · Computer Science 2021-08-04 Inga Jatzkowski , Till Menzel , Ansgar Bock , Markus Maurer

Microsurgical anastomosis demands exceptional dexterity and visuospatial skills, underscoring the importance of comprehensive training and precise outcome assessment. Currently, methods such as the outcome-oriented anastomosis lapse index…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Luyin Hu , Soheil Gholami , George Dindelegan , Torstein R. Meling , Aude Billard

Recently, the robotic ultrasound system has become an emerging topic owing to the widespread use of medical ultrasound. However, it is still a challenging task to model and to transfer the ultrasound skill from an ultrasound physician. In…

Artificial Intelligence · Computer Science 2023-07-27 Xutian Deng , Ziwei Lei , Yi Wang , Miao Li

What is a useful skill hierarchy for an autonomous agent? We propose an answer based on a graphical representation of how the interaction between an agent and its environment may unfold. Our approach uses modularity maximisation as a…

Machine Learning · Computer Science 2024-01-18 Joshua B. Evans , Özgür Şimşek

Healthcare automation is shaped by local procedures and organizational constraints, so agent capabilities rarely transfer unchanged across settings. Agent skills, self-contained directories that package reusable procedures for AI agents,…

Artificial Intelligence · Computer Science 2026-05-05 Gelei Xu , Ningzhi Tang , Xueyang Li , Toby Jia-Jun Li , Zhi Zheng , Wei Jin , Yiyu Shi

Segment anything model (SAM) has demonstrated excellent generalizability in common vision scenarios, yet falling short of the ability to understand specialized data. Recently, several methods have combined parameter-efficient techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yiran Song , Qianyu Zhou , Xuequan Lu , Zhiwen Shao , Lizhuang Ma

Recognizing various surgical tools, actions and phases from surgery videos is an important problem in computer vision with exciting clinical applications. Existing deep-learning-based methods for this problem either process each surgical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Haifeng Wang , Hao Xu , Jun Wang , Jian Zhou , Ke Deng

Rapid technological innovation threatens to leave much of the global workforce behind. Today's economy juxtaposes white-hot demand for skilled labor against stagnant employment prospects for workers unprepared to participate in a digital…

Data-driven approaches to assist operating room (OR) workflow analysis depend on large curated datasets that are time consuming and expensive to collect. On the other hand, we see a recent paradigm shift from supervised learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Muhammad Abdullah Jamal , Omid Mohareri

Humans demonstrate an impressive ability to acquire and generalize manipulation "tricks." Even from a single demonstration, such as using soup ladles to reach for distant objects, we can apply this skill to new scenarios involving different…

Robotics · Computer Science 2023-11-07 Jiayuan Mao , Joshua B. Tenenbaum , Tomás Lozano-Pérez , Leslie Pack Kaelbling

Intra-operative anticipation of instrument usage is a necessary component for context-aware assistance in surgery, e.g. for instrument preparation or semi-automation of robotic tasks. However, the sparsity of instrument occurrences in long…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Dominik Rivoir , Sebastian Bodenstedt , Isabel Funke , Felix von Bechtolsheim , Marius Distler , Jürgen Weitz , Stefanie Speidel

From a computer science viewpoint, a surgical domain model needs to be a conceptual one incorporating both behavior and data. It should therefore model actors, devices, tools, their complex interactions and data flow. To capture and model…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Ege Özsoy , Evin Pınar Örnek , Ulrich Eck , Federico Tombari , Nassir Navab

Cognitive cooperative assistance in robot-assisted surgery holds the potential to increase quality of care in minimally invasive interventions. Automation of surgical tasks promises to reduce the mental exertion and fatigue of surgeons. In…