English
Related papers

Related papers: Model selection and real-time skill assessment for…

200 papers

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Physics-based simulations have accelerated progress in robot learning for driving, manipulation, and locomotion. Yet, a fast, accurate, and robust surgical simulation environment remains a challenge. In this paper, we present…

Predictive models have been at the core of many robotic systems, from quadrotors to walking robots. However, it has been challenging to develop and apply such models to practical robotic manipulation due to high-dimensional sensory…

Robotics · Computer Science 2020-09-14 Lucas Manuelli , Yunzhu Li , Pete Florence , Russ Tedrake

Autonomous surgical robots are a promising solution to the increasing demand for surgery amid a shortage of surgeons. Recent work has proposed learning-based approaches for the autonomous manipulation of soft tissue. However, due to…

Robotics · Computer Science 2025-08-27 Jordan Thompson , Ronald Koe , Anthony Le , Gabriella Goodman , Daniel S. Brown , Alan Kuntz

Background. Bimanual psychomotor proficiency is fundamental to neurosurgical procedures, yet it remains difficult for trainees to acquire and for educators to objectively evaluate performance. In this study, we investigate the feasibility…

Applying deep learning (DL) for annotating surgical instruments in robot-assisted minimally invasive surgeries (MIS) represents a significant advancement in surgical technology. This systematic review examines 48 studies that and advanced…

Semantic tool segmentation in surgical videos is important for surgical scene understanding and computer-assisted interventions as well as for the development of robotic automation. The problem is challenging because different illumination…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Emanuele Colleoni , Philip Edwards , Danail Stoyanov

In Human-Robot Collaboration, safety mechanisms such as Speed and Separation Monitoring and Power and Force Limitation dynamically adjust the robot's speed based on human proximity. While essential for risk reduction, these mechanisms…

Robotics · Computer Science 2025-12-22 Marco Faroni , Alessio Spanò , Andrea M. Zanchettin , Paolo Rocco

Real-time tool segmentation is an essential component in computer-assisted surgical systems. We propose a novel real-time automatic method based on Fully Convolutional Networks (FCN) and optical flow tracking. Our method exploits the…

Operating under real world conditions is challenging due to the possibility of a wide range of failures induced by execution errors and state uncertainty. In relatively benign settings, such failures can be overcome by retrying or executing…

Robotics · Computer Science 2023-03-10 Shivam Vats , Maxim Likhachev , Oliver Kroemer

Simulator training for image guided surgical interventions would benefit from intelligent systems that detect the evolution of task performance, and take control of individual speed precision strategies by providing effective automatic…

Human-Computer Interaction · Computer Science 2019-04-16 Birgitta Dresp-Langley

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Deep learning has led to state-of-the-art results for many medical imaging tasks, such as segmentation of different anatomical structures. With the increased numbers of deep learning publications and openly available code, the approach to…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Tom van Sonsbeek , Veronika Cheplygina

In the realm of automated robotic surgery and computer-assisted interventions, understanding robotic surgical activities stands paramount. Existing algorithms dedicated to surgical activity recognition predominantly cater to pre-defined…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Long Bai , Guankun Wang , Jie Wang , Xiaoxiao Yang , Huxin Gao , Xin Liang , An Wang , Mobarakol Islam , Hongliang Ren

Robotic-assisted procedures offer enhanced precision, but while fully autonomous systems are limited in task knowledge, difficulties in modeling unstructured environments, and generalisation abilities, fully manual teleoperated systems also…

Laparoscopic surgery is a complex surgical technique that requires extensive training. Recent advances in deep learning have shown promise in supporting this training by enabling automatic video-based assessment of surgical skills. However,…

Robot-assisted neurological surgery is receiving growing interest due to the improved dexterity, precision, and control of surgical tools, which results in better patient outcomes. However, such systems often limit surgeons' natural sensory…

Signal Processing · Electrical Eng. & Systems 2025-08-13 Zacharias Chen , Alexa Cristelle Cahilig , Sarah Dias , Prithu Kolar , Ravi Prakash , Patrick J. Codd

Robots operating in open, unstructured real-world environments must rely on onboard visual perception while autonomously moving across different locations. Continuous changes in onboard camera viewpoints cause significant visual scale…

Robotics · Computer Science 2026-05-04 Xianbo Cai , Hideyuki Ichiwara , Hyogo Hiruma , Masaki Yoshikawa , Hiroshi Ito , Tetsuya Ogata

Surgical instrument segmentation in robot-assisted surgery (RAS) - especially that using learning-based models - relies on the assumption that training and testing videos are sampled from the same domain. However, it is impractical and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Zixu Zhao , Yueming Jin , Bo Lu , Chi-Fai Ng , Qi Dou , Yun-Hui Liu , Pheng-Ann Heng

The integration of high-level assistance algorithms in surgical robotics training curricula may be beneficial in establishing a more comprehensive and robust skillset for aspiring surgeons, improving their clinical performance as a…

Robotics · Computer Science 2025-07-11 Alberto Rota , Ke Fan , Elena De Momi