English
Related papers

Related papers: Towards Interpretable Motion-level Skill Assessmen…

200 papers

Purpose: This paper focuses on an automated analysis of surgical motion profiles for objective skill assessment and task recognition in robot-assisted surgery. Existing techniques heavily rely on conventional statistic measures or shallow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Ziheng Wang , Ann Majewicz Fey

Minimally invasive surgery mainly consists of a series of sub-tasks, which can be decomposed into basic gestures or contexts. As a prerequisite of autonomic operation, surgical gesture recognition can assist motion planning and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Dandan Zhang , Ruoxi Wang , Benny Lo

Providing force feedback as relevant information in current Robot-Assisted Minimally Invasive Surgery systems constitutes a technological challenge due to the constraints imposed by the surgical environment. In this context, Sensorless…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Arturo Marban , Vignesh Srinivasan , Wojciech Samek , Josep Fernández , Alicia Casals

In the context of fitness coaching or for rehabilitation purposes, the motor actions of a human participant must be observed and analyzed for errors in order to provide effective feedback. This task is normally carried out by human coaches,…

Artificial Intelligence · Computer Science 2017-09-27 Felix Hülsmann , Stefan Kopp , Mario Botsch

Enabling intuitive, language-driven interaction with surgical scenes is a critical step toward intelligent operating rooms and autonomous surgical robotic assistance. However, the task of referring segmentation, localizing surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Meng Wei , Kun Yuan , Shi Li , Yue Zhou , Long Bai , Nassir Navab , Hongliang Ren , Hong Joo Lee , Tom Vercauteren , Nicolas Padoy

Recent advances in data analytics and computer-aided diagnostics stimulate the vision of patient-centric precision healthcare, where treatment plans are customized based on the health records and needs of every patient. In physical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Yalin Liao , Aleksandar Vakanski , Min Xian , David Paul , Russell Baker

Online recognition of gestures is critical for intuitive human-robot interaction (HRI) and further push collaborative robotics into the market, making robots accessible to more people. The problem is that it is difficult to achieve accurate…

Robotics · Computer Science 2023-04-17 M. A. Simão , O. Gibaru , P. Neto

Human gesture recognition has assumed a capital role in industrial applications, such as Human-Machine Interaction. We propose an approach for segmentation and classification of dynamic gestures based on a set of handcrafted features, which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 André Brás , Miguel Simão , Pedro Neto

Human motion simulation (HMS) supports cost-effective evaluation of worker behavior, safety, and productivity in industrial tasks. However, existing methods often suffer from low motion fidelity. This study introduces Generative-AI-Enabled…

Artificial Intelligence · Computer Science 2025-07-21 Hari Iyer , Neel Macwan , Atharva Jitendra Hude , Heejin Jeong , Shenghan Guo

Despite significant advancements in robotic systems and surgical data science, ensuring safe and optimal execution in robot-assisted minimally invasive surgery (RMIS) remains a complex challenge. Current surgical error detection methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhimin Shao , Jialang Xu , Danail Stoyanov , Evangelos B. Mazomenos , Yueming Jin

Manual labeling of gestures in robot-assisted surgery is labor intensive, prone to errors, and requires expertise or training. We propose a method for automated and explainable generation of gesture transcripts that leverages the abundance…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Kay Hutchinson , Zongyu Li , Ian Reyes , Homa Alemzadeh

Probabilistic representations of movement primitives open important new possibilities for machine learning in robotics. These representations are able to capture the variability of the demonstrations from a teacher as a probability…

Machine Learning · Computer Science 2020-02-20 Sebastian Gomez-Gonzalez , Gerhard Neumann , Bernhard Schölkopf , Jan Peters

Surgical skill directly affects surgical procedure outcomes; thus, effective training is needed to ensure satisfactory results. Many objective assessment metrics have been developed and some are widely used in surgical training simulators.…

Robotics · Computer Science 2021-02-23 Marzieh Ershad , Robert Rege , Ann Majewicz Fey

Purpose: A profound education of novice surgeons is crucial to ensure that surgical interventions are effective and safe. One important aspect is the teaching of technical skills for minimally invasive or robot-assisted procedures. This…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Isabel Funke , Sören Torge Mees , Jürgen Weitz , Stefanie Speidel

Robotic-assisted dressing has the potential to significantly aid both patients as well as healthcare personnel, reducing the workload and improving the efficiency in clinical settings. While substantial progress has been made in robotic…

Robotics · Computer Science 2025-12-23 David Blanco-Mulero , Júlia Borràs , Carme Torras

In surgical training for medical students, proficiency development relies on expert-led skill assessment, which is costly, time-limited, difficult to scale, and its expertise remains confined to institutions with available specialists.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Le Ma , Thiago Freitas dos Santos , Nadia Magnenat-Thalmann , Katarzyna Wac

The application of machine-learning solutions to movement assessment from skeleton videos has attracted significant research attention in recent years. This advancement has made rehabilitation at home more accessible, utilizing movement…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Tal Hakim

Performing bimanual tasks with dual robotic setups can drastically increase the impact on industrial and daily life applications. However, performing a bimanual task brings many challenges, like synchronization and coordination of the…

Robotics · Computer Science 2023-08-28 Giovanni Franzese , Leandro de Souza Rosa , Tim Verburg , Luka Peternel , Jens Kober

Purpose: Manual feedback in basic RMIS training can consume a significant amount of time from expert surgeons' schedule and is prone to subjectivity. While VR-based training tasks can generate automated score reports, there is no mechanism…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Aneeq Zia , Irfan Essa

Assessing learner competency in clinical simulation requires expert observation that is time-intensive, difficult to scale, and subject to inter-rater variability. Vision-language models have emerged as a promising tool for understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanchen David Wang , Yilin Liu , Madison J. Lee , Surya Chand Rayala , Gautam Biswas , Daniel T. Levin , Meiyi Ma