English
Related papers

Related papers: Augmented Reality Predictive Displays to Help Miti…

200 papers

Robotic-assisted procedures offer numerous advantages over traditional approaches, including improved dexterity, reduced fatigue, minimized trauma, and superior outcomes. However, the main challenge of these systems remains the poor…

Teleoperation for contact-rich manipulation remains challenging, especially when using low-cost, motion-only interfaces that provide no haptic feedback. Virtual reality controllers enable intuitive motion control but do not allow operators…

Robotics · Computer Science 2026-03-27 Gijs van den Brandt , Femke van Beek , Elena Torta

Validating Augmented Reality (AR) tracking and interaction models requires precise, repeatable ground-truth motion. However, human users cannot reliably perform consistent motion due to biomechanical variability. Robotic manipulators are…

Robotics · Computer Science 2026-02-09 Harsh Chhajed , Tian Guo

Fluoroscopic X-ray guidance is a cornerstone for percutaneous orthopaedic surgical procedures. However, two-dimensional observations of the three-dimensional anatomy suffer from the effects of projective simplification. Consequently, many…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Sebastian Andress , Alex Johnson , Mathias Unberath , Alexander Winkler , Kevin Yu , Javad Fotouhi , Simon Weidert , Greg Osgood , Nassir Navab

Augmented Reality has been subject to various integration efforts within industries due to its ability to enhance human machine interaction and understanding. Neural networks have achieved remarkable results in areas of computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Linh Kästner , Daniel Dimitrov , Jens Lambrecht

Most existing 6-DoF robot grasping solutions depend on strong supervision on grasp pose to ensure satisfactory performance, which could be laborious and impractical when the robot works in some restricted area. To this end, we propose a…

Robotics · Computer Science 2024-04-05 Xiwen Dengxiong , Xueting Wang , Shi Bai , Yunbo Zhang

Despite their mechanical sophistication, surgical robots remain blind to their surroundings. This lack of spatial awareness causes collisions, system recoveries, and workflow disruptions, issues that will intensify with the introduction of…

Surgical workflow anticipation can give predictions on what steps to conduct or what instruments to use next, which is an essential part of the computer-assisted intervention system for surgery, e.g. workflow reasoning in robotic surgery.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Xiatian Zhang , Noura Al Moubayed , Hubert P. H. Shum

This paper presents a novel method for introducing time into discrete and continuous spatial representations used in mobile robotics, by modelling long-term, pseudo-periodic variations caused by human activities. Unlike previous approaches,…

Robotics · Computer Science 2026-03-16 Tomas Krajnik , Tomas Vintr , Sergi Molina , Jaime P. Fentanes , Grzegorz Cielniak , Tom Duckett

Local-remote systems allow robots to execute complex tasks in hazardous environments such as space and nuclear power stations. However, establishing accurate positional mapping between local and remote devices can be difficult due to time…

Artificial Intelligence · Computer Science 2023-09-21 Luc McCutcheon , Saber Fallah

Purpose: This paper focuses on an automated analysis of surgical motion profiles for objective skill assessment and task recognition in robot-assisted surgery. Existing techniques heavily rely on conventional statistic measures or shallow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Ziheng Wang , Ann Majewicz Fey

As human-robot interaction (HRI) systems advance, so does the difficulty of evaluating and understanding the strengths and limitations of these systems in different environments and with different users. To this end, previous methods have…

Comprehension of surgical workflow is the foundation upon which artificial intelligence (AI) and machine learning (ML) holds the potential to assist intraoperative decision-making and risk mitigation. In this work, we move beyond mere…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Yutong Ban , Guy Rosman , Jennifer A. Eckhoff , Thomas M. Ward , Daniel A. Hashimoto , Taisei Kondo , Hidekazu Iwaki , Ozanan R. Meireles , Daniela Rus

To enable a natural and fluent human robot collaboration flow, it is critical for a robot to comprehend their human peers' on-going actions, predict their behaviors in the near future, and plan its actions correspondingly. Specifically, the…

Robotics · Computer Science 2017-09-28 Tian Zhou , Juan P. Wachs

The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to…

The integration of high-level assistance algorithms in surgical robotics training curricula may be beneficial in establishing a more comprehensive and robust skillset for aspiring surgeons, improving their clinical performance as a…

Robotics · Computer Science 2025-07-11 Alberto Rota , Ke Fan , Elena De Momi

In hazardous and remote environments, robotic systems perform critical tasks demanding improved safety and efficiency. Among these, quadruped robots with manipulator arms offer mobility and versatility for complex operations. However,…

In order to autonomously learn wide repertoires of complex skills, robots must be able to learn from their own autonomously collected data, without human supervision. One learning signal that is always available for autonomously collected…

Robotics · Computer Science 2017-10-18 Frederik Ebert , Chelsea Finn , Alex X. Lee , Sergey Levine

Video understanding of robot-assisted surgery (RAS) videos is an active research area. Modeling the gestures and skill level of surgeons presents an interesting problem. The insights drawn may be applied in effective skill acquisition,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Duygu Sarikaya , Jason J. Corso , Khurshid A. Guru

In this work, we take aim towards increasing the effectiveness of surgical assistant robots. We intended to make assistant robots safer by making them aware about the actions of surgeon, so it can take appropriate assisting actions. In…