English
Related papers

Related papers: STTAR: Surgical Tool Tracking using off-the-shelf …

200 papers

Fluoroscopic X-ray guidance is a cornerstone for percutaneous orthopaedic surgical procedures. However, two-dimensional observations of the three-dimensional anatomy suffer from the effects of projective simplification. Consequently, many…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Sebastian Andress , Alex Johnson , Mathias Unberath , Alexander Winkler , Kevin Yu , Javad Fotouhi , Simon Weidert , Greg Osgood , Nassir Navab

The current apprenticeship model for surgical training requires a high level of supervision, which does not scale well to meet the growing need for more surgeons. Many endoscopic procedures are directly taught in the operating room (OR)…

Human-Computer Interaction · Computer Science 2025-06-30 Jumanh Atoum , Jinkyung Park , Mamtaj Akter , Nicholas Kavoussi , Pamela Wisniewski , Jie Ying Wu

Optical see-though head-mounted displays (OST HMDs) are one of the key technologies for merging virtual objects and physical scenes to provide an immersive mixed reality (MR) environment to its user. A fundamental limitation of HMDs is,…

Human-Computer Interaction · Computer Science 2020-07-07 Mathias Unberath , Kevin Yu , Roghayeh Barmaki , Alex Johnson , Nassir Navab

Purpose: Precise port placement is a critical step in robot-assisted surgery, where port configuration influences both visual access to the operative field and instrument maneuverability. To bridge the gap between preoperative planning and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zheng Han , Zixin Yang , Yonghao Long , Lin Zhang , Peter Kazanzides , Qi Dou

Augmented Reality (AR) systems describe the class of systems that use computers to overlay virtual information on the real world. AR environments allow the development of promising tools in several application domains. In medical training…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-03 Felix G. Hamza-Lup , Jannick P. Rolland , Charles Hughes

Purpose: This study demonstrates a proof of concept of a method for simultaneous anatomical imaging and real-time (SMART) passive device tracking for MR-guided interventions. Methods: Phase Correlation template matching was combined with a…

Medical Physics · Physics 2019-08-29 Frank Zijlstra , Max A. Viergever , Peter R. Seevinck

This study considers modern surgical navigation systems based on augmented reality technologies. Augmented reality glasses are used to construct holograms of the patient's organs from MRI and CT data, subsequently transmitted to the…

Recent advances in augmented reality (AR) have enabled interactive systems that assist users in physical assembly tasks. In this paper, we present an AR-assisted assembly workflow that leverages object recognition and hand tracking to (1)…

Human-Computer Interaction · Computer Science 2026-01-21 Alexander Htet Kyaw , Haotian Ma , Sasa Zivkovic , Jenny Sabin

This article presents a systematic review of optical see-through head mounted display (OST-HMD) usage in augmented reality (AR) surgery applications from 2013 to 2020. Articles were categorised by: OST-HMD device, surgical speciality,…

Human-Computer Interaction · Computer Science 2022-02-10 Manuel Birlo , P. J. "Eddie'' Edwards , Matthew Clarkson , Danail Stoyanov

Background and aim: Image registration and alignment are the main limitations of augmented reality-based knee replacement surgery. This research aims to decrease the registration error, eliminate outcomes that are trapped in local minima to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Nitish Maharjan , Abeer Alsadoon , P. W. C. Prasad , Salma Abdullah , Tarik A. Rashid

Accurate neuronavigation is essential for generating the intended effect with transcranial magnetic stimulation (TMS). Precise coil placement also directly influences stimulation efficacy. Traditional neuronavigation systems often rely on…

Human-Computer Interaction · Computer Science 2026-01-29 Xuyi Hu , Ke Ma , Siwei Liu , Per Ola Kristensson , Stephan Goetz

In recent years, augmented reality (AR) technology has been increasingly employed in structural health monitoring (SHM). In the case of conditions following a seismic event, inspections are conducted to evaluate the progression of the…

Human-Computer Interaction · Computer Science 2021-11-05 Jiaqi Xu , Elijah Wyckoff , John-Wesley Hanson , Fernando Moreu , Derek Doyle

Augmented Reality (AR) navigation via Head-Mounted Displays (HMDs), particularly AR glasses, is revolutionizing the driving experience by integrating real-time routing information into the driver's field of view. Despite the potential of AR…

Human-Computer Interaction · Computer Science 2024-04-30 Xiangyang He , Keyuan Zhou

Handheld Augmented Reality (HAR) is revolutionizing the civil infrastructure application domain. The current trend in HAR relies on marker tracking technology. However, marker-based systems have several limitations, such as difficulty in…

Graphics · Computer Science 2025-06-18 Sabahat Israr , Dawar Khan , Zhanglin Cheng , Mukhtaj Khan , Kiyoshi Kiyokawa

Neurosurgery requires exceptional precision and comprehensive preoperative planning to ensure optimal patient outcomes. Despite technological advancements, there remains a need for intuitive, accessible tools to enhance surgical preparation…

Robotics · Computer Science 2024-11-06 Hon Lung Ho , Yupeng Wang , An Wang , Long Bai , Hongliang Ren

Optical see-through augmented reality (OST-AR) overlays digital targets and annotations on the physical world, offering promising guidance for hands-on tasks such as medical needle insertion or assembly. Recent work on OST-AR depth…

Graphics · Computer Science 2025-10-03 Hu Guo , Lily Patel , Rohan Gupt

Augmented Reality (AR) holds the potential to revolutionize surgical procedures by allowing surgeons to visualize critical structures within the patient's body. This is achieved through superimposing preoperative organ models onto the…

Medical Physics · Physics 2024-08-07 Zheng Han , Qi Dou

Optical see-through head-mounted displays (OST HMDs) are a major output medium for Augmented Reality, which have seen significant growth in popularity and usage among the general public due to the growing release of consumer-oriented…

Human-Computer Interaction · Computer Science 2017-10-02 Jens Grubert , Yuta Itoh , Kenneth Moser , J. Edward Swan

Augmented reality (AR) is an effective tool in robotic surgery education as it combines exploratory learning with three-dimensional guidance. However, existing AR systems require expert supervision and do not account for differences in the…

Robotics · Computer Science 2025-04-10 Alexandre Banks , Richard Cook , Septimiu E. Salcudean

Positive margins are common in head and neck squamous cell carcinoma, yet intraoperative re-resection is often imprecise because margin locations are typically communicated verbally from pathology. We present an all-in-one augmented reality…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yue Yang , Matthieu Chabanas , Carrie Reale , Annie Benson , Jason Slagle , Matthew Weinger , Michael Topf , Jie Ying Wu