English
Related papers

Related papers: STTAR: Surgical Tool Tracking using off-the-shelf …

200 papers

Augmented reality (AR) allows virtual information to be presented in the real world, providing support for numerous tasks including search and navigation. Allowing users access to multiple navigation aids may help leverage the benefits of…

Human-Computer Interaction · Computer Science 2025-11-24 Radha Kumaran , You-Jin Kim , Emily Machniak , Shane Dirksen , Junhyung Yoon , Tom Bullock , Barry Giesbrecht , Tobias Höllerer

BACKGROUND: Augmented reality (AR) is gaining popularity in varying field such as computer gaming and medical education fields. However, still few of applications in real surgeries. Orthopedic surgical applications are currently limited and…

Quantitative Methods · Quantitative Biology 2020-05-27 Anurag Lal , Ming-Hsien Hu , Pei-Yuan Lee , Min Liang Wang

Real-time instrument tracking is a crucial requirement for various computer-assisted interventions. In order to overcome problems such as specular reflections and motion blur, we propose a novel method that takes advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Iro Laina , Nicola Rieke , Christian Rupprecht , Josué Page Vizcaíno , Abouzar Eslami , Federico Tombari , Nassir Navab

Markerless Mobile Augmented Reality (AR) aims to anchor digital content in the physical world without using specific 2D or 3D objects. Absolute Pose Regressors (APR) are end-to-end machine learning solutions that infer the device's pose…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Changkun Liu , Yukun Zhao , Tristan Braud

Purpose: Trans-oral robotic surgery (TORS) using the da Vinci surgical robot is a new minimally-invasive surgery method to treat oropharyngeal tumors, but it is a challenging operation. Augmented reality (AR) based on intra-operative…

This work introduces a novel Augmented Reality (AR) approach to visualize material data alongside real objects in order to facilitate detailed material analyses based on spatial non-destructive testing (NDT) data as generated in X-ray…

Human-Computer Interaction · Computer Science 2024-04-22 Alexander Gall , Anja Heim , Patrick Weinberger , Bernhard Fröhler , Johann Kastner , Christoph Heinzl

Purpose: Tissue tracking is critical for downstream tasks in robot-assisted surgery. The Sparse Efficient Neural Depth and Deformation (SENDD) model has previously demonstrated accurate and real-time sparse point tracking, but struggled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuxin Chen , Zijian Wu , Adam Schmidt , Septimiu E. Salcudean

Intuitive robot programming through use of tracked smart input devices relies on fixed, external tracking systems, most often employing infra-red markers. Such an approach is frequently combined with projector-based augmented reality for…

Robotics · Computer Science 2023-03-29 David Puljiz , Alexandru-George Vasilache , Michael Mende , Björn Hein

Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision-based navigation system is tracking surgical instruments.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wenwu Guo , Jinlin Wu , Zhen Chen , Qingxiang Zhao , Miao Xu , Zhen Lei , Hongbin Liu

Extended Reality (XR) technologies are gaining traction as effective tools for medical training and procedural guidance, particularly in complex cardiac interventions. This paper presents a novel system for real-time 3D tracking and…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Mohsen Annabestani , Sandhya Sriram , S. Chiu Wong , Alexandros Sigaras , Bobak Mosadegh

For those experiencing severe-to-profound sensorineural hearing loss, the cochlear implant (CI) is the preferred treatment. Augmented reality (AR) aided surgery can potentially improve CI procedures and hearing outcomes. Typically, AR…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Yike Zhang , Eduardo Davalos , Dingjie Su , Ange Lou , Jack H. Noble

Intraoperative tracking of surgical instruments is an inevitable task of computer-assisted surgery. An optical tracking system often fails to precisely reconstruct the dynamic location and pose of a surgical tool due to the acquisition…

Robotics · Computer Science 2020-12-23 Md Ashikuzzaman , Noushin Jafarpisheh , Sunil Rottoo , Pierre Brisson , Hassan Rivaz

Augmented Reality (AR) applications often require robust real-time tracking of objects in the user's environment to correctly overlay virtual content. Recent advances in computer vision have produced highly accurate deep learning-based…

Human-Computer Interaction · Computer Science 2025-11-25 Alice Smith , Bob Johnson , Xiaoyu Zhu , Carol Lee

Current spinal pain management procedures, such as radiofrequency ablation (RFA) and epidural steroid injection (ESI), rely on fluoroscopy for needle placement which exposes patients and physicians to ionizing radiation. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2025-10-22 Songyuan Lu , Jingwen Hui , Jake Weeks , David B. Berry , Fanny Chapelin , Frank Talke

Visual tracking has advanced significantly in recent years, mainly due to the availability of large-scale training datasets. These datasets have enabled the development of numerous algorithms that can track objects with high accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiaoyu Guo , Pengzhi Zhong , Lizhi Lin , Hao Zhang , Ling Huang , Shuiwang Li

Neuronavigation is widely used in biomedical research and interventions to guide the precise placement of instruments around the head to support procedures such as transcranial magnetic stimulation. Traditional systems, however, rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ziye Xie , Oded Schlesinger , Raj Kundu , Jessica Y. Choi , Pablo Iturralde , Dennis A. Turner , Stefan M. Goetz , Guillermo Sapiro , Angel V. Peterchev , J. Matias Di Martino

One of the major challenges in Minimally Invasive Surgery (MIS) such as laparoscopy is the lack of depth perception. In recent years, laparoscopic scene tracking and surface reconstruction has been a focus of investigation to provide rich…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Long Chen , Wen Tang , Nigel W. John , Tao Ruan Wan , Jian Jun Zhang

We introduce a novel technique and an associated high resolution dataset that aims to precisely evaluate wireless signal based indoor positioning algorithms. The technique implements an augmented reality (AR) based positioning system that…

Machine Learning · Computer Science 2022-09-09 F. Serhan Daniş , A. Teoman Naskali , A. Taylan Cemgil , Cem Ersoy

The concept of an intelligent augmented reality (AR) assistant has significant, wide-ranging applications, with potential uses in medicine, military, and mechanics domains. Such an assistant must be able to perceive the environment and…

Surgical robots offer the exciting potential for remote telesurgery, but advances are needed to make this technology efficient and accurate to ensure patient safety. Achieving these goals is hindered by the deleterious effects of latency…

Robotics · Computer Science 2019-02-22 Florian Richter , Yifei Zhang , Yuheng Zhi , Ryan K. Orosco , Michael C. Yip