English
Related papers

Related papers: STTAR: Surgical Tool Tracking using off-the-shelf …

200 papers

Purpose: Image guidance is crucial for the success of many interventions. Images are displayed on designated monitors that cannot be positioned optimally due to sterility and spatial constraints. This indirect visualization causes potential…

Other Computer Science · Computer Science 2017-10-03 Long Qian , Mathias Unberath , Kevin Yu , Bernhard Fuerst , Alex Johnson , Nassir Navab , Greg Osgood

Surgical instrument tracking is an active research area that can provide surgeons feedback about the location of their tools relative to anatomy. Recent tracking methods are mainly divided into two parts: segmentation and object detection.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ange Lou , Xing Yao , Ziteng Liu , Jintong Han , Jack Noble

Deep needle insertion to a target often poses a huge challenge, requiring a combination of specialized skills, assistive technology, and extensive training. One of the frequently encountered medical scenarios demanding such expertise…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Zhuoqi Cheng , Simon Lyck Bjært Sørensen , Mikkel Werge Olsen , René Lynge Eriksen , Thiusius Rajeeth Savarimuthu

Fast and accurate eye tracking in a virtual reality or augmented reality headset could lead to better display performance and enable novel methods of user interaction with the system. However, it remains a challenge for a system to combine…

Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Anasse Boutayeb , Iyad Lahsen-cherif , Ahmed El Khadimi

Robotic-assisted orthopaedic surgeries demand accurate, automated leg manipulation for improved spatial accuracy to reduce iatrogenic damage. In this study, we propose novel rigid body designs and an optical tracking volume setup for…

Robotics · Computer Science 2019-09-09 Mario Strydom , Artur Banach , Liao Wu , Ross Crawford , Jonathan Roberts , Anjali Jaiprakash

Mixed reality head-mounted displays (mxdR-HMD) have the potential to visualize volumetric medical imaging data in holograms to provide a true sense of volumetric depth. An effective user interface, however, has yet to be thoroughly studied.…

Human-Computer Interaction · Computer Science 2022-01-27 Hoijoon Jung , Younhyun Jung , Michael Fulham , Jinman Kim

Under the sea, visible spectrum cameras have limited sensing capacity, being able to detect objects only in clear water, but in a constrained range. Considering any sea water condition, sonars are more suitable to support autonomous…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Gustavo Neves , Rômulo Cerqueira , Jan Albiez , Luciano Oliveira

Hand tracking is a critical component of natural user interactions in extended reality (XR) environments, including extended reality musical instruments (XRMIs). However, self-occlusion remains a significant challenge for vision-based hand…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Max Graf , Mathieu Barthet

Many autonomous robotic applications require object-level understanding when deployed. Actively reconstructing objects of interest, i.e. objects with specific semantic meanings, is therefore relevant for a robot to perform downstream tasks…

Robotics · Computer Science 2024-03-19 Liren Jin , Haofei Kuang , Yue Pan , Cyrill Stachniss , Marija Popović

Augmented Reality (AR) embeds digital information into objects of the physical world. Data can be shown in-situ, thereby enabling real-time visual comparisons and object search in real-life user tasks, such as comparing products and looking…

Human-Computer Interaction · Computer Science 2021-12-28 Tica Lin , Yalong Yang , Johanna Beyer , Hanspeter Pfister

Exoskeletons for rehabilitation can help enhance motor recovery in individuals suffering from neurological disorders. Precision in movement execution, especially in arm rehabilitation, is crucial to prevent maladaptive plasticity. However,…

Human-Computer Interaction · Computer Science 2024-12-10 Beatrice Luciani , Alessandra Pedrocchi , Peppino Tropea , Agnese Seregni , Francesco Braghin , Marta Gandolla

Augmented reality (AR) technology provides means for embedding visualization in a real-world context. Such techniques allow situated analyses of live data in their spatial domain. However, as existing techniques have to be adapted for this…

Human-Computer Interaction · Computer Science 2022-09-07 Kuno Kurzhals , Michael Becher , Nelusa Pathmanathan , Guido Reina

The first part of the article describes our approach for solution of this problem by means of Augmented Reality. The merging of the real world model and digital objects allows streamline the work with the model and speed up the whole…

Human-Computer Interaction · Computer Science 2011-03-11 Jiri Stastny , David Prochazka , Tomas Koubek , Jaromir Landa

Augmented Reality (AR) systems, while enhancing task performance through real-time guidance, pose risks of inducing cognitive tunneling-a hyperfocus on virtual content that compromises situational awareness (SA) in safety-critical…

Machine Learning · Computer Science 2025-09-03 Zhehan Qu , Tianyi Hu , Christian Fronk , Maria Gorlatova

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Recent advancements in Augmented Reality (AR) have demonstrated applications in architecture, design, and fabrication. Compared to conventional 2D construction drawings, AR can be used to superimpose contextual instructions, display 3D…

Emerging Technologies · Computer Science 2025-07-08 Alexander Htet Kyaw , Arvin Xu , Sasa Zivkovic , Gwyllim Jahn , Cameron Newnham , Nick Van Den Berg

Mobile Augmented Reality (MAR) integrates computer-generated virtual objects with physical environments for mobile devices. MAR systems enable users to interact with MAR devices, such as smartphones and head-worn wearables, and performs…

Human-Computer Interaction · Computer Science 2022-08-29 Jacky Cao , Kit-Yung Lam , Lik-Hang Lee , Xiaoli Liu , Pan Hui , Xiang Su

Alignment between real and virtual objects is a challenging task required for the deployment of Mixed Reality (MR) into manufacturing, medical, and construction applications. To face this challenge, a series of methods have been proposed.…

Human-Computer Interaction · Computer Science 2022-11-17 Alejandro Martin-Gomez , Alexander Winkler , Rafael de la Tijera Obert , Javad Fotouhi , Daniel Roth , Ulrich Eck , Nassir Navab

Surgeons should play a central role in disaster planning and management due to the overwhelming number of bodily injuries that are typically involved during most forms of disaster. In fact, various types of surgical procedures are performed…

Graphics · Computer Science 2023-03-02 Manos Kamarianakis , Antonis Protopsaltis , George Papagiannakis