Physics-driven Sonification for Improving Multisensory Needle Guidance in Percutaneous Epicardial Access
Abstract
Percutaneous epicardial access (PEA), performed on a beating heart under fluoroscopy, enables arrhythmia treatment. However, advancing a needle toward the thin and moving pericardium remains highly challenging and risky. To address this problem, we present a physics-driven sonification method for Extended Reality (XR)-based multisensory navigation to enhance user perception during the critical needle landing phase in PEA. Dynamic cardiac anatomy from 4D CTA was reconstructed and registered to a real-world coordinate system. Real-time needle tracking provided the position of the needle tip relative to moving cardiac structures and drove an audio-visual feedback module. The visual display presented navigational cues and dynamic anatomy, while the auditory display encoded physiological cardiac states using a multilayer physical membrane model. A phantom study was conducted with twelve cardiologists performing needle insertions under visual-only and multisensory feedback. The multisensory method significantly improved navigation safety (, ), reducing myocardial contact (3.64% vs. 7.27%) and increasing correct access (90.91% vs. 52.73%). Needle placement accuracy improved, with closer membrane proximity (Cliff delta = 0.19) and reduced variability (). Execution time was comparable, while time-accuracy correlations differed significantly between modalities (). NASA-TLX indicated lower cognitive load with multisensory guidance (). These results demonstrate the feasibility of physics-driven sonification for improving spatiotemporal awareness and supporting user-centered surgical navigation.
Keywords
Cite
@article{arxiv.2604.06911,
title = {Physics-driven Sonification for Improving Multisensory Needle Guidance in Percutaneous Epicardial Access},
author = {Veronica Ruozzi and Sasan Matinfar and Pasquale Vergara and Alessandro Albanesi and Serena Dell'Aversana and Stefano Carugo and Gianluigi Buccoliero and Nassir Navab and Alberto Redaelli and Emiliano Votta},
journal= {arXiv preprint arXiv:2604.06911},
year = {2026}
}
Comments
This work has been submitted to the IEEE for possible publication