English
Related papers

Related papers: StraightTrack: Towards Mixed Reality Navigation Sy…

200 papers

Augmented Reality (AR) surgical navigation systems are emerging as the next generation of intraoperative surgical guidance, promising to overcome limitations of traditional navigation systems. However, known issues with AR depth perception…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Marc J. Fischer , Jeffrey Potts , Gabriel Urreola , Dax Jones , Paolo Palmisciano , E. Bradley Strong , Branden Cord , Andrew D. Hernandez , Julia D. Sharma , E. Brandon Strong

The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to…

Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision-based navigation system is tracking surgical instruments.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wenwu Guo , Jinlin Wu , Zhen Chen , Qingxiang Zhao , Miao Xu , Zhen Lei , Hongbin Liu

Accurate needle placement in spine interventions is critical for effective pain management, yet it depends on reliable identification of anatomical landmarks and careful trajectory planning. Conventional imaging guidance often relies both…

Human-Computer Interaction · Computer Science 2026-03-24 Tianyu Song , Felix Pabst , Feng Li , Yordanka Velikova , Miruna-Alexandra Gafencu , Yuan Bi , Ulrich Eck , Nassir Navab

Chinese acupuncture practitioners primarily depend on muscle memory and tactile feedback to insert needles and accurately target acupuncture points, as the current workflow lacks imaging modalities and visual aids. Consequently, new…

Human-Computer Interaction · Computer Science 2025-04-04 Xinkai Wang , Yue Yang , Kehong Zhou , Xue Xie , Lifeng Zhu , Aiguo Song , Bruce Daniel

Abstract Background During percutaneous puncture robotic surgical navigation, the needle insertion point is positioned on the patient's chest and abdomen body surface. By locating any point on the soft skin tissue, it is difficult to apply…

Robotics · Computer Science 2024-06-11 Zezhao Guo , Yanzhong Guo , Zhanfang Zhao

Ultrasound technology enables safe, non-invasive imaging of dynamic tissue behavior, making it a valuable tool in medicine, biomechanics, and sports science. However, accurately tracking tissue motion in B-mode ultrasound remains…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Praneeth Namburi , Roger Pallarès-López , Jessica Rosendorf , Duarte Folgado , Brian W. Anthony

Background and aim: Image registration and alignment are the main limitations of augmented reality-based knee replacement surgery. This research aims to decrease the registration error, eliminate outcomes that are trapped in local minima to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Nitish Maharjan , Abeer Alsadoon , P. W. C. Prasad , Salma Abdullah , Tarik A. Rashid

Tissue tracking plays a critical role in various surgical navigation and extended reality (XR) applications. While current methods trained on large synthetic datasets achieve high tracking accuracy and generalize well to endoscopic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Mert Asim Karaoglu , Wenbo Ji , Ahmed Abbas , Nassir Navab , Benjamin Busam , Alexander Ladikos

Real-time tracking of previously unseen, highly dynamic objects in contact-rich scenes, such as during dexterous in-hand manipulation, remains a major challenge. Pure vision-based approaches often fail under heavy occlusions due to frequent…

Robotics · Computer Science 2026-03-19 Wen Yang , Zhixian Xie , Yiting Wang , Abhijit Tadepalli , Heni Ben Amor , Shan Lin , Wanxin Jin

Extended reality (XR), encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), is emerging as a transformative platform for medical education. Traditional methods such as textbooks, physical models, and cadaveric…

Human-Computer Interaction · Computer Science 2025-09-03 Yuqing Wei , Yupeng Wang , Jiayi Zhao , Yanjun Liu , Huxin Gao , Jiewen Lai

The emergence of real-time 3D ultrasound (US) makes it possible to consider image-based tracking of subcutaneous soft tissue targets for computer guided diagnosis and therapy. We propose a 3D transrectal US based tracking system for precise…

Other Computer Science · Computer Science 2008-01-17 Michael Baumann , Pierre Mozer , Vincent Daanen , Jocelyne Troccaz

Alignment between real and virtual objects is a challenging task required for the deployment of Mixed Reality (MR) into manufacturing, medical, and construction applications. To face this challenge, a series of methods have been proposed.…

Human-Computer Interaction · Computer Science 2022-11-17 Alejandro Martin-Gomez , Alexander Winkler , Rafael de la Tijera Obert , Javad Fotouhi , Daniel Roth , Ulrich Eck , Nassir Navab

Percutaneous epicardial access (PEA), performed on a beating heart under fluoroscopy, enables arrhythmia treatment. However, advancing a needle toward the thin and moving pericardium remains highly challenging and risky. To address this…

During Percutaneous Nephrolithotomy (PCNL) operations, the surgeon is required to define the incision point on the patient's back, align the needle to a pre-planned path, and perform puncture operations afterward. The procedure is currently…

Surgery monitoring in Mixed Reality (MR) environments has recently received substantial focus due to its importance in image-based decisions, skill assessment, and robot-assisted surgery. Tracking hands and articulated surgical instruments…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Ahmed Tawfik Aboukhadra , Nadia Robertini , Jameel Malik , Ahmed Elhayek , Gerd Reis , Didier Stricker

Accurate tool tracking is essential for the success of computer-assisted intervention. Previous efforts often modeled tool trajectories rigidly, overlooking the dynamic nature of surgical procedures, especially tracking scenarios like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chinedu Innocent Nwoye , Nicolas Padoy

Augmented and mixed reality (MR) systems have the potential to improve surgical precision by overlaying digital guidance directly onto the operative field. This paper presents a novel MR guidance system using the Magic Leap head-mounted…

Human-Computer Interaction · Computer Science 2025-10-07 Alice Yang , Michael Beasley , Catherine Taylor , Hu Guo

Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments to visualize relevant intraoperative information. In conventional systems, instruments are typically tracked using fiducial…

Human-Computer Interaction · Computer Science 2026-03-10 Jiaming Zhang , Mingxu Liu , Hongchao Shu , Ruixing Liang , Yihao Liu , Ojas Taskar , Amir Kheradmand , Mehran Armand , Alejandro Martin-Gomez

Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. Augmented reality (AR) has been introduced in the operating rooms…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Javad Fotouhi , Arian Mehrfard , Tianyu Song , Alex Johnson , Greg Osgood , Mathias Unberath , Mehran Armand , Nassir Navab
‹ Prev 1 2 3 10 Next ›