English
Related papers

Related papers: Extend Your Horizon: A Device-Agnostic Surgical To…

200 papers

Purpose: Biopsies play a crucial role in determining the classification and staging of tumors. Ultrasound is frequently used in this procedure to provide real-time anatomical information. Using augmented reality (AR), surgeons can visualize…

Human-Computer Interaction · Computer Science 2024-12-19 Haowei Li , Wenqing Yan , Jiasheng Zhao , Yuqi Ji , Long Qian , Hui Ding , Zhe Zhao , Guangzhi Wang

During Percutaneous Nephrolithotomy (PCNL) operations, the surgeon is required to define the incision point on the patient's back, align the needle to a pre-planned path, and perform puncture operations afterward. The procedure is currently…

Intraoperative segmentation and tracking of minimally invasive instruments is a prerequisite for computer- and robotic-assisted surgery. Since additional hardware like tracking systems or the robot encoders are cumbersome and lack accuracy,…

Augmented Reality (AR) holds the potential to revolutionize surgical procedures by allowing surgeons to visualize critical structures within the patient's body. This is achieved through superimposing preoperative organ models onto the…

Medical Physics · Physics 2024-08-07 Zheng Han , Qi Dou

Conventional computer-assisted orthopaedic navigation systems rely on the tracking of dedicated optical markers for patient poses, which makes the surgical workflow more invasive, tedious, and expensive. Visual tracking has recently been…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Xue Hu , Anh Nguyen , Ferdinando Rodriguez y Baena

Surgical guidance can be delivered in various ways. In neurosurgery, spatial guidance and orientation are predominantly achieved through neuronavigation systems that reference pre-operative MRI scans. Recently, there has been growing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Gary Sarwin , Alessandro Carretta , Victor Staartjes , Matteo Zoli , Diego Mazzatenta , Luca Regli , Carlo Serra , Ender Konukoglu

Optical see-through augmented reality (OST-AR) overlays digital targets and annotations on the physical world, offering promising guidance for hands-on tasks such as medical needle insertion or assembly. Recent work on OST-AR depth…

Graphics · Computer Science 2025-10-03 Hu Guo , Lily Patel , Rohan Gupt

Open, or non-laparoscopic surgery, represents the vast majority of all operating room procedures, but few tools exist to objectively evaluate these techniques at scale. Current efforts involve human expert-based visual assessment. We…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Michael Zhang , Xiaotian Cheng , Daniel Copeland , Arjun Desai , Melody Y. Guan , Gabriel A. Brat , Serena Yeung

This paper tackles instrument tracking and 3D visualization challenges in minimally invasive surgery (MIS), crucial for computer-assisted interventions. Conventional and robot-assisted MIS encounter issues with limited 2D camera projections…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Shubhangi Nema , Abhishek Mathur , Leena Vachhani

This paper develops a method to use RGB-D cameras to track the motions of a human spinal cord injury patient undergoing spinal stimulation and physical rehabilitation. Because clinicians must remain close to the patient during training…

Robotics · Computer Science 2017-08-01 Kun Li , Joel W. Burdick

Robot-assisted minimally invasive surgery has shown to improve patient outcomes, as well as reduce complications and recovery time for several clinical applications. While increasingly configurable robotic arms can maximize reach and avoid…

Optical see-through augmented reality (OST-AR) systems like Microsoft HoloLens 2 hold promise for arm's distance guidance (e.g., surgery), but depth perception of the hologram and occlusion of real instruments remain challenging. We present…

Human-Computer Interaction · Computer Science 2025-08-27 Yue Yang , Xue Xie , Xinkai Wang , Hui Zhang , Chiming Yu , Xiaoxian Xiong , Lifeng Zhu , Yuanyi Zheng , Jue Cen , Bruce Daniel , Fred Baik

In operating rooms (OR), world-scale multi-view 3D tracking supports downstream applications such as surgeon behavior recognition, where physically meaningful quantities such as distances and motion statistics must be measured in meters.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yihua Shao , Kang Chen , Feng Xue , Siyu Chen , Long Bai , Hongyuan Yu , Hao Tang , Jinlin Wu , Nassir Navab

In surgical navigation, finding correspondence between preoperative plan and intraoperative anatomy, the so-called registration task, is imperative. One promising approach is to intraoperatively digitize anatomy and register it with the…

Ophthalmic surgical robots offer superior stability and precision by reducing the natural hand tremors of human surgeons, enabling delicate operations in confined surgical spaces. Despite the advancements in developing vision- and…

Robotics · Computer Science 2025-07-02 Tinghe Hong , Shenlin Cai , Boyang Li , Kai Huang

Accurate needle placement in spine interventions is critical for effective pain management, yet it depends on reliable identification of anatomical landmarks and careful trajectory planning. Conventional imaging guidance often relies both…

Human-Computer Interaction · Computer Science 2026-03-24 Tianyu Song , Felix Pabst , Feng Li , Yordanka Velikova , Miruna-Alexandra Gafencu , Yuan Bi , Ulrich Eck , Nassir Navab

Minimally Invasive Surgery (MIS) techniques have gained rapid popularity among surgeons since they offer significant clinical benefits including reduced recovery time and diminished post-operative adverse effects. However, conventional…

Object tracking is a fundamental tool in modern innovation, with applications in defense systems, autonomous vehicles, and biomedical research. It enables precise identification, monitoring, and spatiotemporal analysis of objects across…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Mojtaba S. Fazli , Shannon Quinn

This work presents a framework for monocular 6D pose estimation of surgical instruments in open surgery, addressing challenges such as object articulations, specularity, occlusions, and synthetic-to-real domain adaptation. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Robert Spektor , Tom Friedman , Itay Or , Gil Bolotin , Shlomi Laufer

Augmented reality (AR) technology provides means for embedding visualization in a real-world context. Such techniques allow situated analyses of live data in their spatial domain. However, as existing techniques have to be adapted for this…

Human-Computer Interaction · Computer Science 2022-09-07 Kuno Kurzhals , Michael Becher , Nelusa Pathmanathan , Guido Reina