English
Related papers

Related papers: Real-time Geometry-Aware Augmented Reality in Mini…

200 papers

Knee arthroscopy is a minimally invasive surgical (MIS) procedure which is performed to treat knee-joint ailment. Lack of visual information of the surgical site obtained from miniaturized cameras make this surgical procedure more complex.…

Image and Video Processing · Electrical Eng. & Systems 2024-09-04 Shahnewaz Ali , Yaqub Jonmohamadi , Yu Takeda , Jonathan Roberts , Ross Crawford , Cameron Brown , Ajay K. Pandey

Objective: The computation of anatomical information and laparoscope position is a fundamental block of surgical navigation in Minimally Invasive Surgery (MIS). Recovering a dense 3D structure of surgical scene using visual cues remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Bo Lu , Yonghao Long , Bohan Yang , Qi Dou , Yunhui Liu , Dong Sun

This dissertation advances the state of the art for AR/VR tracking systems by increasing the tracking frequency by orders of magnitude and proposes an efficient algorithm for the problem of edge-aware optimization. AR/VR is a natural way of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Akash Bapat

Augmented Reality (AR) surgical navigation systems are emerging as the next generation of intraoperative surgical guidance, promising to overcome limitations of traditional navigation systems. However, known issues with AR depth perception…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Marc J. Fischer , Jeffrey Potts , Gabriel Urreola , Dax Jones , Paolo Palmisciano , E. Bradley Strong , Branden Cord , Andrew D. Hernandez , Julia D. Sharma , E. Brandon Strong

Robotic-assisted medical systems (RAMS) have gained significant attention for their advantages in alleviating surgeons' fatigue and improving patients' outcomes. These systems comprise a range of human-computer interactions, including…

Robotics · Computer Science 2024-10-22 Letian Ai , Yihao Liu , Mehran Armand , Amir Kheradmand , Alejandro Martin-Gomez

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

This work introduces a novel Augmented Reality (AR) approach to visualize material data alongside real objects in order to facilitate detailed material analyses based on spatial non-destructive testing (NDT) data as generated in X-ray…

Human-Computer Interaction · Computer Science 2024-04-22 Alexander Gall , Anja Heim , Patrick Weinberger , Bernhard Fröhler , Johann Kastner , Christoph Heinzl

Augmented Reality (AR) systems describe the class of systems that use computers to overlay virtual information on the real world. AR environments allow the development of promising tools in several application domains. In medical training…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-03 Felix G. Hamza-Lup , Jannick P. Rolland , Charles Hughes

Augmented Reality (AR) has emerged as a significant advancement in surgical procedures, offering a solution to the challenges posed by traditional neuronavigation methods. These conventional techniques often necessitate surgeons to split…

Human-Computer Interaction · Computer Science 2023-11-06 Mahdi Bagheri , Farhad Piri , Hadi Digale , Saem Sattarzadeh , Mohammad Reza Mohammadi

As a novel way of presenting information, augmented reality (AR) enables people to interact with the physical world in a direct and intuitive way. While there are some mobile AR products implemented with specific hardware at a high cost,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Songlin Hou , Fangzhou Lin , Yunmei Huang , Zhe Peng , Bin Xiao

Scale-aware monocular depth estimation poses a significant challenge in computer-aided endoscopic navigation. However, existing depth estimation methods that do not consider the geometric priors struggle to learn the absolute scale from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Ruofeng Wei , Bin Li , Kai Chen , Yiyao Ma , Yunhui Liu , Qi Dou

A cost-effective augmented reality (AR) system is presented for visualising three-dimensional magnetic field structures and charged-particle trajectories in magnetically confined fusion plasmas. The system presented in this study integrates…

Plasma Physics · Physics 2026-04-29 Akinobu Matsuyama

BACKGROUND AND OBJECTIVE: The research done in the field of Augmented Reality (AR) for patient positioning in radiation therapy is scarce. We propose an efficient and cost-effective algorithm for tracking the scene and the patient to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Hamid Sarmadi , Rafael Muñoz-Salinas , M. Álvaro Berbís , Antonio Luna , R. Medina-Carnicer

Laparoscopic surgery constrains surgeons spatial awareness because procedures are performed through a monocular, two-dimensional (2D) endoscopic view. Conventional training methods using dry-lab models or recorded videos provide limited…

Human-Computer Interaction · Computer Science 2025-11-05 Songyang Liu , Yunpeng Tan , Shuai Li

Purpose. Ability to locate and track ultrasound images in the 3D operating space is of great benefit for multiple clinical applications. This is often accomplished by tracking the probe using a precise but expensive optical or…

Image and Video Processing · Electrical Eng. & Systems 2022-05-11 Yitian Zhou , Gaétan Lelu , Boris Labbé , Guillaume Pasquier , Pierre Le Gargasson , Albert Murienne , Laurent Launay

Robotic-assisted Minimally Invasive Surgery (RMIS) can benefit from the automation of common, repetitive or well-defined but ergonomically difficult tasks. One such task is the scanning of a pick-up endomicroscopy probe over a complex,…

Robotics · Computer Science 2018-03-05 Lin Zhang , Menglong Ye , Petros Giataganas , Michael Hughes , Guang-Zhong Yang

As robots for minimally invasive surgery (MIS) gradually become more accessible and modular, we believe there is a great opportunity to rethink and expand the visualization and control paradigms that have characterized surgical…

Robot-assisted minimally invasive surgery has shown to improve patient outcomes, as well as reduce complications and recovery time for several clinical applications. While increasingly configurable robotic arms can maximize reach and avoid…

Extended reality (XR), encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), is emerging as a transformative platform for medical education. Traditional methods such as textbooks, physical models, and cadaveric…

Human-Computer Interaction · Computer Science 2025-09-03 Yuqing Wei , Yupeng Wang , Jiayi Zhao , Yanjun Liu , Huxin Gao , Jiewen Lai

A major limitation of minimally invasive surgery is the difficulty in accurately locating the internal anatomical structures of the target organ due to the lack of tactile feedback and transparency. Augmented reality (AR) offers a promising…

Robotics · Computer Science 2024-09-19 Jingwei Song , Ray Zhang , Wenwei Zhang , Hao Zhou , Maani Ghaffari