English
Related papers

Related papers: Real-time Geometry-Aware Augmented Reality in Mini…

200 papers

Minimally invasive surgery (MIS) procedures benefit significantly from robotic systems due to their improved precision and dexterity. However, ensuring safety in these dynamic and cluttered environments is an ongoing challenge. This paper…

Robotics · Computer Science 2025-03-25 Jacinto Colan , Ana Davila , Khusniddin Fozilov , Yasuhisa Hasegawa

Real-time cardiac magnetic resonance imaging (MRI) plays an increasingly important role in guiding various cardiac interventions. In order to provide better visual assistance, the cine MRI frames need to be segmented on-the-fly to avoid…

Image and Video Processing · Electrical Eng. & Systems 2020-12-15 Dewen Zeng , Weiwen Jiang , Tianchen Wang , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

With the growing popularity of robotic surgery, education becomes increasingly important and urgently needed for the sake of patient safety. However, experienced surgeons have limited accessibility due to their busy clinical schedule or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Yonghao Long , Chengkun Li , Qi Dou

Fluoroscopic X-ray guidance is a cornerstone for percutaneous orthopaedic surgical procedures. However, two-dimensional observations of the three-dimensional anatomy suffer from the effects of projective simplification. Consequently, many…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Sebastian Andress , Alex Johnson , Mathias Unberath , Alexander Winkler , Kevin Yu , Javad Fotouhi , Simon Weidert , Greg Osgood , Nassir Navab

Augmented reality (AR) offers promising opportunities to support movement-based activities, such as personal training or physical therapy, with real-time, spatially-situated visual cues. While many approaches leverage AR to guide motion,…

Human-Computer Interaction · Computer Science 2025-10-02 Jade Kandel , Sriya Kasumarthi , Spiros Tsalikis , Chelsea Duppen , Daniel Szafir , Michael Lewek , Henry Fuchs , Danielle Szafir

Operators want to maintain awareness of the structure being tested while observing sensor data. Normally the human's gaze shifts to a separate device or screen during the experiment for data information, missing the structure's physical…

Human-Computer Interaction · Computer Science 2021-10-08 Elijah Wyckoff , Marlan Ball , Fernando Moreu

Advances in computer vision, particularly in optical image-based 3D reconstruction and feature matching, enable applications like marker-less surgical navigation and digitization of surgery. However, their development is hindered by a lack…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Emma Most , Jonas Hein , Frédéric Giraud , Nicola A. Cavalcanti , Lukas Zingg , Baptiste Brument , Nino Louman , Fabio Carrillo , Philipp Fürnstahl , Lilian Calvet

Interactive segmentation enables users to segment as needed by providing cues of objects, which introduces human-computer interaction for many fields, such as image editing and medical image analysis. Typically, massive and expansive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Kehan Li , Yian Zhao , Zhennan Wang , Zesen Cheng , Peng Jin , Xiangyang Ji , Li Yuan , Chang Liu , Jie Chen

In image-assisted minimally invasive surgeries (MIS), understanding surgical scenes is vital for real-time feedback to surgeons, skill evaluation, and improving outcomes through collaborative human-robot procedures. Within this context, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mithun Parab , Pranay Lendave , Jiyoung Kim , Thi Quynh Dan Nguyen , Palash Ingle

Accurate needle placement in spine interventions is critical for effective pain management, yet it depends on reliable identification of anatomical landmarks and careful trajectory planning. Conventional imaging guidance often relies both…

Human-Computer Interaction · Computer Science 2026-03-24 Tianyu Song , Felix Pabst , Feng Li , Yordanka Velikova , Miruna-Alexandra Gafencu , Yuan Bi , Ulrich Eck , Nassir Navab

In augmented reality (AR)-guided surgical navigation, preoperative organ models are superimposed onto the patient's intraoperative anatomy to visualize critical structures such as vessels and tumors. Accurate deformation modeling is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Zheng Han , Jun Zhou , Jialun Pei , Jing Qin , Yingfang Fan , Qi Dou

The integration of augmented reality (AR), extended reality (XR), and virtual reality (VR) technologies in agriculture has shown significant promise in enhancing various agricultural practices. Mobile robots have also been adopted as…

Robotics · Computer Science 2024-11-07 Caio Mucchiani , Dimitrios Chatziparaschis , Konstantinos Karydis

Real-time object pose estimation and tracking is challenging but essential for emerging augmented reality (AR) applications. In general, state-of-the-art methods address this problem using deep neural networks which indeed yield…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Yo-Chung Lau , Kuan-Wei Tseng , I-Ju Hsieh , Hsiao-Ching Tseng , Yi-Ping Hung

Geometric priors are often used to enhance 3D reconstruction. With many smartphones featuring low-resolution depth sensors and the prevalence of off-the-shelf monocular geometry estimators, incorporating geometric priors as regularization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xuqian Ren , Matias Turkulainen , Jiepeng Wang , Otto Seiskari , Iaroslav Melekhov , Juho Kannala , Esa Rahtu

Augmented Reality is a topic of foremost interest nowadays. Its main goal is to seamlessly blend virtual content in real-world scenes. Due to the lack of computational power in mobile devices, rendering a virtual object with high-quality,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Rafael Monroy , Matis Hudon , Aljosa Smolic

Unexposed environments, such as lava tubes, mines, and tunnels, are among the most complex yet strategically significant domains for scientific exploration and infrastructure development. Accurate and real-time 3D meshing of these…

Robotics · Computer Science 2025-04-29 Yizhe Zhang , Jianping Li , Xin Zhao , Fuxun Liang , Zhen Dong , Bisheng Yang

Augmented Reality (AR) holds the potential to revolutionize surgical procedures by allowing surgeons to visualize critical structures within the patient's body. This is achieved through superimposing preoperative organ models onto the…

Medical Physics · Physics 2024-08-07 Zheng Han , Qi Dou

Open-vocabulary panoptic reconstruction is essential for advanced robotics perception and simulation. However, existing methods based on 3D Gaussian Splatting (3DGS) often struggle to simultaneously achieve geometric accuracy, coherent…

Robotics · Computer Science 2026-04-14 Xuan Yu , Yuxuan Xie , Changjian Jiang , Shichao Zhai , Rong Xiong , Yu Zhang , Yue Wang

Retrieving range information in three-dimensional (3D) radio imaging is particularly challenging due to the limited communication bandwidth and pilot resources. To address this issue, we consider a reconfigurable intelligent surface…

Information Theory · Computer Science 2024-03-19 Yixuan Huang , Jie Yang , Chao-Kai Wen , Shi Jin

Over the last two decades, augmented reality (AR) has led to the rapid development of new interfaces in various fields of social and technological application domains. One such domain is medicine, and to a higher extent surgery, where these…

Human-Computer Interaction · Computer Science 2024-04-02 Jaime Sancho , Manuel Villa , Miguel Chavarrías , Eduardo Juarez , Alfonso Lagares , César Sanz