English
Related papers

Related papers: Augmented Reality and Human-Robot Collaboration Fr…

200 papers

Augmented and mixed reality (MR) systems have the potential to improve surgical precision by overlaying digital guidance directly onto the operative field. This paper presents a novel MR guidance system using the Magic Leap head-mounted…

Human-Computer Interaction · Computer Science 2025-10-07 Alice Yang , Michael Beasley , Catherine Taylor , Hu Guo

Purpose: Deep learning-based MRI artifact correction methods often demonstrate poor generalization to clinical data. This limitation largely stems from the inability of deep learning models in reliably distinguishing motion artifacts from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ziheng Guo , Danqun Zheng , Shuai Li , Chengwei Chen , Boyang Pan , Xuezhou Li , Ziqin Yu , Langdi Zhong , Chenwei Shao , Yun Bian , Nan-Jie Gong

Robot-assisted minimally invasive surgery has shown to improve patient outcomes, as well as reduce complications and recovery time for several clinical applications. While increasingly configurable robotic arms can maximize reach and avoid…

Physicians perform minimally invasive percutaneous procedures under Computed Tomography (CT) image guidance both for the diagnosis and treatment of numerous diseases. For these procedures performed within Computed Tomography Scanners,…

Accurately segmenting brain lesions in MRI scans is critical for providing patients with prognoses and neurological monitoring. However, the performance of CNN-based segmentation methods is constrained by the limited training set size.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jiayu Huo , Yang Liu , Xi Ouyang , Alejandro Granados , Sebastien Ourselin , Rachel Sparks

We present an error-controlled mesh refinement procedure for needle insertion simulation and apply it to the simulation of electrode implantation for deep brain stimulation, including brain shift. Our approach enables to control the error…

Computational Engineering, Finance, and Science · Computer Science 2018-11-20 Huu Phuoc Bui , Satyendra Tomar , Hadrien Courtecuisse , Michel Audette , Stéphane Cotin , Stéphane P. A. Bordas

Augmented Reality (AR) applications necessitates methods of inserting needed objects into scenes captured by cameras in a way that is coherent with the surroundings. Common AR applications require the insertion of predefined 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Fouad Afiouni , Mohamad Fakih , Joey Sleiman

In surgical navigation, finding correspondence between preoperative plan and intraoperative anatomy, the so-called registration task, is imperative. One promising approach is to intraoperatively digitize anatomy and register it with the…

Ordinary electric woodworking tools are integrated into a multiple-object-aware augmented framework to assist operators in fabrication tasks. This study presents an advanced evaluation of the developed open-source fabrication software…

Robotics · Computer Science 2025-03-11 Andrea Settimi , Julien Gamerro , Yves Weinand

We propose a general strategy for autonomous guidance and insertion of a needle into a retinal blood vessel. The main challenges underpinning this task are the accurate placement of the needle-tip on the target vein and a careful needle…

Robotics · Computer Science 2023-06-21 Ji Woong Kim , Peiyao Zhang , Peter Gehlbach , Iulian Iordachita , Marin Kobilarov

Seven million people suffer surgical complications each year, but with sufficient surgical training and review, 50\% of these complications could be prevented. To improve surgical performance, existing research uses various deep learning…

Image and Video Processing · Electrical Eng. & Systems 2022-04-19 Ella Selina Lan

Non-prehensile (NP) manipulation, in which robots alter object states without forming stable grasps (for example, pushing, poking, or sliding), significantly broadens robotic manipulation capabilities when grasping is infeasible or…

One of the major challenges in Minimally Invasive Surgery (MIS) such as laparoscopy is the lack of depth perception. In recent years, laparoscopic scene tracking and surface reconstruction has been a focus of investigation to provide rich…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Long Chen , Wen Tang , Nigel W. John , Tao Ruan Wan , Jian Jun Zhang

Scene understanding and object recognition is a difficult to achieve yet crucial skill for robots. Recently, Convolutional Neural Networks (CNN), have shown success in this task. However, there is still a gap between their performance on…

Robotics · Computer Science 2017-01-18 Sepehr Valipour , Camilo Perez , Martin Jagersand

During retinal microsurgery, precise manipulation of the delicate retinal tissue is required for positive surgical outcome. However, accurate manipulation and navigation of surgical tools remain difficult due to a constrained workspace and…

Robotics · Computer Science 2020-11-17 Ji Woong Kim , Peiyao Zhang , Peter Gehlbach , Iulian Iordachita , Marin Kobilarov

This study presents an integrated framework for enhancing the safety and operational efficiency of robotic arms in laparoscopic surgery by addressing key challenges in collision detection and minimum distance estimation. By combining…

Robotics · Computer Science 2026-01-23 Sarvin Ghiasi , Majid Roshanfar , Jake Barralet , Liane S. Feldman , Amir Hooshiar

Minimally Invasive Surgery (MIS) techniques have gained rapid popularity among surgeons since they offer significant clinical benefits including reduced recovery time and diminished post-operative adverse effects. However, conventional…

Computed Tomography (CT) image guidance enables accurate and safe minimally invasive treatment of diseases, including cancer and chronic pain, with needle-like tools via a percutaneous approach. The physician incrementally inserts and…

Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Mathias Unberath , Javad Fotouhi , Jonas Hajek , Andreas Maier , Greg Osgood , Russell Taylor , Mehran Armand , Nassir Navab

Purpose: In this paper, we develop and clinically evaluate a depth-only, markerless augmented reality (AR) registration pipeline on a head-mounted display, and assess accuracy across small or low-curvature anatomies in real-life operative…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yue Yang , Fabian Necker , Christoph Leuze , Michelle Chen , Andrey Finegersh , Jake Lee , Vasu Divi , Bruce Daniel , Brian Hargreaves , Jie Ying Wu , Fred M Baik