中文
相关论文

相关论文: Real-time Geometry-Aware Augmented Reality in Mini…

200 篇论文

In recent years, augmented reality (AR) technology has been increasingly employed in structural health monitoring (SHM). In the case of conditions following a seismic event, inspections are conducted to evaluate the progression of the…

人机交互 · 计算机科学 2021-11-05 Jiaqi Xu , Elijah Wyckoff , John-Wesley Hanson , Fernando Moreu , Derek Doyle

Purpose: Monocular depth estimation (MDE) is vital for scene understanding in minimally invasive surgery (MIS). However, endoscopic video sequences are often contaminated by smoke, specular reflections, blur, and occlusions, limiting the…

Structural Health Monitoring (SHM) has become increasingly critical due to the rapid deterioration of civil infrastructure. Traditional methods involving heavy equipment are costly and time-consuming. Recent SHM approaches use advanced…

人机交互 · 计算机科学 2025-12-19 Omar Awadallah , Katarina Grolinger , Ayan Sadhu

The use of Augmented Reality (AR) devices for surgical guidance has gained increasing traction in the medical field. Traditional registration methods often rely on external fiducial markers to achieve high accuracy and real-time…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yue Yang , Christoph Leuze , Brian Hargreaves , Bruce Daniel , Fred Baik

Estimating precise metric depth and scene reconstruction from monocular endoscopy is a fundamental task for surgical navigation in robotic surgery. However, traditional stereo matching adopts binocular images to perceive the depth…

机器人学 · 计算机科学 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Fangxun Zhong , Yonghao Long , Qi Dou , Yun-Hui Liu , Dong Sun

Despite having achieved real-time performance in mesh construction, most of the current LiDAR odometry and meshing methods may struggle to deal with complex scenes due to relying on explicit meshing schemes. They are usually sensitive to…

机器人学 · 计算机科学 2023-12-27 Yanjin Zhu , Xin Zheng , Jianke Zhu

High-resolution imaging is crucial for enhancing visual clarity and enabling precise computer-assisted guidance in minimally invasive surgery (MIS). Despite the increasing adoption of 4K endoscopic systems, there remains a significant gap…

For those experiencing severe-to-profound sensorineural hearing loss, the cochlear implant (CI) is the preferred treatment. Augmented reality (AR) aided surgery can potentially improve CI procedures and hearing outcomes. Typically, AR…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Yike Zhang , Eduardo Davalos , Dingjie Su , Ange Lou , Jack H. Noble

Minimally invasive surgery (MIS) has many documented advantages, but the surgeon's limited visual contact with the scene can be problematic. Hence, systems that can help surgeons navigate, such as a method that can produce a 3D semantic…

Augmented reality (AR) has the potential to improve the immersion and efficiency of computer-assisted orthopaedic surgery (CAOS) by allowing surgeons to maintain focus on the operating site rather than external displays in the operating…

机器人学 · 计算机科学 2024-05-06 Hisham Iqbal , Ferdinando Rodriguez y Baena

Accurate camera-to-robot calibration is essential for any vision-based robotic control system and especially critical in minimally invasive surgical robots, where instruments conduct precise micro-manipulations. However, MIS robots have…

机器人学 · 计算机科学 2025-10-07 Zekai Liang , Kazuya Miyata , Xiao Liang , Florian Richter , Michael C. Yip

Augmented reality (AR) devices with head mounted displays (HMDs) facilitate the direct superimposition of 3D preoperative imaging data onto the patient during surgery. To use an HMD-AR device as a stand-alone surgical navigation system, the…

We propose a new benchmark for evaluating stereoscopic visual-inertial computer vision algorithms (SLAM/ SfM/ 3D Reconstruction/ Visual-Inertial Odometry) for minimally invasive surgical (MIS) interventions in the abdomen. Our MITI Dataset…

图像与视频处理 · 电气工程与系统科学 2026-02-12 Regine Hartwig , Daniel Ostler , Jean-Claude Rosenthal , Hubertus Feußner , Dirk Wilhelm , Dirk Wollherr

Background: Robot-assisted minimally invasive surgery (RMIS) research increasingly relies on multimodal data, yet access to proprietary robot telemetry remains a major barrier. We introduce MiDAS, an open-source, platform-agnostic system…

This study considers modern surgical navigation systems based on augmented reality technologies. Augmented reality glasses are used to construct holograms of the patient's organs from MRI and CT data, subsequently transmitted to the…

Industrial robotics are redefining inspection and maintenance routines across multiple sectors, enhancing safety, efficiency, and environmental sustainability. In outdoor industrial facilities, it is crucial to inspect and repair complex…

机器人学 · 计算机科学 2023-11-03 Frank Regal , Steven Swanbeck , Fabian Parra , Jared Rosenbaum , Mitch Pryor

The ability to interpret social cues comes naturally for most people, but for those living with Autism Spectrum Disorder (ASD), some experience a deficiency in this area. This paper presents the development of a multimodal augmented reality…

计算机视觉与模式识别 · 计算机科学 2020-10-23 James Ren Hou Lee , Alexander Wong

The concept of augmented reality (AR) assistants has captured the human imagination for decades, becoming a staple of modern science fiction. To pursue this goal, it is necessary to develop artificial intelligence (AI)-based methods that…

Musculoskeletal modeling and simulations enable the accurate description and analysis of the movement of biological systems with applications such as rehabilitation assessment, prosthesis, and exoskeleton design. However, the widespread…

机器人学 · 计算机科学 2025-07-29 Frederico Belmonte Klein , Zhaoyuan Wan , Huawei Wang , Ruoli Wang

Laparoscopic Field of View (FOV) control is one of the most fundamental and important components in Minimally Invasive Surgery (MIS), nevertheless, the traditional manual holding paradigm may easily bring fatigue to surgical assistants, and…

机器人学 · 计算机科学 2021-09-23 Bin Li , Bo Lu , Yiang Lu , Qi Dou , Yun-Hui Liu