English
Related papers

Related papers: Toward Reliable AR-Guided Surgical Navigation: Int…

200 papers

Proton therapy offers superior organ-at-risk sparing but is highly sensitive to anatomical changes, making accurate deformable image registration (DIR) across longitudinal CT scans essential. Conventional DIR methods are often too slow for…

Automation holds the potential to assist surgeons in robotic interventions, shifting their mental work load from visuomotor control to high level decision making. Reinforcement learning has shown promising results in learning complex…

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

Non-rigid 3D mesh matching is a critical step in computer vision and computer graphics pipelines. We tackle matching meshes that contain topological artefacts which can break the assumption made by current approaches. While Functional Maps…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Aymen Merrouche , Stefanie Wuhrer , Edmond Boyer

Understanding how segmentation performance scales with training data is fundamental for developing data-efficient medical AI systems. In this study, we systematically revisit data scaling behavior across 15 anatomical segmentation tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuetan Chu , Zhongyi Han , Gongning Luo , Xin Gao

Objective: The computation of anatomical information and laparoscope position is a fundamental block of surgical navigation in Minimally Invasive Surgery (MIS). Recovering a dense 3D structure of surgical scene using visual cues remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Bo Lu , Yonghao Long , Bohan Yang , Qi Dou , Yunhui Liu , Dong Sun

Deformable image registration is a fundamental problem in the field of medical image analysis. During the last years, we have witnessed the advent of deep learning-based image registration methods which achieve state-of-the-art performance,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-03 Lucas Mansilla , Diego H. Milone , Enzo Ferrante

The use of Augmented Reality (AR) devices for surgical guidance has gained increasing traction in the medical field. Traditional registration methods often rely on external fiducial markers to achieve high accuracy and real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yue Yang , Christoph Leuze , Brian Hargreaves , Bruce Daniel , Fred Baik

One of the fundamental challenges in supervised learning for multimodal image registration is the lack of ground-truth for voxel-level spatial correspondence. This work describes a method to infer voxel-level transformation from…

We propose FlowReg, a deep learning-based framework for unsupervised image registration for neuroimaging applications. The system is composed of two architectures that are trained sequentially: FlowReg-A which affinely corrects for gross…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Sergiu Mocanu , Alan R. Moody , April Khademi

When choosing a deformable image registration (DIR) approach for images with large deformations and content mismatch, the realism of found transformations often needs to be traded off against the required runtime. DIR approaches using deep…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Georgios Andreadis , Eduard Ruiz Munné , Thomas H. W. Bäck , Peter A. N. Bosman , Tanja Alderliesten

Deep learning affords enormous opportunities to augment the armamentarium of biomedical imaging, albeit its design and implementation have potential flaws. Fundamentally, most deep learning models are driven entirely by data without…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Liyue Shen , Wei Zhao , Dante Capaldi , John Pauly , Lei Xing

Neurosurgery requires exceptional precision and comprehensive preoperative planning to ensure optimal patient outcomes. Despite technological advancements, there remains a need for intuitive, accessible tools to enhance surgical preparation…

Robotics · Computer Science 2024-11-06 Hon Lung Ho , Yupeng Wang , An Wang , Long Bai , Hongliang Ren

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

Simulating facial appearance change following bony movement is a critical step in orthognathic surgical planning for patients with jaw deformities. Conventional biomechanics-based methods such as the finite-element method (FEM) are labor…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Xi Fang , Daeseung Kim , Xuanang Xu , Tianshu Kuang , Hannah H. Deng , Joshua C. Barber , Nathan Lampen , Jaime Gateno , Michael A. K. Liebschner , James J. Xia , Pingkun Yan

Cancer cases have been rising globally, resulting in nearly 10 million deaths in 2023. Biopsy, crucial for diagnosis, is often performed under ultrasound (US) guidance, demanding precise hand coordination and cognitive decision-making.…

Robotics · Computer Science 2024-10-15 Pratima Mohan , Aayush Agrawal , Niravkumar A. Patel

We propose 3Deformer, a general-purpose framework for interactive 3D shape editing. Given a source 3D mesh with semantic materials, and a user-specified semantic image, 3Deformer can accurately edit the source mesh following the shape…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Hao Su , Xuefeng Liu , Jianwei Niu , Ji Wan , Xinghao Wu

We introduce a speech-guided embodied agent framework for video-guided skull base surgery that dynamically executes perception and image-guidance tasks in response to surgeon queries. The proposed system integrates natural language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jecia Z. Y. Mao , Francis X. Creighton , Russell H. Taylor , Manish Sahu

Early diagnosis of breast cancer is crucial, enabling the establishment of appropriate treatment plans and markedly enhancing patient prognosis. While direct magnetic resonance imaging-guided biopsy demonstrates promising performance in…

Machine Learning · Computer Science 2025-11-18 Kyunghyun Lee , Yong-Min Shin , Minwoo Shin , Jihun Kim , Sunghwan Lim , Won-Yong Shin , Kyungho Yoon

Robotic automation in surgery requires precise tracking of surgical tools and mapping of deformable tissue. Previous works on surgical perception frameworks require significant effort in developing features for surgical tool and tissue…

Robotics · Computer Science 2021-03-26 Jingpei Lu , Ambareesh Jayakumari , Florian Richter , Yang Li , Michael C. Yip