English

Iterative PnP and its application in 3D-2D vascular image registration for robot navigation

Robotics 2024-01-12 v2 Image and Video Processing

Abstract

This paper reports on a new real-time robot-centered 3D-2D vascular image alignment algorithm, which is robust to outliers and can align nonrigid shapes. Few works have managed to achieve both real-time and accurate performance for vascular intervention robots. This work bridges high-accuracy 3D-2D registration techniques and computational efficiency requirements in intervention robot applications. We categorize centerline-based vascular 3D-2D image registration problems as an iterative Perspective-n-Point (PnP) problem and propose to use the Levenberg-Marquardt solver on the Lie manifold. Then, the recently developed Reproducing Kernel Hilbert Space (RKHS) algorithm is introduced to overcome the ``big-to-small'' problem in typical robotic scenarios. Finally, an iterative reweighted least squares is applied to solve RKHS-based formulation efficiently. Experiments indicate that the proposed algorithm processes registration over 50 Hz (rigid) and 20 Hz (nonrigid) and obtains competing registration accuracy similar to other works. Results indicate that our Iterative PnP is suitable for future vascular intervention robot applications.

Keywords

Cite

@article{arxiv.2310.12551,
  title  = {Iterative PnP and its application in 3D-2D vascular image registration for robot navigation},
  author = {Jingwei Song and Keke Yang and Zheng Zhang and Meng Li and Tuoyu Cao and Maani Ghaffari},
  journal= {arXiv preprint arXiv:2310.12551},
  year   = {2024}
}

Comments

Submitted to ICRA 2024 Errors in Eq. 4 and Eq. 6 have been corrected. Updates include some minor improvements in Section II

R2 v1 2026-06-28T12:55:19.024Z