English

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

Computer Vision and Pattern Recognition 2020-11-13 v1 Image and Video Processing

Abstract

Multimodal image registration (MIR) is a fundamental procedure in many image-guided therapies. Recently, unsupervised learning-based methods have demonstrated promising performance over accuracy and efficiency in deformable image registration. However, the estimated deformation fields of the existing methods fully rely on the to-be-registered image pair. It is difficult for the networks to be aware of the mismatched boundaries, resulting in unsatisfactory organ boundary alignment. In this paper, we propose a novel multimodal registration framework, which leverages the deformation fields estimated from both: (i) the original to-be-registered image pair, (ii) their corresponding gradient intensity maps, and adaptively fuses them with the proposed gated fusion module. With the help of auxiliary gradient-space guidance, the network can concentrate more on the spatial relationship of the organ boundary. Experimental results on two clinically acquired CT-MRI datasets demonstrate the effectiveness of our proposed approach.

Keywords

Cite

@article{arxiv.2011.06216,
  title  = {Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance},
  author = {Zhe Xu and Jiangpeng Yan and Jie Luo and Xiu Li and Jayender Jagadeesan},
  journal= {arXiv preprint arXiv:2011.06216},
  year   = {2020}
}

Comments

5 pages, under review

R2 v1 2026-06-23T20:07:14.487Z