English
Related papers

Related papers: Unsupervised Multimodal Image Registration with Ad…

200 papers

Co-registration of multimodal remote sensing images is still an ongoing challenge because of nonlinear radiometric differences (NRD) and significant geometric distortions (e.g., scale and rotation changes) between these images. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuanxin Ye , Bai Zhu , Tengfeng Tang , Chao Yang , Qizhi Xu , Guo Zhang

Regularization strategies in medical image registration often take a one-size-fits-all approach by imposing uniform constraints across the entire image domain. Yet biological structures are anything but regular. Lacking structural…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Ziad Kheil , Soleakhena Ken , Laurent Risser

Robust and accurate 2D/3D registration, which aligns preoperative models with intraoperative images of the same anatomy, is crucial for successful interventional navigation. To mitigate the challenge of a limited field of view in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yuxin Cui , Rui Song , Yibin Li , Max Q. -H. Meng , Zhe Min

Nonrigid registration is vital to medical image analysis but remains challenging for diffusion MRI (dMRI) due to its high-dimensional, orientation-dependent nature. While classical methods are accurate, they are computationally demanding,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Gianfranco Cortes , Xiaoda Qu , Baba C. Vemuri

The recent application of deep learning in various areas of medical image analysis has brought excellent performance gains. In particular, technologies based on deep learning in medical image registration can outperform traditional…

Image and Video Processing · Electrical Eng. & Systems 2019-09-09 Abdullah Nazib , Clinton Fookes , Dimitri Perrin

Tagged magnetic resonance imaging~(MRI) has been used for decades to observe and quantify the detailed motion of deforming tissue. However, this technique faces several challenges such as tag fading, large motion, long computation times,…

Image and Video Processing · Electrical Eng. & Systems 2023-05-02 Zhangxing Bian , Fangxu Xing , Jinglun Yu , Muhan Shao , Yihao Liu , Aaron Carass , Jiachen Zhuo , Jonghye Woo , Jerry L. Prince

Diffeomorphic deformable image registration is crucial in many medical image studies, as it offers unique, special properties including topology preservation and invertibility of the transformation. Recent deep learning-based deformable…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Tony C. W. Mok , Albert C. S. Chung

This study introduces a pioneering methodology for human action recognition by harnessing deep neural network techniques and adaptive fusion strategies across multiple modalities, including RGB, optical flows, audio, and depth information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Novanto Yudistira

Traditional deformable registration techniques achieve impressive results and offer a rigorous theoretical treatment, but are computationally intensive since they solve an optimization problem for each image pair. Recently, learning-based…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Adrian V. Dalca , Guha Balakrishnan , John Guttag , Mert R. Sabuncu

Multi-modal image registration is a crucial pre-processing step in many medical applications. However, it is a challenging task due to the complex intensity relationships between different imaging modalities, which can result in large…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Vasiliki Sideri-Lampretsa , Veronika A. Zimmer , Huaqi Qiu , Georgios Kaissis , Daniel Rueckert

Registration is a fundamental task in medical robotics and is often a crucial step for many downstream tasks such as motion analysis, intra-operative tracking and image segmentation. Popular registration methods such as ANTs and NiftyReg…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wentao Zhu , Yufang Huang , Daguang Xu , Zhen Qian , Wei Fan , Xiaohui Xie

Deformable image registration (DIR) is a cornerstone of medical image analysis, enabling spatial alignment for tasks like comparative studies and multi-modal fusion. While learning-based methods (e.g., CNNs, transformers) offer fast…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Nikita Drozdov , Marat Zinovev , Dmitry Sorokin

Multi-modality (or multi-channel) imaging is becoming increasingly important and more widely available, e.g. hyperspectral imaging in remote sensing, spectral CT in material sciences as well as multi-contrast MRI and PET-MR in medicine.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Leon Bungert , Matthias J. Ehrhardt

Multi-modal image registration plays a critical role in precision medicine but faces challenges from non-linear intensity relationships and local optima. While deep learning models enable rapid inference, they often suffer from…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Boya Wang , Ruizhe Li , Chao Chen , Xin Chen

In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Junyu Chen , Eric C. Frey , Yufan He , William P. Segars , Ye Li , Yong Du

We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Xiao Yang , Roland Kwitt , Martin Styner , Marc Niethammer

Unsafe surgical care is a critical health concern, often linked to limitations in surgeon experience, skills, and situational awareness. Integrating patient-specific 3D models into the surgical field can enhance visualization, provide…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Alberto Neri , Veronica Penza , Nazim Haouchine , Leonardo S. Mattos

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tony C. W. Mok , Zi Li , Yunhao Bai , Jianpeng Zhang , Wei Liu , Yan-Jie Zhou , Ke Yan , Dakai Jin , Yu Shi , Xiaoli Yin , Le Lu , Ling Zhang

For a variety of biometric cross-spectral tasks, Visible-Thermal (VT) facial pairs are used. However, due to a lack of calibration in the lab, photographic capture between two different sensors leads to severely misaligned pairs that can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Catherine Ordun , Edward Raff , Sanjay Purushotham

Existing pyramid registration networks may accumulate anatomical misalignments and lack an effective mechanism to dynamically determine the number of optimization iterations under varying deformation requirements across images, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Heming Wu , Di Wang , Tai Ma , Peng Zhao , Yubin Xiao , Zhongke Wu , Xing-Ce Wang , Xuan Wu , You Zhou