English
Related papers

Related papers: Adapting Frozen Mono-modal Backbones for Multi-mod…

200 papers

Current multi-modal object re-identification approaches based on large-scale pre-trained backbones (i.e., ViT) have displayed remarkable progress and achieved excellent performance. However, these methods usually adopt the standard full…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Minghui Lin , Shu Wang , Xiang Wang , Jianhua Tang , Longbin Fu , Zhengrong Zuo , Nong Sang

Deformable image registration aims to precisely align medical images from different modalities or times. Traditional deep learning methods, while effective, often lack interpretability, real-time observability and adjustment capacity during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yongtai Zhuo , Yiqing Shen

Diffeomorphic deformable multi-modal image registration is a challenging task which aims to bring images acquired by different modalities to the same coordinate space and at the same time to preserve the topology and the invertibility of…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Vasiliki Sideri-Lampretsa , Georgios Kaissis , Daniel Rueckert

Robust and accurate 2D/3D registration, which aligns preoperative models with intraoperative images of the same anatomy, is crucial for successful interventional navigation. To mitigate the challenge of a limited field of view in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yuxin Cui , Rui Song , Yibin Li , Max Q. -H. Meng , Zhe Min

Recent contrastive multimodal vision-language models like CLIP have demonstrated robust open-world semantic understanding, becoming the standard image backbones for vision-language applications. However, recent findings suggest high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mayug Maniparambil , Raiymbek Akshulakov , Yasser Abdelaziz Dahou Djilali , Sanath Narayan , Ankit Singh , Noel E. O'Connor

One of the fundamental challenges in supervised learning for multimodal image registration is the lack of ground-truth for voxel-level spatial correspondence. This work describes a method to infer voxel-level transformation from…

Deformable image registration is a very important field of research in medical imaging. Recently multiple deep learning approaches were published in this area showing promising results. However, drawbacks of deep learning methods are the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Tobias Fechter , Dimos Baltas

The ability to simultaneously leverage multiple modes of sensor information is critical for perception of an automated vehicle's physical surroundings. Spatio-temporal alignment of registration of the incoming information is often a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Michael Giering , Vivek Venugopalan , Kishore Reddy

Recent works in medical image registration have proposed the use of Implicit Neural Representations, demonstrating performance that rivals state-of-the-art learning-based methods. However, these implicit representations need to be optimized…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Louis D. van Harten , Jaap Stoker , Ivana Išgum

Spatial registration across different visual modalities is a critical but formidable step in multi-modality image fusion for real-world perception. Although several methods are proposed to address this issue, the existing registration-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Congcong Bian , Haolong Ma , Hui Li , Zhongwei Shen , Xiaoqing Luo , Xiaoning Song , Xiao-Jun Wu

The crucial components of a conventional image registration method are the choice of the right feature representations and similarity measures. These two components, although elaborately designed, are somewhat handcrafted using human…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Shanhui Sun , Jing Hu , Mingqing Yao , Jinrong Hu , Xiaodong Yang , Qi Song , Xi Wu

Deformable image registration is a fundamental task in medical image analysis and plays a crucial role in a wide range of clinical applications. Recently, deep learning-based approaches have been widely studied for deformable medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-03 Jing Zou , Noémie Debroux , Lihao Liu , Jing Qin , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Deep learning approaches to the segmentation of magnetic resonance images have shown significant promise in automating the quantitative analysis of brain images. However, a continuing challenge has been its sensitivity to the variability of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-05 Dzung L. Pham , Yi-Yu Chou , Blake E. Dewey , Daniel S. Reich , John A. Butman , Snehashis Roy

The recent application of deep learning in various areas of medical image analysis has brought excellent performance gains. In particular, technologies based on deep learning in medical image registration can outperform traditional…

Image and Video Processing · Electrical Eng. & Systems 2019-09-09 Abdullah Nazib , Clinton Fookes , Dimitri Perrin

Deformable medical image registration plays an important role in clinical diagnosis and treatment. Recently, the deep learning (DL) based image registration methods have been widely investigated and showed excellent performance in…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yibo Wang , Wen Qian , Xuming Zhang

Diffeomorphic deformable image registration is one of the crucial tasks in medical image analysis, which aims to find a unique transformation while preserving the topology and invertibility of the transformation. Deep convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-02-09 Ameneh Sheikhjafari , Michelle Noga , Kumaradevan Punithakumar , Nilanjan Ray

Non-rigid inter-modality registration can facilitate accurate information fusion from different modalities, but it is challenging due to the very different image appearances across modalities. In this paper, we propose to train a non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Xiaohuan Cao , Jianhua Yang , Li Wang , Zhong Xue , Qian Wang , Dinggang Shen

Diffeomorphic deformable image registration is crucial in many medical image studies, as it offers unique, special properties including topology preservation and invertibility of the transformation. Recent deep learning-based deformable…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Tony C. W. Mok , Albert C. S. Chung