English
Related papers

Related papers: Adapting Frozen Mono-modal Backbones for Multi-mod…

200 papers

We describe an adversarial learning approach to constrain convolutional neural network training for image registration, replacing heuristic smoothness measures of displacement fields often used in these tasks. Using minimally-invasive…

Data-driven deep learning approaches to image registration can be less accurate than conventional iterative approaches, especially when training data is limited. To address this whilst retaining the fast inference speed of deep learning, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xi Jia , Alexander Thorley , Wei Chen , Huaqi Qiu , Linlin Shen , Iain B Styles , Hyung Jin Chang , Ales Leonardis , Antonio de Marvao , Declan P. O'Regan , Daniel Rueckert , Jinming Duan

Surgical navigation based on multimodal image registration has played a significant role in providing intraoperative guidance to surgeons by showing the relative position of the target area to critical anatomical structures during surgery.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiazheng Wang , Zeyu Liu , Min Liu , Xiang Chen , Xinyao Yu , Yaonan Wang , Hang Zhang

Medical image registration is a fundamental task in medical image analysis, aiming to establish spatial correspondences between paired images. However, existing unsupervised deformable registration methods rely solely on intensity-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hao Xu , Tengfei Xue , Jianan Fan , Dongnan Liu , Yuqian Chen , Fan Zhang , Carl-Fredrik Westin , Ron Kikinis , Lauren J. O'Donnell , Weidong Cai

Extreme low-data fine-grained classification is common in expert domains where labeling is expensive, yet practitioners still need principled guidance for selecting pretrained encoders. We study emerald inclusion grading with a custom…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Alexander Hackett , Srikanth Thudumu , Ginny Fisher , Jason Fisher

Deformation field estimation is an important and challenging issue in many medical image registration applications. In recent years, deep learning technique has become a promising approach for simplifying registration problems, and has been…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Yujia Zhou , Shumao Pang , Jun Cheng , Yuhang Sun , Yi Wu , Lei Zhao , Yaqin Liu , Zhentai Lu , Wei Yang , Qianjin Feng

We present a diffeomorphic image registration algorithm to learn spatial transformations between pairs of images to be registered using fully convolutional networks (FCNs) under a self-supervised learning setting. The network is trained to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Hongming Li , Yong Fan

The substantial modality-induced variations in radiometric, texture, and structural characteristics pose significant challenges for the accurate registration of multimodal images. While supervised deep learning methods have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Xiaochen Wei , Weiwei Guo , Wenxian Yu

We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

Most existing deep learning-based registration methods are trained on single-type images to address same-domain tasks.However, cross-domain deformable registration remains challenging.We argue that the tailor-made matching criteria in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhuoyuan Wang , Haiqiao Wang , Yi Wang

Multimodal learning, while contributing to numerous success stories across various fields, faces the challenge of prohibitively expensive manual annotation. To address the scarcity of annotated data, a popular solution is unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jun Sun , Xinxin Zhang , Simin Hong , Jian Zhu , Xiang Gao

Co-registration of multimodal remote sensing images is still an ongoing challenge because of nonlinear radiometric differences (NRD) and significant geometric distortions (e.g., scale and rotation changes) between these images. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuanxin Ye , Bai Zhu , Tengfeng Tang , Chao Yang , Qizhi Xu , Guo Zhang

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner

We introduce HyperMorph, a framework that facilitates efficient hyperparameter tuning in learning-based deformable image registration. Classical registration algorithms perform an iterative pair-wise optimization to compute a deformation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Andrew Hoopes , Malte Hoffmann , Douglas N. Greve , Bruce Fischl , John Guttag , Adrian V. Dalca

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

The combination of transformers and masked image modeling (MIM) pre-training framework has shown great potential in various vision tasks. However, the pre-training computational budget is too heavy and withholds the MIM from becoming a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Yunhe Wang , Chang Xu

Parameter-efficient adaptation of pretrained vision models is commonly performed through linear probes, prompts, low-rank updates, or lightweight residual modules. While effective, these methods usually treat adaptation as a discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Salim Khazem , Ibrahim Mohamed Serouis , Zakaria Ezzahed

Many applications, such as autonomous driving, heavily rely on multi-modal data where spatial alignment between the modalities is required. Most multi-modal registration methods struggle computing the spatial correspondence between the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Moab Arar , Yiftach Ginger , Dov Danon , Ilya Leizerson , Amit Bermano , Daniel Cohen-Or

Medical imaging tasks are very challenging due to the lack of publicly available labeled datasets. Hence, it is difficult to achieve high performance with existing deep-learning models as they require a massive labeled dataset to be trained…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Anubhav Gupta , Islam Osman , Mohamed S. Shehata , John W. Braun

Complicated image registration is a key issue in medical image analysis, and deep learning-based methods have achieved better results than traditional methods. The methods include ConvNet-based and Transformer-based methods. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Runshi Zhang , Hao Mo , Junchen Wang , Bimeng Jie , Yang He , Nenghao Jin , Liang Zhu