English
Related papers

Related papers: Adapting Frozen Mono-modal Backbones for Multi-mod…

200 papers

We tackle here the problem of multimodal image non-rigid registration, which is of prime importance in remote sensing and medical imaging. The difficulties encountered by classical registration approaches include feature design and slow…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Armand Zampieri , Guillaume Charpiat , Yuliya Tarabalka

Radiological analysis increasingly benefits from pretrained visual representations that can support heterogeneous downstream tasks across imaging modalities. In this work, we introduce OmniRad, a self-supervised radiological foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Luca Zedda , Andrea Loddo , Cecilia Di Ruberto

Deformable image registration is able to achieve fast and accurate alignment between a pair of images and thus plays an important role in many medical image studies. The current deep learning (DL)-based image registration approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Xinke Ma , Yibo Yang , Yong Xia , Dacheng Tao

Affine registration is indispensable in a comprehensive medical image registration pipeline. However, only a few studies focus on fast and robust affine registration algorithms. Most of these studies utilize convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tony C. W. Mok , Albert C. S. Chung

Image registration is used in many medical image analysis applications, such as tracking the motion of tissue in cardiac images, where cardiac kinematics can be an indicator of tissue health. Registration is a challenging problem for deep…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Benjamin Graham

Multi-modal image registration is a crucial pre-processing step in many medical applications. However, it is a challenging task due to the complex intensity relationships between different imaging modalities, which can result in large…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Vasiliki Sideri-Lampretsa , Veronika A. Zimmer , Huaqi Qiu , Georgios Kaissis , Daniel Rueckert

Tracking microsctructural changes in the developing brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Irina Grigorescu , Alena Uus , Daan Christiaens , Lucilio Cordero-Grande , Jana Hutter , A. David Edwards , Joseph V. Hajnal , Marc Modat , Maria Deprez

Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Yexing Hu , Berkan Lafci , Artur Luzgin , Hao Wang , Jan Klohs , Xose Luis Dean-Ben , Ruiqing Ni , Daniel Razansky , Wuwei Ren

Objective: In medical imaging, it is often crucial to accurately assess and correct movement during image-guided therapy. Deformable image registration (DIR) consists in estimating the required spatial transformation to align a moving image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Eloïse Inacio , Luc Lafitte , Laurent Facq , Clair Poignard , Baudouin Denis de Senneville

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Accurate image registration is essential in many medical imaging applications, yet most deep registration networks provide little indication of when or where their predictions are unreliable. Existing uncertainty estimation approaches, such…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Lin Tian , Xiaoling Hu , Juan Eugenio Iglesias

Proton therapy offers superior organ-at-risk sparing but is highly sensitive to anatomical changes, making accurate deformable image registration (DIR) across longitudinal CT scans essential. Conventional DIR methods are often too slow for…

In the context of medical imaging and machine learning, one of the most pressing challenges is the effective adaptation of pre-trained models to specialized medical contexts. Despite the availability of advanced pre-trained models, their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

Image registration is a critical component in the applications of various medical image analyses. In recent years, there has been a tremendous surge in the development of deep learning (DL)-based medical image registration models. This…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Subrato Bharati , M. Rubaiyat Hossain Mondal , Prajoy Podder , V. B. Surya Prasath

Deep learning based methods provide efficient solutions to medical image registration, including the challenging problem of diffeomorphic image registration. However, most methods register normal image pairs, facing difficulty handling…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Ankita Joshi , Yi Hong

Recent deep learning-based methods have shown promising results and runtime advantages in deformable image registration. However, analyzing the effects of hyperparameters and searching for optimal regularization parameters prove to be too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Tony C. W. Mok , Albert C. S. Chung

Registration plays an important role in medical image analysis. Deep learning-based methods have been studied for medical image registration, which leverage convolutional neural networks (CNNs) for efficiently regressing a dense deformation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Xiaoru Gao , GuoYan Zheng

Purpose: This study aims to explore training strategies to improve convolutional neural network-based image-to-image deformable registration for abdominal imaging. Methods: Different training strategies, loss functions, and transfer…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Javier Pérez de Frutos , André Pedersen , Egidijus Pelanis , David Bouget , Shanmugapriya Survarachakan , Thomas Langø , Ole-Jakob Elle , Frank Lindseth

Ultrasound imaging is a cost-effective and radiation-free modality for visualizing anatomical structures in real-time, making it ideal for guiding surgical interventions. However, its limited field-of-view, speckle noise, and imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-04-26 Remi Delaunay , Ruisi Zhang , Filipe C. Pedrosa , Navid Feizi , Dianne Sacco , Rajni Patel , Jayender Jagadeesan

To achieve accurate and robust object detection in the real-world scenario, various forms of images are incorporated, such as color, thermal, and depth. However, multimodal data often suffer from the position shift problem, i.e., the image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Lu Zhang , Zhiyong Liu , Xiangyu Zhu , Zhan Song , Xu Yang , Zhen Lei , Hong Qiao