English
Related papers

Related papers: Adapting Frozen Mono-modal Backbones for Multi-mod…

200 papers

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

This paper presents DeepFLASH, a novel network with efficient training and inference for learning-based medical image registration. In contrast to existing approaches that learn spatial transformations from training data in the high…

Image and Video Processing · Electrical Eng. & Systems 2020-04-07 Jian Wang , Miaomiao Zhang

We present deformable unsupervised medical image registration using a randomly-initialized deep convolutional neural network (CNN) as regularization prior. Conventional registration methods predict a transformation by minimizing…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

Pretrain techniques, whether supervised or self-supervised, are widely used in deep learning to enhance model performance. In real-world clinical scenarios, different sets of magnetic resonance (MR) contrasts are often acquired for…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

In breast surgical planning, accurate registration of MR images across patient positions has the potential to improve the localisation of tumours during breast cancer treatment. While learning-based registration methods have recently become…

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Peirong Liu , Oula Puonti , Xiaoling Hu , Daniel C. Alexander , Juan E. Iglesias

To accurately analyze changes of anatomical structures in longitudinal imaging studies, consistent segmentation across multiple time-points is required. Existing solutions often involve independent registration and segmentation components.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-28 Bo Li , Wiro Niessen , Stefan Klein , Marius de Groot , Arfan Ikram , Meike Vernooij , Esther Bron

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong

In medical imaging, the heterogeneity of multi-centre data impedes the applicability of deep learning-based methods and results in significant performance degradation when applying models in an unseen data domain, e.g. a new centreor a new…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Hongwei Li , Timo Loehr , Anjany Sekuboyina , Jianguo Zhang , Benedikt Wiestler , Bjoern Menze

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Deep learning (DL) image registration methods amortize the costly pair-wise iterative optimization by training deep neural networks to predict the optimal transformation in one fast forward-pass. In this work, we bridge the gap between…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Huaqi Qiu , Kerstin Hammernik , Chen Qin , Chen Chen , Daniel Rueckert

The clinical integration of deep learning models for brain tumor diagnosis in neuro-oncology is severely constrained by limited expert-annotated MRI data and substantial inter-institutional domain shift arising from variations in scanners,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Sapna Sachan , Amulya Kumar Mahto , Prashant Wagambar Patil

Deep learning has shown remarkable performance in medical image segmentation. However, despite its promise, deep learning has many challenges in practice due to its inability to effectively transition to unseen domains, caused by the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Dewei Hu , Hao Li , Han Liu , Jiacheng Wang , Xing Yao , Daiwei Lu , Ipek Oguz

Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade. The initial developments, such as regression-based and U-Net-based networks, established the foundation for deep learning in…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Junyu Chen , Yihao Liu , Shuwen Wei , Zhangxing Bian , Shalini Subramanian , Aaron Carass , Jerry L. Prince , Yong Du

CT and MRI are two of the most informative modalities in spinal diagnostics and treatment planning. CT is useful when analysing bony structures, while MRI gives information about the soft tissue. Thus, fusing the information of both…

Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a monomodal one.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje

Domain shift presents a significant challenge in applying Deep Learning to the segmentation of 3D medical images from sources like Magnetic Resonance Imaging (MRI) and Computed Tomography (CT). Although numerous Domain Adaptation methods…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Boris Shirokikh , Anvar Kurmukov , Mariia Donskova , Valentin Samokhin , Mikhail Belyaev , Ivan Oseledets

Multiparametric mapping MRI has become a viable tool for myocardial tissue characterization. However, misalignment between multiparametric maps makes pixel-wise analysis challenging. To address this challenge, we developed a generalizable…

Image and Video Processing · Electrical Eng. & Systems 2025-10-31 Xinqi Li , Yi Zhang , Li-Ting Huang , Hsiao-Huang Chang , Thoralf Niendorf , Min-Chi Ku , Qian Tao , Hsin-Jung Yang

Deep learning has shown significant value in medical image registration for motion correction, however, current techniques are either limited by the type and range of motion they can handle, or require iterative inference and/or retraining…

Image and Video Processing · Electrical Eng. & Systems 2026-05-04 Jian Wang , Razieh Faghihpirayesh , Danny Joca , Polina Golland , Ali Gholipour

A unified representation space in multi-modal learning is essential for effectively integrating diverse data sources, such as text, images, and audio, to enhance efficiency and performance across various downstream tasks. Recent binding…

Machine Learning · Computer Science 2025-10-08 Minoh Jeong , Zae Myung Kim , Min Namgung , Dongyeop Kang , Yao-Yi Chiang , Alfred Hero