English
Related papers

Related papers: Representation Disentanglement for Multi-modal bra…

200 papers

Federated learning enables multiple hospitals to cooperatively learn a shared model without privacy disclosure. Existing methods often take a common assumption that the data from different hospitals have the same modalities. However, such a…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yunlu Yan , Hong Wang , Yawen Huang , Nanjun He , Lei Zhu , Yuexiang Li , Yong Xu , Yefeng Zheng

Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Agisilaos Chartsias , Thomas Joyce , Giorgos Papanastasiou , Michelle Williams , David Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Representation learning constitutes a pivotal cornerstone in contemporary deep learning paradigms, offering a conduit to elucidate distinctive features within the latent space and interpret the deep models. Nevertheless, the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Siyuan Dai , Kai Ye , Kun Zhao , Ge Cui , Haoteng Tang , Liang Zhan

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Magnetic resonance imaging (MRI) is an invaluable tool for clinical and research applications. Yet, variations in scanners and acquisition parameters cause inconsistencies in image contrast, hindering data comparability and reproducibility…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Robbie Holland , Viktoria Ehm , Jan C. Peeken , Benedikt Wiestler , Daniel Rueckert

The intricate morphology of brain vessels poses significant challenges for automatic segmentation models, which usually focus on a single imaging modality. However, accurately treating brain-related conditions requires a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Francesco Galati , Daniele Falcetta , Rosa Cortese , Ferran Prados , Ninon Burgos , Maria A. Zuluaga

A disentangled representation encodes information about the salient factors of variation in the data independently. Although it is often argued that this representational format is useful in learning to solve many real-world down-stream…

Machine Learning · Computer Science 2020-01-08 Sjoerd van Steenkiste , Francesco Locatello , Jürgen Schmidhuber , Olivier Bachem

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

In medical imaging, most of the image registration methods implicitly assume a one-to-one correspondence between the source and target images (i.e., diffeomorphism). However, this is not necessarily the case when dealing with pathological…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Matthis Maillard , Anton François , Joan Glaunès , Isabelle Bloch , Pietro Gori

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

We propose a fully unsupervised multi-modal deformable image registration method (UMDIR), which does not require any ground truth deformation fields or any aligned multi-modal image pairs during training. Multi-modal registration is a key…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Chen Qin , Bibo Shi , Rui Liao , Tommaso Mansi , Daniel Rueckert , Ali Kamen

Integrating the brain structural and functional connectivity features is of great significance in both exploring brain science and analyzing cognitive impairment clinically. However, it remains a challenge to effectively fuse structural and…

Neurons and Cognition · Quantitative Biology 2023-05-25 Qiankun Zuo , Baiying Lei , Ning Zhong , Yi Pan , Shuqiang Wang

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Neurophysiological decoding, fundamental to advancing brain-computer interface (BCI) technologies, has significantly benefited from recent advances in deep learning. However, existing decoding approaches largely remain constrained to…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Di Wu , Yifei Jia , Siyuan Li , Shiqi Zhao , Jie Yang , Mohamad Sawan

In medical vision, different imaging modalities provide complementary information. However, in practice, not all modalities may be available during inference or even training. Previous approaches, e.g., knowledge distillation or image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Aishik Konwer , Xiaoling Hu , Joseph Bae , Xuan Xu , Chao Chen , Prateek Prasanna

Deep learning holds immense promise for transforming medical image analysis, yet its clinical generalization remains profoundly limited. A major barrier is data heterogeneity. This is particularly true in Magnetic Resonance Imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Mehmet Yigit Avci , Pedro Borges , Virginia Fernandez , Paul Wright , Mehmet Yigitsoy , Sebastien Ourselin , Jorge Cardoso

We propose a hierarchically structured variational inference model for accurately disentangling observable evidence of disease (e.g. brain lesions or atrophy) from subject-specific anatomy in brain MRIs. With flexible, partially…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Anjun Hu , Jean-Pierre R. Falet , Brennan S. Nichyporuk , Changjian Shui , Douglas L. Arnold , Sotirios A. Tsaftaris , Tal Arbel

Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Maren Awiszus , Hanno Ackermann , Bodo Rosenhahn