English
Related papers

Related papers: Towards Personalized Multi-Modal MRI Synthesis acr…

200 papers

Accurate brain tumor segmentation is essential for preoperative evaluation and personalized treatment. Multi-modal MRI is widely used due to its ability to capture complementary tumor features across different sequences. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shenghao Zhu , Yifei Chen , Weihong Chen , Shuo Jiang , Guanyu Zhou , Yuanhan Wang , Feiwei Qin , Changmiao Wang , Qiyuan Tian

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Cross-modality magnetic resonance (MR) image synthesis can be used to generate missing modalities from given ones. Existing (supervised learning) methods often require a large number of paired multi-modal data to train an effective…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Yonghao Li , Tao Zhou , Kelei He , Yi Zhou , Dinggang Shen

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

We present seg2med, a modular framework for anatomy-driven multimodal medical image synthesis. The system integrates three components to enable high-fidelity, cross-modality generation of CT and MR images based on structured anatomical…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Zeyu Yang , Zhilin Chen , Yipeng Sun , Anika Strittmatter , Anish Raj , Ahmad Allababidi , Johann S. Rink , Frank G. Zöllner

Multi-modal magnetic resonance imaging (MRI) provides information of lesions for computer-aided diagnosis from different views. Deep learning algorithms are suitable for identifying specific anatomical structures, segmenting lesions, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Linxuan Han , Sa Xiao , Zimeng Li , Haidong Li , Xiuchao Zhao , Yeqing Han , Fumin Guo , Xin Zhou

Multi-site MRI studies often suffer from site-specific variations arising from differences in methodology, hardware, and acquisition protocols, thereby compromising accuracy and reliability in clinical AI/ML tasks. We present PRISM…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Sarang Galada , Tanurima Halder , Kunal Deo , Ram P Krish , Kshitij Jadhav

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Multimodal physiological signals, such as EEG, ECG, EOG, and EMG, are crucial for healthcare and brain-computer interfaces. While existing methods rely on specialized architectures and dataset-specific fusion strategies, they struggle to…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Wei-Bang Jiang , Xi Fu , Yi Ding , Cuntai Guan

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Ultra-low-field (ULF) MRI offers portable and accessible neuroimaging but suffers from reduced signal-to-noise ratio and limited spatial resolution compared to high-field (HF) systems. Acquiring paired ULF-HF data for supervised enhancement…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Toufiq Musah , Salvatore Calcagno , Federica Proietto Salanitri , Xiaomeng Li , Maruf Adewole , Marawan Elbatel

In this paper, we propose SimMLM, a simple yet powerful framework for multimodal learning with missing modalities. Unlike existing approaches that rely on sophisticated network architectures or complex data imputation techniques, SimMLM…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sijie Li , Chen Chen , Jungong Han

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the…

Machine Learning · Computer Science 2023-01-30 Can Cui , Haichun Yang , Yaohong Wang , Shilin Zhao , Zuhayr Asad , Lori A. Coburn , Keith T. Wilson , Bennett A. Landman , Yuankai Huo

Multimodal Federated Learning (MFL) has emerged as a promising approach for collaboratively training multimodal models across distributed clients, particularly in healthcare domains. In the context of brain imaging analysis, modality…

Image and Video Processing · Electrical Eng. & Systems 2025-02-19 Xinpeng Wang , Rong Zhou , Han Xie , Xiaoying Tang , Lifang He , Carl Yang

With the increasing availability of diverse data types, particularly images and time series data from medical experiments, there is a growing demand for techniques designed to combine various modalities of data effectively. Our motivation…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Ali Rasekh , Reza Heidari , Amir Hosein Haji Mohammad Rezaie , Parsa Sharifi Sedeh , Zahra Ahmadi , Prasenjit Mitra , Wolfgang Nejdl

Magnetic resonance imaging (MRI) reconstruction is a fundamental task aimed at recovering high-quality images from undersampled or low-quality MRI data. This process enhances diagnostic accuracy and optimizes clinical applications. In…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Xiaoyan Kui , Zijie Fan , Zexin Ji , Qinsong Li , Chengtao Liu , Weixin Si , Beiji Zou

Millimeter-wave (mmWave) radar has shown great potential for contactless, privacy-preserving, and robust human sensing, yet existing mmWave-based human mesh reconstruction (HMR) studies are still limited by the lack of benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Rongxiao Guo , Qingchao Chen

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

Synthetic cardiac MRI (CMRI) generation has emerged as a promising strategy to overcome the scarcity of annotated medical imaging data. Recent advances in GANs, VAEs, diffusion probabilistic models, and flow-matching techniques aim to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ishan Kumarasinghe , Dasuni Kawya , Madhura Edirisooriya , Isuri Devindi , Isuru Nawinne , Vajira Thambawita