English
Related papers

Related papers: Towards Personalized Multi-Modal MRI Synthesis acr…

200 papers

We propose a multimodal latent diffusion model that jointly synthesizes volumetric magnetic resonance imaging (MRI) and tabular clinical data within a shared latent space via cross-attention. This approach enables coherent joint…

Image and Video Processing · Electrical Eng. & Systems 2026-05-11 Daniel Mensing , Jan Kapar , Jochen G. Hirsch , Matthias Günther , Horst Hahn , Marvin N. Wright

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Magnetic resonance imaging (MRI) is indispensable for diagnosing and planning treatment in various medical conditions due to its ability to produce multi-series images that reveal different tissue characteristics. However, integrating these…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Churan Wang , Fei Gao , Lijun Yan , Siwen Wang , Yizhou Yu , Yizhou Wang

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

The primary challenges in visible-infrared person re-identification arise from the differences between visible (vis) and infrared (ir) images, including inter-modal and intra-modal variations. These challenges are further complicated by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jiarui Li , Zhen Qiu , Yilin Yang , Yuqi Li , Zeyu Dong , Chuanguang Yang

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice is missing MRI…

Image and Video Processing · Electrical Eng. & Systems 2025-06-04 Haowen Pang , Weiyan Guo , Chuyang Ye

Cross-modal medical image synthesis research focuses on reconstructing missing imaging modalities from available ones to support clinical diagnosis. Driven by clinical necessities for flexible modality reconstruction, we explore K to N…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Feng Yuan , Yifan Gao , Yuehua Ye , Haoyue Li , Xin Gao

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

MRI entails a great amount of cost, time and effort for the generation of all the modalities that are recommended for efficient diagnosis and treatment planning. Recent advancements in deep learning research show that generative models have…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Jaya Chandra Raju , Kompella Subha Gayatri , Keerthi Ram , Rajeswaran Rangasami , Rajoo Ramachandran , Mohansankar Sivaprakasam

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

Computation and Language · Computer Science 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Deep generative models have emerged as a transformative tool in medical imaging, offering substantial potential for synthetic data generation. However, recent empirical studies highlight a critical vulnerability: these models can memorize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Antonio Scardace , Lemuel Puglisi , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì

Neuroimaging consortia can enhance reliability and generalizability of findings by pooling data across studies to achieve larger sample sizes. To adjust for site and MRI protocol effects, imaging datasets are often harmonized based on…

Quantitative Methods · Quantitative Biology 2024-03-04 Shruti P. Gadewar , Alyssa H. Zhu , Iyad Ba Gari , Sunanda Somu , Sophia I. Thomopoulos , Paul M. Thompson , Talia M. Nir , Neda Jahanshad

Missing or corrupted modalities are common in physiological signal-based medical applications owing to hardware constraints or motion artifacts. However, most existing methods assume the availability of all modalities, resulting in…

Machine Learning · Computer Science 2025-10-14 Cheol-Hui Lee , Hwa-Yeon Lee , Min-Kyung Jung , Dong-Joo Kim

Magnetic resonance imaging (MRI) is a widely used radiological modality renowned for its radiation-free, comprehensive insights into the human body, facilitating medical diagnoses. However, the drawback of prolonged scan times hinders its…

Multi-modal brain MRI provides essential complementary information for clinical diagnosis. However, acquiring all modalities in practice is often constrained by time and cost. To address this, various methods have been proposed to generate…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Hanyeol Yang , Sunggyu Kim , Mi Kyung Kim , Yongseon Yoo , Yu-Mi Kim , Min-Ho Shin , Insung Chung , Sang Baek Koh , Hyeon Chang Kim , Jong-Min Lee

Multimodal sequential recommendation (MSR) leverages diverse item modalities to improve recommendation accuracy, while achieving effective and adaptive fusion remains challenging. Existing MSR models often overlook synergistic information…

Information Retrieval · Computer Science 2026-01-19 Xinyi Zhang , Yutong Li , Peijie Sun , Letian Sha , Zhongxuan Han

Multimodal MRI provides complementary and clinically relevant information to probe tissue condition and to characterize various diseases. However, it is often difficult to acquire sufficiently many modalities from the same subject due to…

Image and Video Processing · Electrical Eng. & Systems 2021-06-08 Xiaofeng Liu , Fangxu Xing , Georges El Fakhri , Jonghye Woo

Federated learning (FL) has become a promising paradigm for collaborative medical image analysis, yet existing frameworks remain tightly coupled to task-specific backbones and are fragile under heterogeneous imaging modalities. Such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Meilin Liu , Jiaying Wang , Jing Shan