English
Related papers

Related papers: AliFuse: Aligning and Fusing Multi-modal Medical D…

200 papers

Accurate diagnosis of Alzheimer's disease (AD) is essential for enabling timely intervention and slowing disease progression. Multimodal diagnostic approaches offer considerable promise by integrating complementary information across…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Yujie Nie , Jianzhang Ni , Yonglong Ye , Yuan-Ting Zhang , Yun Kwok Wing , Xiangqing Xu , Xin Ma , Lizhou Fan

Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Farshad G. Veshki , Nora Ouzir , Sergiy A. Vorobyov , Esa Ollila

The application of machine learning in medicine and healthcare has led to the creation of numerous diagnostic and prognostic models. However, despite their success, current approaches generally issue predictions using data from a single…

Machine Learning · Computer Science 2025-05-13 Fergus Imrie , Stefan Denner , Lucas S. Brunschwig , Klaus Maier-Hein , Mihaela van der Schaar

Healthcare data are inherently multimodal, including electronic health records (EHR), medical images, and multi-omics data. Combining these multimodal data sources contributes to a better understanding of human health and provides optimal…

Machine Learning · Computer Science 2022-10-28 Farida Mohsen , Hazrat Ali , Nady El Hajj , Zubair Shah

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Alzheimer's disease (AD) is a prevalent and debilitating neurodegenerative disorder impacting a large aging population. Detecting AD in all its presymptomatic and symptomatic stages is crucial for early intervention and treatment. An active…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yasmine Mustafa , Tie Luo

The prediction of mild cognitive impairment (MCI) conversion to Alzheimer's disease (AD) is important for early treatment to prevent or slow the progression of AD. To accurately predict the MCI conversion to stable MCI or progressive MCI,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Linfeng Liu , Junyan Lyu , Siyu Liu , Xiaoying Tang , Shekhar S. Chandra , Fatima A. Nasrallah

Electronic health records (EHRs) are multimodal by nature, consisting of structured tabular features like lab tests and unstructured clinical notes. In real-life clinical practice, doctors use complementary multimodal EHR data sources to…

Computation and Language · Computer Science 2024-07-18 Thao Minh Nguyen Phan , Cong-Tinh Dao , Chenwei Wu , Jian-Zhe Wang , Shun Liu , Jun-En Ding , David Restrepo , Feng Liu , Fang-Ming Hung , Wen-Chih Peng

Medical image classification has developed rapidly under the impetus of the convolutional neural network (CNN). Due to the fixed size of the receptive field of the convolution kernel, it is difficult to capture the global features of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-22 Xiangzuo Huo , Gang Sun , Shengwei Tian , Yan Wang , Long Yu , Jun Long , Wendong Zhang , Aolun Li

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Fusing structural-functional images of the brain has shown great potential to analyze the deterioration of Alzheimer's disease (AD). However, it is a big challenge to effectively fuse the correlated and complementary information from…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Qiankun Zuo , Junren Pan , Shuqiang Wang

We propose a novel framework for integrating fragmented multi-modal data in Alzheimer's disease (AD) research using large language models (LLMs) and knowledge graphs. While traditional multimodal analysis requires matched patient IDs across…

Machine Learning · Computer Science 2025-08-19 Kanan Kiguchi , Yunhao Tu , Katsuhiro Ajito , Fady Alnajjar , Kazuyuki Murase

The integration of multi-modal Magnetic Resonance Imaging (MRI) and clinical data holds great promise for enhancing the diagnosis of neurological disorders (NDs) in real-world clinical settings. Deep Learning (DL) has recently emerged as a…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Wajih Hassan Raza , Aamir Bader Shah , Yu Wen , Yidan Shen , Juan Diego Martinez Lemus , Mya Caryn Schiess , Timothy Michael Ellmore , Renjie Hu , Xin Fu

The automatic early diagnosis of prodromal stages of Alzheimer's disease is of great relevance for patient treatment to improve quality of life. We address this problem as a multi-modal classification task. Multi-modal data provides richer…

Alzheimer's Disease (AD) is an irreversible neurodegenerative disease characterized by progressive cognitive decline as its main symptom. In the research field of deep learning-assisted diagnosis of AD, traditional convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Yang Ming , Jiang Shi Zhong , Zhou Su Juan

The current clinical diagnosis framework of Alzheimer's disease (AD) involves multiple modalities acquired from multiple diagnosis stages, each with distinct usage and cost. Previous AD diagnosis research has predominantly focused on how to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuxiao Liu , Mianxin Liu , Yuanwang Zhang , Kaicong Sun , Dinggang Shen

Multimodal neuroimage can provide complementary information about the dementia, but small size of complete multimodal data limits the ability in representation learning. Moreover, the data distribution inconsistency from different…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Qiankun Zuo , Baiying Lei , Yanyan Shen , Yong Liu , Zhiguang Feng , Shuqiang Wang

Introspection of deep supervised predictive models trained on functional and structural brain imaging may uncover novel markers of Alzheimer's disease (AD). However, supervised training is prone to learning from spurious features (shortcut…

Machine Learning · Computer Science 2022-05-24 Alex Fedorov , Lei Wu , Tristan Sylvain , Margaux Luck , Thomas P. DeRamus , Dmitry Bleklov , Sergey M. Plis , Vince D. Calhoun

Multimodal fusion has emerged as a promising paradigm for disease diagnosis and prognosis, integrating complementary information from heterogeneous data sources such as medical images, clinical records, and radiology reports. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chongyu Qu , Zhengyi Lu , Yuxiang Lai , Thomas Z. Li , Junchao Zhu , Junlin Guo , Juming Xiong , Yanfan Zhu , Yuechen Yang , Allen J. Luna , Kim L. Sandler , Bennett A. Landman , Yuankai Huo