中文
相关论文

相关论文: HyperFusion: A Hypernetwork Approach to Multimodal…

200 篇论文

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

图像与视频处理 · 电气工程与系统科学 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

机器学习 · 计算机科学 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis. Recently, Graph Neural Networks (GNNs) have become…

神经元与认知 · 定量生物学 2022-05-25 Yanqiao Zhu , Hejie Cui , Lifang He , Lichao Sun , Carl Yang

Breast cancer is a leading cause of cancer-related mortality worldwide, and timely accurate diagnosis is critical to improving survival outcomes. While convolutional neural networks (CNNs) have demonstrated strong performance on…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Aditya Shribhagwan Khandelwal , Mohammad Samar Ansari , Asra Aslam

Electronic Health Records (EHR) have been heavily used in modern healthcare systems for recording patients' admission information to hospitals. Many data-driven approaches employ temporal features in EHR for predicting specific diseases,…

机器学习 · 计算机科学 2021-12-07 Chang Lu , Chandan K. Reddy , Yue Ning

Accurate brain tumor classification is crucial in medical imaging to ensure reliable diagnosis and effective treatment planning. This study introduces a novel double ensembling framework that synergistically combines pre-trained deep…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Zahid Ullah , Jihie Kim

Alzheimers Disease (AD) is a progressive neurodegenerative disorder that poses significant challenges in its early diagnosis, often leading to delayed treatment and poorer outcomes for patients. Traditional diagnostic methods, typically…

机器学习 · 计算机科学 2025-08-06 Tatwadarshi P Nagarhalli , Sanket Patil , Vishal Pande , Uday Aswalekar , Prafulla Patil

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

图像与视频处理 · 电气工程与系统科学 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Multi-disease diagnosis using multi-modal data like electronic health records and medical imaging is a critical clinical task. Although existing deep learning methods have achieved initial success in this area, a significant gap persists…

多媒体 · 计算机科学 2025-09-22 Yueheng Jiang , Peng Zhang

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

机器学习 · 计算机科学 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Data fusion refers to the joint analysis of multiple datasets which provide complementary views of the same task. In this preprint, the problem of jointly analyzing electroencephalography (EEG) and functional Magnetic Resonance Imaging…

信号处理 · 电气工程与系统科学 2020-05-15 Christos Chatzichristos , Eleftherios Kofidis , Lieven De Lathauwer , Sergios Theodoridis , Sabine Van Huffel

Medical patient data is always multimodal. Images, text, age, gender, histopathological data are only few examples for different modalities in this context. Processing and integrating this multimodal data with deep learning based methods is…

人工智能 · 计算机科学 2025-09-11 Christian Gapp , Elias Tappeiner , Martin Welk , Rainer Schubert

Brain network analysis is a useful approach to studying human brain disorders because it can distinguish patients from healthy people by detecting abnormal connections. Due to the complementary information from multiple modal neuroimages,…

图像与视频处理 · 电气工程与系统科学 2023-08-22 Qiankun Zuo , Yanfei Zhu , Libin Lu , Zhi Yang , Yuhui Li , Ning Zhang

Early and accurate diagnosis of Alzheimer's disease (AD) remains a critical challenge in neuroimaging-based clinical decision support systems. In this work, we propose a novel hybrid deep learning framework that integrates Topological Data…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Faisal Ahmed

Accurate and early diagnosis of Alzheimer's disease (AD) is critical for effective intervention and requires integrating complementary information from multimodal neuroimaging data. However, conventional fusion approaches often rely on…

Gaining insights into the structural and functional mechanisms of the brain has been a longstanding focus in neuroscience research, particularly in the context of understanding and treating neuropsychiatric disorders such as Schizophrenia…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Badhan Mazumder , Lei Wu , Vince D. Calhoun , Dong Hye Ye

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

机器学习 · 计算机科学 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Computer-aided diagnosis (CAD) systems play a crucial role in analyzing neuroimaging data for neurological and psychiatric disorders. However, small-sample studies suffer from low reproducibility, while large-scale datasets introduce…

机器学习 · 计算机科学 2025-08-12 Xinglin Zhao , Yanwen Wang , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

机器学习 · 计算机科学 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo