English
Related papers

Related papers: Heterogeneous Graph Learning for Multi-modal Medic…

200 papers

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Accurate forecasting and analysis of emerging pandemics play a crucial role in effective public health management and decision-making. Traditional approaches primarily rely on epidemiological data, overlooking other valuable sources of…

Machine Learning · Computer Science 2023-10-24 Khanh-Tung Tran , Truong Son Hy , Lili Jiang , Xuan-Son Vu

Multimodal graphs, which integrate unstructured heterogeneous data with structured interconnections, offer substantial real-world utility but remain insufficiently explored in unsupervised learning. In this work, we initiate the study of…

Artificial Intelligence · Computer Science 2025-07-22 Zhaochen Guo , Zhixiang Shen , Xuanting Xie , Liangjian Wen , Zhao Kang

In this paper, we propose MGNet, a simple and effective multiplex graph convolutional network (GCN) model for multimodal brain network analysis. The proposed method integrates tensor representation into the multiplex GCN model to extract…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Zhaoming Kong , Lichao Sun , Hao Peng , Liang Zhan , Yong Chen , Lifang He

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called…

Machine Learning · Computer Science 2023-10-05 Tianyu Liu , Yuge Wang , Rex Ying , Hongyu Zhao

We investigate the problem of multiplex graph embedding, that is, graphs in which nodes interact through multiple types of relations (dimensions). In recent years, several methods have been developed to address this problem. However, the…

Machine Learning · Computer Science 2023-12-29 Kamel Abdous , Nairouz Mrabah , Mohamed Bouguessa

With the arrival of the big data era, more and more data are becoming readily available in various real-world applications and those data are usually highly heterogeneous. Taking computational medicine as an example, we have both Electronic…

Machine Learning · Computer Science 2019-05-08 Xi Sheryl Zhang , Jingyuan Chou , Fei Wang

This paper presents a Tri-branch Neural Fusion (TNF) approach designed for classifying multimodal medical images and tabular data. It also introduces two solutions to address the challenge of label inconsistency in multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Tong Zheng , Shusaku Sone , Yoshitaka Ushiku , Yuki Oba , Jiaxin Ma

Artificial intelligence for graphs has achieved remarkable success in modeling complex systems, ranging from dynamic networks in biology to interacting particle systems in physics. However, the increasingly heterogeneous graph datasets call…

Machine Learning · Computer Science 2023-01-25 Yasha Ektefaie , George Dasoulas , Ayush Noori , Maha Farhat , Marinka Zitnik

With the rapid development of biomedical software and hardware, a large amount of relational data interlinking genes, proteins, chemical components, drugs, diseases, and symptoms has been collected for modern biomedical research. Many…

Artificial Intelligence · Computer Science 2021-01-21 Yankai Chen , Yaozu Wu , Shicheng Ma , Irwin King

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Detailed phenotype information is fundamental to accurate diagnosis and risk estimation of diseases. As a rich source of phenotype information, electronic health records (EHRs) promise to empower diagnostic variant interpretation. However,…

Machine Learning · Computer Science 2023-04-28 Shenghan Zhang , Haoxuan Li , Ruixiang Tang , Sirui Ding , Laila Rasmy , Degui Zhi , Na Zou , Xia Hu

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Integrating heterogeneous biomedical data including imaging, omics, and clinical records supports accurate diagnosis and personalised care. Graph-based models fuse such non-Euclidean data by capturing spatial and relational structure, yet…

Genomics · Quantitative Biology 2025-05-06 Alireza Sadeghi , Farshid Hajati , Ahmadreza Argha , Nigel H Lovell , Min Yang , Hamid Alinejad-Rokny

Electronic health records (EHRs) are designed to synthesize diverse data types, including unstructured clinical notes, structured lab tests, and time-series visit data. Physicians draw on these multimodal and temporal sources of EHR data to…

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

Medical deep learning models depend heavily on domain-specific knowledge to perform well on knowledge-intensive clinical tasks. Prior work has primarily leveraged unimodal knowledge graphs, such as the Unified Medical Language System…

Artificial Intelligence · Computer Science 2025-05-26 Xiaochen Wang , Yuan Zhong , Lingwei Zhang , Lisong Dai , Ting Wang , Fenglong Ma

Medical data collected for diagnostic decisions are typically multimodal, providing comprehensive information on a subject. While computer-aided diagnosis systems can benefit from multimodal inputs, effectively fusing such data remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Qiuhui Chen , Yi Hong

Aiming at the limitations of traditional medical decision system in processing large-scale heterogeneous medical data and realizing highly personalized recommendation, this paper introduces a personalized medical decision algorithm…

Machine Learning · Computer Science 2024-05-29 Yafeng Yan , Shuyao He , Zhou Yu , Jiajie Yuan , Ziang Liu , Yan Chen

Intracranial Hemorrhage is a potentially lethal condition whose manifestation is vastly diverse and shifts across clinical centers worldwide. Deep-learning-based solutions are starting to model complex relations between brain structures,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Antoine P. Sanner , Jonathan Stieber , Nils F. Grauhan , Suam Kim , Marc A. Brockmann , Ahmed E. Othman , Anirban Mukhopadhyay