English

Learning on Multimodal Graphs: A Survey

Machine Learning 2024-02-09 v1 Artificial Intelligence Graphics Social and Information Networks

Abstract

Multimodal data pervades various domains, including healthcare, social media, and transportation, where multimodal graphs play a pivotal role. Machine learning on multimodal graphs, referred to as multimodal graph learning (MGL), is essential for successful artificial intelligence (AI) applications. The burgeoning research in this field encompasses diverse graph data types and modalities, learning techniques, and application scenarios. This survey paper conducts a comparative analysis of existing works in multimodal graph learning, elucidating how multimodal learning is achieved across different graph types and exploring the characteristics of prevalent learning techniques. Additionally, we delineate significant applications of multimodal graph learning and offer insights into future directions in this domain. Consequently, this paper serves as a foundational resource for researchers seeking to comprehend existing MGL techniques and their applicability across diverse scenarios.

Keywords

Cite

@article{arxiv.2402.05322,
  title  = {Learning on Multimodal Graphs: A Survey},
  author = {Ciyuan Peng and Jiayuan He and Feng Xia},
  journal= {arXiv preprint arXiv:2402.05322},
  year   = {2024}
}

Comments

9 pages, 1 figure

R2 v1 2026-06-28T14:42:21.155Z