English
Related papers

Related papers: Toward Effective Multimodal Graph Foundation Model…

200 papers

Graph-based models have emerged as a powerful paradigm for modeling multimodal urban data and learning region representations for various downstream tasks. However, existing approaches face two major limitations. (1) They typically employ…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yaya Zhao , Kaiqi Zhao , Zixuan Tang , Zhiyuan Liu , Xiaoling Lu , Yalei Du

Graph-based retrieval-augmented generation (GraphRAG) exploits structured knowledge to support knowledge-intensive reasoning. However, most existing methods treat graphs as intermediate artifacts, and the few subgraph-based retrieval…

Information Retrieval · Computer Science 2026-03-10 Haonan Yuan , Qingyun Sun , Junhua Shi , Mingjun Liu , Jiaqi Yuan , Ziwei Zhang , Xingcheng Fu , Jianxin Li

While foundation models have revolutionized such fields as natural language processing and computer vision, their potential in graph machine learning remains largely unexplored. One of the key challenges in designing graph foundation models…

Machine Learning · Computer Science 2025-09-24 Dmitry Eremeev , Gleb Bazhenov , Oleg Platonov , Artem Babenko , Liudmila Prokhorenkova

Recently, multimodal graph learning (MGL) has garnered significant attention for integrating diverse modality information and structured context to support various network applications. However, real-world graphs are often isolated due to…

Machine Learning · Computer Science 2026-05-14 Sirui Zhang , Haonan Wang , Xunkai Li , Zekai Chen , Shumeng Li , Hongchao Qin , Rong-Hua Li , Guoren Wang

Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis. Recently, Graph Neural Networks (GNNs) have become…

Neurons and Cognition · Quantitative Biology 2022-05-25 Yanqiao Zhu , Hejie Cui , Lifang He , Lichao Sun , Carl Yang

Graph machine learning has made significant strides in recent years, yet the integration of visual information with graph structure and its potential for improving performance in downstream tasks remains an underexplored area. To address…

Machine Learning · Computer Science 2025-04-01 Jing Zhu , Yuhang Zhou , Shengyi Qian , Zhongmou He , Tong Zhao , Neil Shah , Danai Koutra

Inspired by the remarkable success of foundation models in language and vision, Graph Foundation Models (GFMs) hold significant promise for broad applicability across diverse graph tasks and domains. However, existing GFMs struggle with…

Machine Learning · Computer Science 2025-11-11 Haonan Yuan , Qingyun Sun , Junhua Shi , Xingcheng Fu , Bryan Hooi , Jianxin Li , Philip S. Yu

Graph foundation models (GFMs) have recently gained significant attention. However, the unique data processing and evaluation setups employed by different studies hinder a deeper understanding of their progress. Additionally, current…

Code clone detection is a fundamental task in software engineering that underpins refactoring, debugging, plagiarism detection, and vulnerability analysis. Existing methods often rely on singular representations such as abstract syntax…

Software Engineering · Computer Science 2025-10-29 Zixian Zhang , Takfarinas Saber

Multimodal recommendation enhances ranking by integrating user-item interactions with item content, which is particularly effective under sparse feedback and long-tail distributions. However, multimodal signals are inherently heterogeneous…

Artificial Intelligence · Computer Science 2026-02-27 Ji Dai , Quan Fang , Dengsheng Cai

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph…

Multimedia · Computer Science 2023-12-05 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Real-world multimodal data usually exhibit complex structural relationships beyond traditional one-to-one mappings like image-caption pairs. Entities across modalities interact in intricate ways, with images and text forming diverse…

Machine Learning · Computer Science 2025-10-21 Xuying Ning , Dongqi Fu , Tianxin Wei , Wujiang Xu , Jingrui He

Synthesizing multimodality medical data provides complementary knowledge and helps doctors make precise clinical decisions. Although promising, existing multimodal brain graph synthesis frameworks have several limitations. First, they…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Islem Mhiri , Mohamed Ali Mahjoub , Islem Rekik

Foundation models excel at language, where sentences become tokens, and vision, where images become pixels, because both reduce to discrete symbols on a shared, fixed grid. Knowledge Graphs share the discreteness, but not the geometry.…

Artificial Intelligence · Computer Science 2026-05-08 Kossi Amouzouvi , Robert Wardenga , Jens Lehmann , Sahar Vahdati

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Integrating Pre-trained Language Models (PLMs) with Graph Neural Networks (GNNs) remains a central challenge in text-rich heterophilic graph learning. We propose a novel integration framework that enables effective fusion between powerful…

Computation and Language · Computer Science 2025-10-09 Aarush Sinha

Multimodal alignment is commonly learned from isolated image-text pairs via CLIP-style dual encoders, leaving the relational context among entities largely unused. Multimodal attributed graphs (MAGs), where nodes carry multimodal attributes…

Machine Learning · Computer Science 2026-05-18 Xu Wang , Xunkai Li , Yinlin Zhu , Rong-Hua Li , Guoren Wang

A large number of real-world graphs or networks are inherently heterogeneous, involving a diversity of node types and relation types. Heterogeneous graph embedding is to embed rich structural and semantic information of a heterogeneous…

Social and Information Networks · Computer Science 2020-04-01 Xinyu Fu , Jiani Zhang , Ziqiao Meng , Irwin King