English
Related papers

Related papers: Toward Effective Multimodal Graph Foundation Model…

200 papers

Recent advances in CV and NLP have inspired researchers to develop general-purpose graph foundation models through pre-training across diverse domains. However, a fundamental challenge arises from the substantial differences in graph…

Social and Information Networks · Computer Science 2025-06-02 Shuo Wang , Bokui Wang , Zhixiang Shen , Boyan Deng , Zhao Kang

Multimodal Attributed Graphs (MAGs) are ubiquitous in real-world applications, encompassing extensive knowledge through multimodal attributes attached to nodes (e.g., texts and images) and topological structure representing node…

Machine Learning · Computer Science 2025-02-28 Hao Yan , Chaozhuo Li , Jun Yin , Zhigang Yu , Weihao Han , Mingzheng Li , Zhengxin Zeng , Hao Sun , Senzhang Wang

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only…

Computation and Language · Computer Science 2026-03-12 Xingtong Yu , Shenghua Ye , Ruijuan Liang , Chang Zhou , Hong Cheng , Xinming Zhang , Yuan Fang

Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode…

Machine Learning · Computer Science 2026-01-27 Haonan Yuan , Qingyun Sun , Jiacheng Tao , Xingcheng Fu , Jianxin Li

Existing foundation models, such as CLIP, aim to learn a unified embedding space for multimodal data, enabling a wide range of downstream web-based applications like search, recommendation, and content classification. However, these models…

Machine Learning · Computer Science 2025-04-28 Yufei He , Yuan Sui , Xiaoxin He , Yue Liu , Yifei Sun , Bryan Hooi

Graph Foundation Models (GFMs) are emerging as a significant research topic in the graph domain, aiming to develop graph models trained on extensive and diverse data to enhance their applicability across various tasks and domains.…

Machine Learning · Computer Science 2024-06-03 Haitao Mao , Zhikai Chen , Wenzhuo Tang , Jianan Zhao , Yao Ma , Tong Zhao , Neil Shah , Mikhail Galkin , Jiliang Tang

The growing interests and applications of graph learning in diverse domains have propelled the development of a unified model generalizing well across different graphs and tasks, known as the Graph Foundation Model (GFM). Existing research…

Machine Learning · Computer Science 2025-06-17 Trung-Kien Nguyen , Heng Ping , Shixuan Li , Peiyu Zhang , Nikos Kanakaris , Nicholas Kotov , Paul Bogdan

Federated graph learning (FGL) enables collaborative training on graph data across multiple clients. As graph data increasingly contain multimodal node attributes such as text and images, multimodal federated graph learning (MM-FGL) has…

Machine Learning · Computer Science 2026-05-13 Zekai Chen , Xun Wu , Xunkai Li , Yihan Sun , Rong-Hua Li , Guoren Wang

The pretrain-transfer paradigm, which underpins the success of large language models (LLMs), has demonstrated the immense power of creating foundation models that learn generalizable representations from vast datasets. However, extending…

Machine Learning · Computer Science 2025-09-30 Yunhao Liang , Pujun Zhang , Yuan Qu , Shaochong Lin , Zuo-jun Max Shen

Foundation models have emerged as critical components in a variety of artificial intelligence applications, and showcase significant success in natural language processing and several other domains. Meanwhile, the field of graph machine…

Machine Learning · Computer Science 2025-03-11 Jiawei Liu , Cheng Yang , Zhiyuan Lu , Junze Chen , Yibo Li , Mengmei Zhang , Ting Bai , Yuan Fang , Lichao Sun , Philip S. Yu , Chuan Shi

Graph-structured data pervades domains such as social networks, biological systems, knowledge graphs, and recommender systems. While foundation models have transformed natural language processing, vision, and multimodal learning through…

Developing effective path representations has become increasingly essential across various fields within intelligent transportation. Although pre-trained path representation learning models have shown improved performance, they…

Machine Learning · Computer Science 2025-01-03 Ronghui Xu , Hanyin Cheng , Chenjuan Guo , Hongfan Gao , Jilin Hu , Sean Bin Yang , Bin Yang

In the realm of personalization, integrating diverse information sources such as consumption signals and content-based representations is becoming increasingly critical to build state-of-the-art solutions. In this regard, two of the biggest…

Information Retrieval · Computer Science 2024-03-13 Andreas Damianou , Francesco Fabbri , Paul Gigioli , Marco De Nadai , Alice Wang , Enrico Palumbo , Mounia Lalmas

Given the ubiquity of graph data and its applications in diverse domains, building a Graph Foundation Model (GFM) that can work well across different graphs and tasks with a unified backbone has recently garnered significant interests. A…

Machine Learning · Computer Science 2024-06-18 Zhikai Chen , Haitao Mao , Jingzhe Liu , Yu Song , Bingheng Li , Wei Jin , Bahare Fatemi , Anton Tsitsulin , Bryan Perozzi , Hui Liu , Jiliang Tang

Multimodal-attributed graphs (MAGs) are a fundamental data structure for multimodal graph learning (MGL), enabling both graph-centric and modality-centric tasks. However, our empirical analysis reveals inherent topology quality limitations…

Machine Learning · Computer Science 2026-03-31 Yinlin Zhu , Xunkai Li , Di Wu , Wang Luo , Miao Hu , Di Wu

Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity,…

Machine Learning · Computer Science 2025-11-17 Yinlin Zhu , Xunkai Li , Jishuo Jia , Miao Hu , Di Wu , Meikang Qiu

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. However, existing…

Artificial Intelligence · Computer Science 2026-01-21 Zhifei Li , Ziyue Qin , Xiangyu Luo , Xiaoju Hou , Yue Zhao , Miao Zhang , Zhifang Huang , Kui Xiao , Bing Yang

Knowledge graphs (KGs) play a key role in promoting various multimedia and AI applications. However, with the explosive growth of multi-modal information, traditional knowledge graph completion (KGC) models cannot be directly applied. This…

Multimedia · Computer Science 2025-05-29 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Chengfeng Dou , Yuanpeng He , Xuan Zhang , Haiyan Zhao

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu
‹ Prev 1 2 3 10 Next ›