English
Related papers

Related papers: Text-space Graph Foundation Models: Comprehensive …

200 papers

Efficient traffic management is crucial for maintaining urban mobility, especially in densely populated areas where congestion, accidents, and delays can lead to frustrating and expensive commutes. However, existing prediction methods face…

Machine Learning · Computer Science 2023-05-25 Xuhong Wang , Ding Wang , Liang Chen , Yilun Lin

Foundation models (FMs) have emerged as a powerful paradigm, enabling a diverse range of data analytics and knowledge discovery tasks across scientific fields. Inspired by the success of FMs, particularly large language models, researchers…

Machine Learning · Computer Science 2025-11-27 Sean Bin Yang , Ying Sun , Yunyao Cheng , Yan Lin , Kristian Torp , Jilin Hu

Graph foundation models face several fundamental challenges including transferability across datasets and data scarcity, which calls into question the very feasibility of graph foundation models. However, despite similar challenges, the…

Machine Learning · Computer Science 2026-02-13 Dmitry Eremeev , Oleg Platonov , Gleb Bazhenov , Artem Babenko , Liudmila Prokhorenkova

Graph mining has become crucial in fields such as social science, finance, and cybersecurity. Many large-scale real-world networks exhibit both heterogeneity, where multiple node and edge types exist in the graph, and heterophily, where…

Machine Learning · Computer Science 2025-06-04 Junhong Lin , Xiaojie Guo , Shuaicheng Zhang , Yada Zhu , Julian Shun

World models (WMs) demonstrate strong capabilities in prediction, generation, and planning tasks. Existing WMs primarily focus on unstructured data and cannot leverage the ubiquitous structured data, often represented as graphs, in the…

Machine Learning · Computer Science 2025-07-15 Tao Feng , Yexin Wu , Guanyu Lin , Jiaxuan You

The remarkable success of large language models (LLMs) has motivated researchers to adapt them as universal predictors for various graph-related tasks, with the ultimate goal of developing a graph foundation model that generalizes diverse…

Computation and Language · Computer Science 2026-03-03 Zhongjian Zhang , Xiao Wang , Mengmei Zhang , Jiarui Tan , Chuan Shi

Graph machine learning has gained great attention in both academia and industry recently. Most of the graph machine learning models, such as Graph Neural Networks (GNNs), are trained over massive graph data. However, in many real-world…

Machine Learning · Computer Science 2022-10-19 Xingbo Fu , Binchi Zhang , Yushun Dong , Chen Chen , Jundong Li

Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity,…

Machine Learning · Computer Science 2025-11-17 Yinlin Zhu , Xunkai Li , Jishuo Jia , Miao Hu , Di Wu , Meikang Qiu

Graph machine learning has advanced rapidly in tasks such as link prediction, anomaly detection, and node classification. As models scale up, pretrained graph models have become valuable intellectual assets because they encode extensive…

Graph Transformers (GTs) have recently demonstrated remarkable performance across diverse domains. By leveraging attention mechanisms, GTs are capable of modeling long-range dependencies and complex structural relationships beyond local…

Machine Learning · Computer Science 2025-06-06 Jiachen Tang , Zhonghao Wang , Sirui Chen , Sheng Zhou , Jiawei Chen , Jiajun Bu

This work focuses on training graph foundation models (GFMs) that have strong generalization ability in graph-level tasks such as graph classification. Effective GFM training requires capturing information consistent across different…

Machine Learning · Computer Science 2026-03-10 Ziheng Sun , Qi Feng , Lehao Lin , Chris Ding , Jicong Fan

Multi-modal graphs, which integrate diverse multi-modal features and relations, are ubiquitous in real-world applications. However, existing multi-modal graph learning methods are typically trained from scratch for specific graph data and…

Machine Learning · Computer Science 2025-11-26 Xin Wang , Zeyang Zhang , Linxin Xiao , Haibo Chen , Chendi Ge , Wenwu Zhu

Despite advances in the field of Graph Neural Networks (GNNs), only a small number (~5) of datasets are currently used to evaluate new models. This continued reliance on a handful of datasets provides minimal insight into the performance…

Machine Learning · Computer Science 2022-07-11 John Palowitch , Anton Tsitsulin , Brandon Mayer , Bryan Perozzi

Graphs are able to model interconnected entities in many online services, supporting a wide range of applications on the Web. This raises an important question: How can we train a graph foundational model on multiple source domains and…

Computation and Language · Computer Science 2025-04-15 Xingtong Yu , Zechuan Gong , Chang Zhou , Yuan Fang , Hui Zhang

Although data that can be naturally represented as graphs is widespread in real-world applications across diverse industries, popular graph ML benchmarks for node property prediction only cover a surprisingly narrow set of data domains, and…

Machine Learning · Computer Science 2026-05-05 Gleb Bazhenov , Oleg Platonov , Liudmila Prokhorenkova

Graph embedding is the task of representing nodes of a graph in a low-dimensional space and its applications for graph tasks have gained significant traction in academia and industry. The primary difference among the many recently proposed…

Social and Information Networks · Computer Science 2019-08-28 Palash Goyal , Di Huang , Ankita Goswami , Sujit Rokka Chhetri , Arquimedes Canedo , Emilio Ferrara

Graphs are an essential data structure utilized to represent relationships in real-world scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver impressive outcomes in graph-centric tasks, such as link prediction…

Machine Learning · Computer Science 2024-09-12 Xubin Ren , Jiabin Tang , Dawei Yin , Nitesh Chawla , Chao Huang

In recent years, large language models (LLMs) have demonstrated remarkable generalization capabilities across various natural language processing (NLP) tasks. Similarly, graph foundation models (GFMs) have emerged as a promising direction…

Machine Learning · Computer Science 2025-05-20 Jianxiang Yu , Jiapeng Zhu , Hao Qian , Ziqi Liu , Zhiqiang Zhang , Xiang Li

Geospatial foundation models (GFMs) have been proposed as generalizable backbones for disaster response, land-cover mapping, food-security monitoring, and other high-stakes Earth-observation tasks. Yet the published work about these models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Isaac Corley , Nils Lehmann , Caleb Robinson , Gabriel Tseng , Anthony Fuller , Hamed Alemohammad , Evan Shelhamer , Jennifer Marcus , Hannah Kerner

Recently, graph neural networks (GNNs) have been successfully applied to recommender systems. In recommender systems, the user's feedback behavior on an item is usually the result of multiple factors acting at the same time. However, a…

Information Retrieval · Computer Science 2020-07-14 Dongbo Xi , Fuzhen Zhuang , Yongchun Zhu , Pengpeng Zhao , Xiangliang Zhang , Qing He