English
Related papers

Related papers: Evaluating Progress in Graph Foundation Models: A …

200 papers

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

Machine learning on graphs has made substantial progress across domains such as molecular property prediction and chip design. Yet benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent…

Graph machine learning has advanced rapidly in tasks such as link prediction, anomaly detection, and node classification. As models scale up, pretrained graph models have become valuable intellectual assets because they encode extensive…

Foundation models have shown remarkable cross-domain generalization in language and vision, inspiring the development of graph foundation models (GFMs). However, existing GFMs typically assume centralized access to multi-domain graphs,…

Machine Learning · Computer Science 2025-10-10 Zhengyu Wu , Yinlin Zhu , Xunkai Li , Ziang Qiu , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Although data that can be naturally represented as graphs is widespread in real-world applications across diverse industries, popular graph ML benchmarks for node property prediction only cover a surprisingly narrow set of data domains, and…

Machine Learning · Computer Science 2026-05-05 Gleb Bazhenov , Oleg Platonov , Liudmila Prokhorenkova

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on…

Neurons and Cognition · Quantitative Biology 2026-02-11 Xinxu Wei , Kanhao Zhao , Yong Jiao , Lifang He , Yu Zhang

It has become a popular paradigm to transfer the knowledge of large-scale pre-trained models to various downstream tasks via fine-tuning the entire model parameters. However, with the growth of model scale and the rising number of…

Machine Learning · Computer Science 2023-05-18 Anchun Gui , Jinqiang Ye , Han Xiao

Recent advancements in large-scale pre-training have shown the potential to learn generalizable representations for downstream tasks. In the graph domain, however, capturing and transferring structural information across different graph…

Machine Learning · Computer Science 2026-02-24 Jialin Chen , Haolan Zuo , Haoyu Peter Wang , Siqi Miao , Pan Li , Rex Ying

Prior highly-tuned image parsing models are usually studied in a certain domain with a specific set of semantic labels and can hardly be adapted into other scenarios (e.g., sharing discrepant label granularity) without extensive…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Liang Lin , Yiming Gao , Ke Gong , Meng Wang , Xiaodan Liang

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Foundation models, such as Large Language Models (LLMs) or Large Vision Models (LVMs), have emerged as one of the most powerful tools in the respective fields. However, unlike text and image data, graph data do not have a definitive…

Machine Learning · Computer Science 2025-04-28 Lecheng Kong , Jiarui Feng , Hao Liu , Chengsong Huang , Jiaxin Huang , Yixin Chen , Muhan Zhang

In real-world scenarios, achieving domain adaptation and generalization poses significant challenges, as models must adapt to or generalize across unknown target distributions. Extending these capabilities to unseen multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hao Dong , Moru Liu , Kaiyang Zhou , Eleni Chatzi , Juho Kannala , Cyrill Stachniss , Olga Fink

Graph foundation models have recently attracted significant attention due to its strong generalizability. Although existing methods resort to language models to learn unified semantic representations across domains, they disregard the…

Machine Learning · Computer Science 2025-10-17 Yao Cheng , Yige Zhao , Jianxiang Yu , Xiang Li

A foundation model like GPT elicits many emergent abilities, owing to the pre-training with broad inclusion of data and the use of the powerful Transformer architecture. While foundation models in natural languages are prevalent, can we…

Machine Learning · Computer Science 2025-06-18 Ziyuan Tang , Jie Chen

In recent years, large language models (LLMs) have demonstrated remarkable generalization capabilities across various natural language processing (NLP) tasks. Similarly, graph foundation models (GFMs) have emerged as a promising direction…

Machine Learning · Computer Science 2025-05-20 Jianxiang Yu , Jiapeng Zhu , Hao Qian , Ziqi Liu , Zhiqiang Zhang , Xiang Li

Given the ubiquity of graph data, it is intriguing to ask: Is it possible to train a graph foundation model on a broad range of graph data across diverse domains? A major hurdle toward this goal lies in the fact that graphs from different…

Machine Learning · Computer Science 2024-09-24 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

Predictive Business Process Monitoring (PBPM) aims to forecast future events in ongoing cases based on historical event logs. While Graph Neural Networks (GNNs) are well suited to capture structural dependencies in process data, existing…

Machine Learning · Computer Science 2025-11-25 Fang Wang , Ernesto Damiani

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

Machine Learning · Computer Science 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

Graph foundation models represent a transformative paradigm for learning transferable representations across diverse graph domains. Recent methods leverage large language models to unify graph and text modalities into a shared…

Machine Learning · Computer Science 2025-12-23 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Haochen You , Zijian Zhang , Yilei Yuan , Jin Huang

Graph Transformers (GTs) have recently demonstrated remarkable performance across diverse domains. By leveraging attention mechanisms, GTs are capable of modeling long-range dependencies and complex structural relationships beyond local…

Machine Learning · Computer Science 2025-06-06 Jiachen Tang , Zhonghao Wang , Sirui Chen , Sheng Zhou , Jiawei Chen , Jiajun Bu