English
Related papers

Related papers: Boosting Graph Foundation Model from Structural Pe…

200 papers

Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode…

Machine Learning · Computer Science 2026-01-27 Haonan Yuan , Qingyun Sun , Jiacheng Tao , Xingcheng Fu , Jianxin Li

Graph foundation models (GFMs), pretrained on massive graph data, have transformed graph machine learning by supporting general-purpose reasoning across diverse graph tasks and domains. Existing GFMs pretrained with fixed-hop subgraph…

Machine Learning · Computer Science 2026-05-12 Haokun Liu , Zezhong Ding , Xike Xie

Graph neural networks (GNNs) have found extensive applications in learning from graph data. However, real-world graphs often possess diverse structures and comprise nodes and edges of varying types. To bolster the generalization capacity of…

Machine Learning · Computer Science 2023-10-18 Haotao Wang , Ziyu Jiang , Yuning You , Yan Han , Gaowen Liu , Jayanth Srinivasa , Ramana Rao Kompella , Zhangyang Wang

For supervised learning with tabular data, decision tree ensembles produced via boosting techniques generally dominate real-world applications involving iid training/test sets. However for graph data where the iid assumption is violated due…

Machine Learning · Computer Science 2022-10-06 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Soji Adeshina , Yangkun Wang , Tom Goldstein , David Wipf

Graph learning is a prevalent domain that endeavors to learn the intricate relationships among nodes and the topological structure of graphs. Over the years, graph learning has transcended from graph theory to graph data mining. With the…

Artificial Intelligence · Computer Science 2024-09-24 Shaopeng Wei , Jun Wang , Yu Zhao , Xingyan Chen , Qing Li , Fuzhen Zhuang , Ji Liu , Fuji Ren , Gang Kou

Large language models show great potential in unstructured data understanding, but still face significant challenges with graphs due to their structural hallucination. Existing approaches mainly either verbalize graphs into natural…

Computation and Language · Computer Science 2026-02-03 Jingyao Wu , Bin Lu , Zijun Di , Xiaoying Gan , Meng Jin , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Although graph neural networks (GNNs) have achieved impressive achievements in graph classification, they often need abundant task-specific labels, which could be extensively costly to acquire. A credible solution is to explore additional…

Machine Learning · Computer Science 2025-07-15 Nan Yin , Li Shen , Mengzhu Wang , Long Lan , Zeyu Ma , Chong Chen , Xian-Sheng Hua , Xiao Luo

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

Machine Learning · Computer Science 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

Graph-structured data underpins many critical applications. While foundation models have transformed language and vision via large-scale pretraining and lightweight adaptation, extending this paradigm to general, real-world graphs is…

Machine Learning · Computer Science 2026-05-22 Maya Bechler-Speicher , Yoel Gottlieb , Andrey Isakov , David Abensur , Ami Tavory , Daniel Haimovich , Ido Guy , Udi Weinsberg

Recent advances in CV and NLP have inspired researchers to develop general-purpose graph foundation models through pre-training across diverse domains. However, a fundamental challenge arises from the substantial differences in graph…

Social and Information Networks · Computer Science 2025-06-02 Shuo Wang , Bokui Wang , Zhixiang Shen , Boyan Deng , Zhao Kang

Graph Foundation Models (GFMs) are emerging as a significant research topic in the graph domain, aiming to develop graph models trained on extensive and diverse data to enhance their applicability across various tasks and domains.…

Machine Learning · Computer Science 2024-06-03 Haitao Mao , Zhikai Chen , Wenzhuo Tang , Jianan Zhao , Yao Ma , Tong Zhao , Neil Shah , Mikhail Galkin , Jiliang Tang

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Graphs are naturally used to describe the structures of various real-world systems in biology, society, computer science etc., where subgraphs or motifs as basic blocks play an important role in function expression and information…

Social and Information Networks · Computer Science 2021-02-11 Jinhuan Wang , Pengtao Chen , Bin Ma , Jiajun Zhou , Zhongyuan Ruan , Guanrong Chen , Qi Xuan

Graph representation learning has attracted increasing research attention. However, most existing studies fuse all structural features and node attributes to provide an overarching view of graphs, neglecting finer substructures' semantics,…

Machine Learning · Computer Science 2021-05-25 Qingyun Sun , Jianxin Li , Hao Peng , Jia Wu , Yuanxing Ning , Phillip S. Yu , Lifang He

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Foundation models have emerged as critical components in a variety of artificial intelligence applications, and showcase significant success in natural language processing and several other domains. Meanwhile, the field of graph machine…

Machine Learning · Computer Science 2025-03-11 Jiawei Liu , Cheng Yang , Zhiyuan Lu , Junze Chen , Yibo Li , Mengmei Zhang , Ting Bai , Yuan Fang , Lichao Sun , Philip S. Yu , Chuan Shi

Graph Neural Networks (GNNs) have become essential in interpreting relational data across various domains, yet, they often struggle to generalize to unseen graph data that differs markedly from training instances. In this paper, we…

Machine Learning · Computer Science 2024-12-10 Xinke Jiang , Rihong Qiu , Yongxin Xu , Wentao Zhang , Yichen Zhu , Ruizhe Zhang , Yuchen Fang , Xu Chu , Junfeng Zhao , Yasha Wang

Graph neural networks, a powerful deep learning tool to model graph-structured data, have demonstrated remarkable performance on numerous graph learning tasks. To address the data noise and data scarcity issues in deep graph learning, the…

Machine Learning · Computer Science 2022-11-22 Kaize Ding , Zhe Xu , Hanghang Tong , Huan Liu

Graphs are general and powerful data representations which can model complex real-world phenomena, ranging from chemical compounds to social networks; however, effective feature extraction from graphs is not a trivial task, and much work…

Graph foundation models (GFMs) seek transferable representations across graph domains but are limited by structural heterogeneity and incompatible node feature spaces. We propose Structure-Centric Graph Foundation Models (SCGFM), which…

Machine Learning · Computer Science 2026-05-12 Xiaodong He , Haolan He , Ruiyi Fang , Ming Sun , Zhao Kang