English
Related papers

Related papers: Towards Pre-trained Graph Condensation via Optimal…

200 papers

Graph condensation has recently emerged as a prevalent technique to improve the training efficiency for graph neural networks (GNNs). It condenses a large graph into a small one such that a GNN trained on this small synthetic graph can…

Machine Learning · Computer Science 2025-04-01 Jiahao Wu , Ning Lu , Zeiyu Dai , Kun Wang , Wenqi Fan , Shengcai Liu , Qing Li , Ke Tang

Graph neural networks (GNNs) encounter significant computational challenges when handling large-scale graphs, which severely restricts their efficacy across diverse applications. To address this limitation, graph condensation has emerged as…

Machine Learning · Computer Science 2023-12-12 Xinyi Gao , Tong Chen , Yilong Zang , Wentao Zhang , Quoc Viet Hung Nguyen , Kai Zheng , Hongzhi Yin

Efficient training of large-scale heterogeneous graphs is of paramount importance in real-world applications. However, existing approaches typically explore simplified models to mitigate resource and time overhead, neglecting the crucial…

Machine Learning · Computer Science 2024-12-24 Yuxuan Liang , Wentao Zhang , Xinyi Gao , Ling Yang , Chong Chen , Hongzhi Yin , Yunhai Tong , Bin Cui

Graph Neural Networks(GNNs) are a family of neural models tailored for graph-structure data and have shown superior performance in learning representations for graph-structured data. However, training GNNs on large graphs remains…

Machine Learning · Computer Science 2022-12-13 Junwei Su

Distributed Graph Neural Network (GNN) training suffers from substantial communication overhead due to the inherent neighborhood dependency in graph-structured data. This neighbor explosion problem requires workers to frequently exchange…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-27 Zizhao Zhang , Yihan Xue , Haotian Zhu , Sijia Li , Zhijun Wang , Yujie Xiao

Recent research on deep graph learning has shifted from static to dynamic graphs, motivated by the evolving behaviors observed in complex real-world systems. However, the temporal extension in dynamic graphs poses significant data…

Machine Learning · Computer Science 2025-06-17 Dong Chen , Shuai Zheng , Yeyu Yan , Muhao Xu , Zhenfeng Zhu , Yao Zhao , Kunlun He

Graph neural networks (GNNs) enable the analysis of graphs using deep learning, with promising results in capturing structured information in graphs. This paper focuses on creating a small graph to represent the original graph, so that GNNs…

Machine Learning · Computer Science 2022-06-29 Mengyang Liu , Shanchuan Li , Xinshi Chen , Le Song

Graph condensation (GC) has become a vital strategy for scaling Graph Neural Networks by compressing massive datasets into small, synthetic node sets. While current GC methods effectively maintain predictive accuracy, they are primarily…

Machine Learning · Computer Science 2026-03-31 Yihan Gao , Chenxi Huang , Wen Shi , Ke Sun , Ziqi Xu , Xikun Zhang , Mingliang Hou , Renqiang Luo

Graph condensation has emerged as an intriguing technique to save the expensive training costs of Graph Neural Networks (GNNs) by substituting a condensed small graph with the original graph. Despite the promising results achieved, previous…

Social and Information Networks · Computer Science 2025-01-27 Zhenbang Xiao , Yu Wang , Shunyu Liu , Bingde Hu , Huiqiong Wang , Mingli Song , Tongya Zheng

Federated graph learning is a widely recognized technique that promotes collaborative training of graph neural networks (GNNs) by multi-client graphs.However, existing approaches heavily rely on the communication of model parameters or…

Machine Learning · Computer Science 2025-05-06 Hao Zhang , Xunkai Li , Yinlin Zhu , Lianglin Hu

The increasing scale of graph datasets has significantly improved the performance of graph representation learning methods, but it has also introduced substantial training challenges. Graph dataset condensation techniques have emerged to…

Machine Learning · Computer Science 2026-05-28 Huaming Du , Yijie Huang , Su Yao , Yiying Wang , Yueyang Zhou , Jingwen Yang , Jinshi Zhang , Han Ji , Yu Zhao , Guisong Liu , Hegui Zhang , Carl Yang , Gang Kou

Training on large-scale graphs has achieved remarkable results in graph representation learning, but its cost and storage have raised growing concerns. As one of the most promising directions, graph condensation methods address these issues…

Machine Learning · Computer Science 2024-09-30 Tianle Zhang , Yuchen Zhang , Kun Wang , Kai Wang , Beining Yang , Kaipeng Zhang , Wenqi Shao , Ping Liu , Joey Tianyi Zhou , Yang You

Large graph datasets make training graph neural networks (GNNs) computationally costly. Graph condensation methods address this by generating small synthetic graphs that approximate the original data. However, existing approaches rely on…

Machine Learning · Computer Science 2026-01-16 Jay Nandy , Arnab Kumar Mondal , Anuj Rathore , Mahesh Chandran

Heterogeneous graph neural networks (HGNNs) have demonstrated strong capability in modeling complex semantics across multi-type nodes and relations. However, their scalability to large-scale graphs remains challenging due to structural…

Machine Learning · Computer Science 2025-12-12 Fuyan Ou , Siqi Ai , Yulin Hu

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph representation learning on vast datasets, like web data, has made significant strides. However, the associated computational and storage overheads raise concerns. In sight of this, Graph condensation (GCond) has been introduced to…

Machine Learning · Computer Science 2024-02-12 Junfeng Fang , Xinglin Li , Yongduo Sui , Yuan Gao , Guibin Zhang , Kun Wang , Xiang Wang , Xiangnan He

Graph clustering aims to divide the graph into different clusters. The recently emerging deep graph clustering approaches are largely built on graph neural networks (GNN). However, GNN is designed for general graph encoding and there is a…

Machine Learning · Computer Science 2025-04-28 Zhiyuan Ning , Zaitian Wang , Ran Zhang , Ping Xu , Kunpeng Liu , Pengyang Wang , Wei Ju , Pengfei Wang , Yuanchun Zhou , Erik Cambria , Chong Chen

Graph condensation (GC) has gained significant attention for its ability to synthesize smaller yet informative graphs. However, existing studies often overlook the robustness of GC in scenarios where the original graph is corrupted. In such…

Machine Learning · Computer Science 2025-11-25 Jiayi Luo , Qingyun Sun , Beining Yang , Haonan Yuan , Xingcheng Fu , Yanbiao Ma , Jianxin Li , Philip S. Yu

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to…

Machine Learning · Computer Science 2020-02-20 Weihua Hu , Bowen Liu , Joseph Gomes , Marinka Zitnik , Percy Liang , Vijay Pande , Jure Leskovec