中文
相关论文

相关论文: Accurate, Efficient and Scalable Training of Graph…

200 篇论文

Edge intelligence has arisen as a promising computing paradigm for supporting miscellaneous smart applications that rely on machine learning techniques. While the community has extensively investigated multi-tier edge deployment for…

分布式、并行与集群计算 · 计算机科学 2022-11-01 Liekang Zeng , Chongyu Yang , Peng Huang , Zhi Zhou , Shuai Yu , Xu Chen

Communication is a key bottleneck for distributed graph neural network (GNN) training. This paper proposes GNNPipe, a new approach that scales the distributed full-graph deep GNN training. Being the first to use layer-level model…

分布式、并行与集群计算 · 计算机科学 2023-09-26 Jingji Chen , Zhuoming Chen , Xuehai Qian

How can we subsample graph data so that a graph neural network (GNN) trained on the subsample achieves performance comparable to training on the full dataset? This question is of fundamental interest, as smaller datasets reduce labeling…

机器学习 · 计算机科学 2025-02-25 Mika Sarkin Jain , Stefanie Jegelka , Ishani Karmarkar , Luana Ruiz , Ellen Vitercik

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

机器学习 · 计算机科学 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

机器学习 · 计算机科学 2025-11-13 Yuyao Long

In recent years, graph neural networks (GNNs) have facilitated the development of graph data mining. However, training GNNs requires sufficient labeled task-specific data, which is expensive and sometimes unavailable. To be less dependent…

机器学习 · 计算机科学 2025-10-15 Shengyin Sun , Chen Ma , Jiehao Chen

Graph neural networks (GNNs) have been widely adopted for semi-supervised learning on graphs. A recent study shows that the graph random neural network (GRAND) model can generate state-of-the-art performance for this problem. However, it is…

机器学习 · 计算机科学 2022-03-15 Wenzheng Feng , Yuxiao Dong , Tinglin Huang , Ziqi Yin , Xu Cheng , Evgeny Kharlamov , Jie Tang

Graph neural networks (GNNs) leverage the connectivity and structure of real-world graphs to learn intricate properties and relationships between nodes. Many real-world graphs exceed the memory capacity of a GPU due to their sheer size, and…

机器学习 · 计算机科学 2025-10-30 Aditya K. Ranjan , Siddharth Singh , Cunyang Wei , Abhinav Bhatele

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

机器学习 · 计算机科学 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

As graphs grow larger, full-batch GNN training becomes hard for single GPU memory. Therefore, to enhance the scalability of GNN training, some studies have proposed sampling-based mini-batch training and distributed graph learning. However,…

机器学习 · 计算机科学 2024-08-22 Zhengjia Xu , Dingyang Lyu , Jinghui Zhang

Graph neural networks (GNNs) are often trained on individual datasets, requiring specialized models and significant hyperparameter tuning due to the unique structures and features of each dataset. This approach limits the scalability and…

机器学习 · 计算机科学 2026-02-17 Divyansha Lachi , Mehdi Azabou , Vinam Arora , Eva Dyer

Many interesting datasets ubiquitous in machine learning and deep learning can be described via graphs. As the scale and complexity of graph-structured datasets increase, such as in expansive social networks, protein folding, chemical…

机器学习 · 计算机科学 2021-04-06 Matthew T. Dearing , Xiaoyan Wang

Graph Neural Networks (GNNs) have demonstrated effectiveness in various graph-based tasks. However, their inefficiency in training and inference presents challenges for scaling up to real-world and large-scale graph applications. To address…

机器学习 · 计算机科学 2024-05-08 Lu Ma , Zeang Sheng , Xunkai Li , Xinyi Gao , Zhezheng Hao , Ling Yang , Wentao Zhang , Bin Cui

Graph Neural Networks (GNNs) are proficient in graph representation learning and achieve promising performance on versatile tasks such as node classification and link prediction. Usually, a comprehensive hyperparameter tuning is essential…

机器学习 · 计算机科学 2024-10-10 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Graph Neural Networks (GNNs) play a crucial role in various fields. However, most existing deep graph learning frameworks assume pre-stored static graphs and do not support training on graph streams. In contrast, many real-world graphs are…

分布式、并行与集群计算 · 计算机科学 2023-12-01 Yuchen Zhong , Guangming Sheng , Tianzuo Qin , Minjie Wang , Quan Gan , Chuan Wu

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

机器学习 · 计算机科学 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

机器学习 · 计算机科学 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

Graph neural networks (GNNs) have demonstrated remarkable success in graph representation learning, and various sampling approaches have been proposed to scale GNNs to applications with large-scale graphs. A class of promising GNN training…

机器学习 · 计算机科学 2024-10-10 Rui Xue , Tong Zhao , Neil Shah , Xiaorui Liu

This work develops a distributed graph neural network (GNN) methodology for mesh-based modeling applications using a consistent neural message passing layer. As the name implies, the focus is on enabling scalable operations that satisfy…

分布式、并行与集群计算 · 计算机科学 2024-10-03 Shivam Barwey , Riccardo Balin , Bethany Lusch , Saumil Patel , Ramesh Balakrishnan , Pinaki Pal , Romit Maulik , Venkatram Vishwanath

Distributed training of graph neural networks (GNNs) has become a crucial technique for processing large graphs. Prevalent GNN frameworks are model-centric, necessitating the transfer of massive graph vertex features to GNN models, which…

分布式、并行与集群计算 · 计算机科学 2024-09-10 Weijian Chen , Shuibing He , Haoyang Qu , Xuechen Zhang