English
Related papers

Related papers: Scaling Large-scale GNN Training to Thousands of P…

200 papers

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure information and the node (or edge) features through message passing…

Machine Learning · Computer Science 2021-05-04 Saurav Manchanda , Da Zheng , George Karypis

Graph convolutional networks (GCNs) are widely used in graph-based applications such as graph classification and segmentation. However, current GCNs have limitations on implementation such as network architectures due to their irregular…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yecheng Lyu , Xinming Huang , Ziming Zhang

Graph Convolutional Networks (GCN) is a pioneering model for graph-based semi-supervised learning. However, GCN does not perform well on sparsely-labeled graphs. Its two-layer version cannot effectively propagate the label information to…

Machine Learning · Computer Science 2025-02-24 Wei Ye , Zexi Huang , Yunqi Hong , Ambuj Singh

Large-scale graphs are valuable for graph representation learning, yet the abundant data in these graphs hinders the efficiency of the training process. Graph condensation (GC) alleviates this issue by compressing the large graph into a…

Machine Learning · Computer Science 2024-07-11 Yilun Liu , Ruihong Qiu , Zi Huang

Methods for training models on graphs distributed across multiple clients have recently grown in popularity, due to the size of these graphs as well as regulations on keeping data where it is generated. However, the cross-client edges…

Machine Learning · Computer Science 2023-12-19 Yuhang Yao , Weizhao Jin , Srivatsan Ravi , Carlee Joe-Wong

Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and…

Machine Learning · Computer Science 2021-07-13 Ronghang Zhu , Zhiqiang Tao , Yaliang Li , Sheng Li

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

Machine Learning · Computer Science 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong

Graph convolution network (GCN) attracts intensive research interest with broad applications. While existing work mainly focused on designing novel GCN architectures for better performance, few of them studied a practical yet challenging…

Machine Learning · Computer Science 2020-10-16 Xiaoming Liu , Qirui Li , Chao Shen , Xi Peng , Yadong Zhou , Xiaohong Guan

Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning…

Machine Learning · Computer Science 2024-11-19 Dmytro Lopushanskyy , Borun Shi

Graph Convolutional Network (GCN) is an emerging technique that performs learning and reasoning on graph data. It operates feature learning on the graph structure, through aggregating the features of the neighbor nodes to obtain the…

Machine Learning · Computer Science 2020-03-06 Fuli Feng , Xiangnan He , Hanwang Zhang , Tat-Seng Chua

Graph Convolutional Networks (GCNs) achieve an impressive performance due to the remarkable representation ability in learning the graph information. However, GCNs, when implemented on a deep network, require expensive computation power,…

Machine Learning · Computer Science 2022-08-03 Zulun Zhu , Jiaying Peng , Jintang Li , Liang Chen , Qi Yu , Siqiang Luo

Graph data, also known as complex network data, is omnipresent across various domains and applications. Prior graph neural network models primarily focused on extracting task-specific structural features through supervised learning…

Machine Learning · Computer Science 2024-03-26 Hongyin Zhu

Graph Neural Networks (GNNs) are powerful machine learning models that excel at analyzing structured data represented as graphs, demonstrating remarkable performance in applications like social network analysis and recommendation systems.…

Quantum Physics · Physics 2024-05-28 Yidong Liao , Xiao-Ming Zhang , Chris Ferrie

Graph neural networks (GNNs) have demonstrated excellent performance in a wide range of applications. However, the enormous size of large-scale graphs hinders their applications under real-time inference scenarios. Although existing…

Machine Learning · Computer Science 2022-12-29 Xinyi Gao , Wentao Zhang , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

Distributed scheduling algorithms for throughput or utility maximization in dense wireless multi-hop networks can have overwhelmingly high overhead, causing increased congestion, energy consumption, radio footprint, and security…

Signal Processing · Electrical Eng. & Systems 2022-03-29 Zhongyuan Zhao , Ananthram Swami , Santiago Segarra

We propose a framework that automatically transforms non-scalable GNNs into precomputation-based GNNs which are efficient and scalable for large-scale graphs. The advantages of our framework are two-fold; 1) it transforms various…

Machine Learning · Computer Science 2022-07-26 Seiji Maekawa , Yuya Sasaki , George Fletcher , Makoto Onizuka

Graph neural networks (GNNs) have delivered remarkable results in various fields. However, the rapid increase in the scale of graph data has introduced significant performance bottlenecks for GNN inference. Both computational complexity and…

Machine Learning · Computer Science 2025-03-11 Xiabao Wu , Yongchao Liu , Wei Qin , Chuntao Hong

Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN…

Machine Learning · Computer Science 2022-07-26 Jong Youl Choi , Pei Zhang , Kshitij Mehta , Andrew Blanchard , Massimiliano Lupo Pasini