English
Related papers

Related papers: BNS-GCN: Efficient Full-Graph Training of Graph Co…

200 papers

Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-02 Yi-Chien Lin , Viktor Prasanna

Graph embedding is an important approach for graph analysis tasks such as node classification and link prediction. The goal of graph embedding is to find a low dimensional representation of graph nodes that preserves the graph information.…

Machine Learning · Computer Science 2019-08-27 Mahsa Ghorbani , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Training Graph Neural Networks(GNNs) on a large monolithic graph presents unique challenges as the graph cannot fit within a single machine and it cannot be decomposed into smaller disconnected components. Distributed sampling-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Hesham Mostafa , Adam Grabowski , Md Asadullah Turja , Juan Cervino , Alejandro Ribeiro , Nageen Himayat

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

The burgeoning volume of graph data presents significant computational challenges in training graph neural networks (GNNs), critically impeding their efficiency in various applications. To tackle this challenge, graph condensation (GC) has…

Machine Learning · Computer Science 2024-06-13 Xinyi Gao , Tong Chen , Wentao Zhang , Yayong Li , Xiangguo Sun , Hongzhi Yin

The Graph Convolutional Network (GCN) has been successfully applied to many graph-based applications. Training a large-scale GCN model, however, is still challenging: Due to the node dependency and layer dependency of the GCN architecture,…

Machine Learning · Computer Science 2021-12-20 Hongyi Li , Junxiang Wang , Yongchao Wang , Yue Cheng , Liang Zhao

Graph Convolutional Network (GCN) has experienced great success in graph analysis tasks. It works by smoothing the node features across the graph. The current GCN models overwhelmingly assume that the node feature information is complete.…

Machine Learning · Computer Science 2020-12-08 Hibiki Taguchi , Xin Liu , Tsuyoshi Murata

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

Graph Neural Networks (GNNs) are widely used for learning on graph-structured data, but scaling GNN training to massive graphs remains challenging. To enable scalable distributed training, graphs are divided into smaller partitions that are…

Machine Learning · Computer Science 2026-04-02 Nikolai Merkel , Ruben Mayer , Volker Markl , Hans-Arno Jacobsen

The emerging Graph Convolutional Network (GCN) has now been widely used in many domains, and it is challenging to improve the efficiencies of applications by accelerating the GCN trainings. For the sparsity nature and exploding scales of…

Machine Learning · Computer Science 2022-10-11 Shaoxian Xu , Zhiyuan Shao , Ci Yang , Xiaofei Liao , Hai Jin

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph convolution network (GCN) attracts intensive research interest with broad applications. While existing work mainly focused on designing novel GCN architectures for better performance, few of them studied a practical yet challenging…

Machine Learning · Computer Science 2020-10-16 Xiaoming Liu , Qirui Li , Chao Shen , Xi Peng , Yadong Zhou , Xiaohong Guan

Graph representation learning resurges as a trending research subject owing to the widespread use of deep learning for Euclidean data, which inspire various creative designs of neural networks in the non-Euclidean domain, particularly…

Graph Neural Networks (GNNs) have demonstrated promising results on exploiting node representations for many downstream tasks through supervised end-to-end training. To deal with the widespread label scarcity issue in real-world…

Machine Learning · Computer Science 2023-08-02 Cheng Wu , Chaokun Wang , Jingcao Xu , Ziyang Liu , Kai Zheng , Xiaowei Wang , Yang Song , Kun Gai

Graph Convolutional Networks (GCNs) are increasingly adopted in large-scale graph-based recommender systems. Training GCN requires the minibatch generator traversing graphs and sampling the sparsely located neighboring nodes to obtain their…

Machine Learning · Computer Science 2021-08-17 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu

Graph convolutional networks (GCNs) are becoming increasingly popular as they overcome the limited applicability of prior neural networks. A GCN takes as input an arbitrarily structured graph and executes a series of layers which exploit…

Machine Learning · Computer Science 2023-01-26 Mingi Yoo , Jaeyong Song , Jounghoo Lee , Namhyung Kim , Youngsok Kim , Jinho Lee

Developing scalable solutions for training Graph Neural Networks (GNNs) for link prediction tasks is challenging due to the high data dependencies which entail high computational cost and huge memory footprint. We propose a new method for…

Machine Learning · Computer Science 2022-01-11 Nasrullah Sheikh , Xiao Qin , Berthold Reinwald , Chuan Lei

To solve the problem that convolutional neural networks (CNNs) are difficult to process non-grid type relational data like graphs, Kipf et al. proposed a graph convolutional neural network (GCN). The core idea of the GCN is to perform…

Machine Learning · Computer Science 2019-04-17 Shangsheng Xie , Mingming Lu

We study the problem of semi-supervised learning with Graph Neural Networks (GNNs) in an active learning setup. We propose GraphPart, a novel partition-based active learning approach for GNNs. GraphPart first splits the graph into disjoint…

Machine Learning · Computer Science 2023-03-20 Jiaqi Ma , Ziqiao Ma , Joyce Chai , Qiaozhu Mei
‹ Prev 1 3 4 5 6 7 10 Next ›