English
Related papers

Related papers: Distributed Training of Graph Convolutional Networ…

200 papers

Recently, distributed GNN training frameworks, such as DistDGL and PyG, have been developed to enable training GNN models on large graphs by leveraging multiple GPUs in a distributed manner. Despite these advances, their memory requirements…

Machine Learning · Computer Science 2025-12-09 Xin Huang , Weipeng Zhuo , Minh Phu Vuong , Shiju Li , Jongryool Kim , Bradley Rees , Chul-Ho Lee

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

Graph neural networks (GNNs) have emerged as a powerful model to capture critical graph patterns. Instead of treating them as black boxes in an end-to-end fashion, attempts are arising to explain the model behavior. Existing works mainly…

Machine Learning · Computer Science 2024-02-22 Yi Nian , Yurui Chang , Wei Jin , Lu Lin

Graph embedding, aiming to learn low-dimensional representations (aka. embeddings) of nodes, has received significant attention recently. Recent years have witnessed a surge of efforts made on static graphs, among which Graph Convolutional…

Machine Learning · Computer Science 2021-04-08 Zeyu Cui , Zekun Li , Shu Wu , Xiaoyu Zhang , Qiang Liu , Liang Wang , Mengmeng Ai

Graph Neural Networks (GNNs) have emerged as the leading paradigm for solving graph analytical problems in various real-world applications. Nevertheless, GNNs could potentially render biased predictions towards certain demographic…

Machine Learning · Computer Science 2022-11-29 Yushun Dong , Song Wang , Jing Ma , Ninghao Liu , Jundong Li

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

The increasing prevalence of large-scale graphs poses a significant challenge for graph neural network training, attributed to their substantial computational requirements. In response, graph condensation (GC) emerges as a promising…

Machine Learning · Computer Science 2025-01-24 Xinyi Gao , Guanhua Ye , Tong Chen , Wentao Zhang , Junliang Yu , Hongzhi Yin

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

Graph similarity computation aims to predict a similarity score between one pair of graphs to facilitate downstream applications, such as finding the most similar chemical compounds similar to a query compound or Fewshot 3D Action…

Machine Learning · Computer Science 2021-01-06 Haoyan Xu , Ziheng Duan , Jie Feng , Runjian Chen , Qianru Zhang , Zhongbin Xu , Yueyang Wang

Controlling network systems has become a problem of paramount importance. In this paper, we consider a distributed linear-quadratic problem and propose the use of graph neural networks (GNNs) to parametrize and design a distributed…

Systems and Control · Electrical Eng. & Systems 2022-02-14 Fernando Gama , Somayeh Sojoudi

How can we subsample graph data so that a graph neural network (GNN) trained on the subsample achieves performance comparable to training on the full dataset? This question is of fundamental interest, as smaller datasets reduce labeling…

Machine Learning · Computer Science 2025-02-25 Mika Sarkin Jain , Stefanie Jegelka , Ishani Karmarkar , Luana Ruiz , Ellen Vitercik

Recently, graph convolutional network (GCN) has been widely used for semi-supervised classification and deep feature representation on graph-structured data. However, existing GCN generally fails to consider the local invariance constraint…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Bo Jiang , Doudou Lin

Graph condensation (GC), which reduces the size of a large-scale graph by synthesizing a small-scale condensed graph as its substitution, has benefited various graph learning tasks. However, existing GC methods rely on centralized data…

Machine Learning · Computer Science 2024-12-23 Bo Yan , Sihao He , Cheng Yang , Shang Liu , Yang Cao , Chuan Shi

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However,…

Machine Learning · Computer Science 2022-04-19 Ke-jia Chen , Jiajun Zhang , Linpu Jiang , Yunyun Wang , Yuxuan Dai

Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they…

Machine Learning · Computer Science 2017-08-17 Ruoyu Li , Junzhou Huang

Recent works on representation learning for graph structured data predominantly focus on learning distributed representations of graph substructures such as nodes and subgraphs. However, many graph analytics tasks such as graph…

Artificial Intelligence · Computer Science 2017-07-18 Annamalai Narayanan , Mahinthan Chandramohan , Rajasekar Venkatesan , Lihui Chen , Yang Liu , Shantanu Jaiswal

Data augmentation aims to generate new and synthetic features from the original data, which can identify a better representation of data and improve the performance and generalizability of downstream tasks. However, data augmentation for…

Machine Learning · Computer Science 2021-06-17 Zhengzheng Tang , Ziyue Qiao , Xuehai Hong , Yang Wang , Fayaz Ali Dharejo , Yuanchun Zhou , Yi Du

Graph representation learning aims to effectively encode high-dimensional sparse graph-structured data into low-dimensional dense vectors, which is a fundamental task that has been widely studied in a range of fields, including machine…

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of…

Machine Learning · Computer Science 2018-10-16 Otkrist Gupta , Ramesh Raskar