English
Related papers

Related papers: Communication-Efficient Sampling for Distributed T…

200 papers

In this work, we aim to classify nodes of unstructured peer-to-peer networks with communication uncertainty, such as users of decentralized social networks. Graph Neural Networks (GNNs) are known to improve the accuracy of simple…

Machine Learning · Computer Science 2022-03-17 Emmanouil Krasanakis , Symeon Papadopoulos , Ioannis Kompatsiaris

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN…

Machine Learning · Computer Science 2021-12-16 Cheolhyeong Kim , Haeseong Moon , Hyung Ju Hwang

Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent…

Machine Learning · Computer Science 2024-09-04 Jun Hu , Bryan Hooi , Bingsheng He

Distributed computing excels at processing large scale data, but the communication cost for synchronizing the shared parameters may slow down the overall performance. Fortunately, the interactions between parameter and data in many problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Mu Li , Dave G. Andersen , Alexander J. Smola

Graph convolutional networks (GCNs) have achieved promising performance on various graph-based tasks. However they suffer from over-smoothing when stacking more layers. In this paper, we present a quantitative study on this observation and…

Machine Learning · Computer Science 2020-09-28 Hongwei Zhang , Tijin Yan , Zenjun Xie , Yuanqing Xia , Yuan Zhang

We propose AGS-GNN, a novel attribute-guided sampling algorithm for Graph Neural Networks (GNNs) that exploits node features and connectivity structure of a graph while simultaneously adapting for both homophily and heterophily in graphs.…

Machine Learning · Computer Science 2024-05-27 Siddhartha Shankar Das , S M Ferdous , Mahantesh M Halappanavar , Edoardo Serra , Alex Pothen

Scalability of graph neural networks remains one of the major challenges in graph machine learning. Since the representation of a node is computed by recursively aggregating and transforming representation vectors of its neighboring nodes…

Machine Learning · Computer Science 2021-06-10 Zengfeng Huang , Shengzhong Zhang , Chong Xi , Tang Liu , Min Zhou

Consensus-based decentralized stochastic gradient descent (D-SGD) is a widely adopted algorithm for decentralized training of machine learning models across networked agents. A crucial part of D-SGD is the consensus-based model averaging,…

Information Theory · Computer Science 2025-02-12 Daniel Pérez Herrera , Zheng Chen , Erik G. Larsson

Minimizing transmission delay in wireless multi-hop networks is a fundamental yet challenging task due to the complex coupling among interference, queue dynamics, and distributed control. Traditional scheduling algorithms, such as…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Boxuan Wen , Junyu Luo

Graph Convolution Network (GCN) has been widely applied in recommender systems for its representation learning capability on user and item embeddings. However, GCN is vulnerable to noisy and incomplete graphs, which are common in real…

Information Retrieval · Computer Science 2023-05-16 Yaxing Fang , Pengpeng Zhao , Guanfeng Liu , Yanchi Liu , Victor S. Sheng , Lei Zhao , Xiaofang Zhou

Recently, Graph Convolutional Networks (GCNs) and their variants have been receiving many research interests for learning graph-related tasks. While the GCNs have been successfully applied to this problem, some caveats inherited from…

Machine Learning · Computer Science 2019-11-11 Mustafa Coskun

Although graph convolutional networks exhibit promising performance in 3D human pose estimation, their reliance on one-hop neighbors limits their ability to capture high-order dependencies among body joints, crucial for mitigating…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Abu Taib Mohammed Shahjahan , A. Ben Hamza

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Graph Convolutional Networks (GCNs) are widely used in graph-based applications, such as social networks and recommendation systems. Nevertheless, large-scale graphs or deep aggregation layers in full-batch GCNs consume significant GPU…

Machine Learning · Computer Science 2024-10-15 Shengwei Ji , Yujie Tian , Fei Liu , Xinlu Li , Le Wu

Forecasting the trajectories of neighbor vehicles is a crucial step for decision making and motion planning of autonomous vehicles. This paper proposes a graph-based spatial-temporal convolutional network (GSTCN) to predict future…

Machine Learning · Computer Science 2022-10-17 Zihao Sheng , Yunwen Xu , Shibei Xue , Dewei Li

The emerging Graph Convolutional Network (GCN) has now been widely used in many domains, and it is challenging to improve the efficiencies of applications by accelerating the GCN trainings. For the sparsity nature and exploding scales of…

Machine Learning · Computer Science 2022-10-11 Shaoxian Xu , Zhiyuan Shao , Ci Yang , Xiaofei Liao , Hai Jin

For privacy-preserving graph learning tasks involving distributed graph datasets, federated learning (FL)-based GCN (FedGCN) training is required. A key challenge for FedGCN is scaling to large-scale graphs, which typically incurs high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-24 Anran Li , Yuanyuan Chen , Chao Ren , Wenhan Wang , Ming Hu , Tianlin Li , Han Yu , Qingyu Chen

Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning…

Machine Learning · Computer Science 2024-11-19 Dmytro Lopushanskyy , Borun Shi

Graph Neural Networks (GNNs) are a computationally efficient method to learn embeddings and classifications on graph data. However, GNN training has low computational intensity, making communication costs the bottleneck for scalability.…

Machine Learning · Computer Science 2025-04-08 Ujjaini Mukhodopadhyay , Alok Tripathy , Oguz Selvitopi , Katherine Yelick , Aydin Buluc