English
Related papers

Related papers: ReInc: Scaling Training of Dynamic Graph Neural Ne…

200 papers

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

Full-batch training on Graph Neural Networks (GNN) to learn the structure of large graphs is a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is challenging due to large memory capacity and bandwidth…

Graph neural networks (GNNs) have delivered remarkable results in various fields. However, the rapid increase in the scale of graph data has introduced significant performance bottlenecks for GNN inference. Both computational complexity and…

Machine Learning · Computer Science 2025-03-11 Xiabao Wu , Yongchao Liu , Wei Qin , Chuntao Hong

Recent research on deep graph learning has shifted from static to dynamic graphs, motivated by the evolving behaviors observed in complex real-world systems. However, the temporal extension in dynamic graphs poses significant data…

Machine Learning · Computer Science 2025-06-17 Dong Chen , Shuai Zheng , Yeyu Yan , Muhao Xu , Zhenfeng Zhu , Yao Zhao , Kunlun He

Graph Neural Networks (GNNs) unlock new ways of learning from graph-structured data, proving highly effective in capturing complex relationships and patterns. Federated GNNs (FGNNs) have emerged as a prominent distributed learning paradigm…

Machine Learning · Computer Science 2026-01-23 Xiuling Wang , Xin Huang , Haibo Hu , Jianliang Xu

Traffic prediction is the cornerstone of an intelligent transportation system. Accurate traffic forecasting is essential for the applications of smart cities, i.e., intelligent traffic management and urban planning. Although various methods…

Machine Learning · Computer Science 2021-05-04 Fuxian Li , Jie Feng , Huan Yan , Guangyin Jin , Depeng Jin , Yong Li

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

Machine Learning · Computer Science 2021-06-15 Marco Serafini , Hui Guan

Dynamic graph neural networks (DGNNs) have emerged and been widely deployed in various web applications (e.g., Reddit) to serve users (e.g., personalized content delivery) due to their remarkable ability to learn from complex and dynamic…

Machine Learning · Computer Science 2025-02-04 He Zhang , Bang Wu , Xiangwen Yang , Xingliang Yuan , Xiaoning Liu , Xun Yi

Graph Neural Networks (GNN) have shown a strong potential to be integrated into commercial products for network control and management. Early works using GNN have demonstrated an unprecedented capability to learn from different network…

Networking and Internet Architecture · Computer Science 2021-10-05 Miquel Ferriol-Galmés , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

Machine Learning · Computer Science 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

Deep reinforcement learning (DRL) has been widely used in many important tasks of communication networks. In order to improve the perception ability of DRL on the network, some studies have combined graph neural networks (GNNs) with DRL,…

Cryptography and Security · Computer Science 2025-01-22 Xuzeng Li , Tao Zhang , Jian Wang , Zhen Han , Jiqiang Liu , Jiawen Kang , Dusit Niyato , Abbas Jamalipour

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

Machine Learning · Computer Science 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

In recent years, Dynamic Graph (DG) representations have been increasingly used for modeling dynamic systems due to their ability to integrate both topological and temporal information in a compact representation. Dynamic graphs allow to…

Machine Learning · Computer Science 2023-04-13 Leshanshui Yang , Sébastien Adam , Clément Chatelain

Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets. However, recent deep learning models have moved forward from…

Machine Learning · Computer Science 2021-08-03 Wentao Zhang , Zhi Yang , Yexin Wang , Yu Shen , Yang Li , Liang Wang , Bin Cui

Implicit graph neural networks have gained popularity in recent years as they capture long-range dependencies while improving predictive performance in static graphs. Despite the tussle between performance degradation due to the…

Machine Learning · Computer Science 2024-06-27 Yongjian Zhong , Hieu Vu , Tianbao Yang , Bijaya Adhikari

In this paper, we propose Graph Retention Networks (GRNs) as a unified architecture for deep learning on dynamic graphs. The GRN extends the concept of retention into dynamic graph data as graph retention, equipping the model with three key…

Machine Learning · Computer Science 2026-04-14 Qian Chang , Xia Li , Xiufeng Cheng , Runsong Jia , Jinqing Yang , Guoping Hu , Ciprian Doru Giurcaneanu

Graph Neural Networks (GNNs) show strong promise for circuit analysis, but scaling to modern large-scale circuit graphs is limited by GPU memory and training cost, especially for deep models. We revisit deep GNNs for circuit graphs and show…

Machine Learning · Computer Science 2026-03-31 Yuebo Luo , Shiyang Li , Yifei Feng , Vishal Kancharla , Shaoyi Huang , Caiwen Ding

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Recent years have seen a surge in research on dynamic graph representation learning, which aims to model temporal graphs that are dynamic and evolving constantly over time. However, current work typically models graph dynamics with…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Jintang Li , Zhouxin Yu , Zulun Zhu , Liang Chen , Qi Yu , Zibin Zheng , Sheng Tian , Ruofan Wu , Changhua Meng