English
Related papers

Related papers: GraNNite: Enabling High-Performance Execution of G…

200 papers

Graph Neural Networks (GNNs) have shown success in learning from graph-structured data, with applications to fraud detection, recommendation, and knowledge graph reasoning. However, training GNN efficiently is challenging because: 1) GPU…

Machine Learning · Computer Science 2021-11-12 Seung Won Min , Kun Wu , Mert Hidayetoğlu , Jinjun Xiong , Xiang Song , Wen-mei Hwu

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Graph Neural Networks (GNNs) have demonstrated significant achievements in processing graph data, yet scalability remains a substantial challenge. To address this, numerous graph coarsening methods have been developed. However, most…

Machine Learning · Computer Science 2024-12-19 Shuyin Xia , Xinjun Ma , Zhiyuan Liu , Cheng Liu , Sen Zhao , Guoyin Wang

Characterizing and understanding graph neural networks (GNNs) is essential for identifying performance bottlenecks and facilitating their deployment in parallel and distributed systems. Despite substantial work in this area, a comprehensive…

Hardware Architecture · Computer Science 2025-01-22 Meng Wu , Mingyu Yan , Wenming Li , Xiaochun Ye , Dongrui Fan , Yuan Xie

Graph Neural Networks (GNNs) have demonstrated remarkable performance in a wide range of tasks, such as node classification, link prediction, and graph classification, by exploiting the structural information in graph-structured data.…

Machine Learning · Computer Science 2026-01-09 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda , Antonio Diaz-Cano , Miguel Familiar

The increasing scale and complexity of integrated circuit design have led to increased challenges in Electronic Design Automation (EDA). Graph Neural Networks (GNNs) have emerged as a promising approach to assist EDA design as circuits can…

Machine Learning · Computer Science 2025-08-26 Yuebo Luo , Shiyang Li , Junran Tao , Kiran Thorat , Xi Xie , Hongwu Peng , Nuo Xu , Caiwen Ding , Shaoyi Huang

Graph Neural Networks (GNNs) achieve an impressive performance on structured graphs by recursively updating the representation vector of each node based on its neighbors, during which parameterized transformation matrices should be learned…

Machine Learning · Computer Science 2019-06-14 Pengfei Chen , Weiwen Liu , Chang-Yu Hsieh , Guangyong Chen , Shengyu Zhang

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

Machine Learning · Computer Science 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several…

Machine Learning · Computer Science 2023-01-10 Chenhui Deng , Xiuyu Li , Zhuo Feng , Zhiru Zhang

Graph Neural Networks (GNNs) have recently emerged as a promising approach to tackling power allocation problems in wireless networks. Since unpaired transmitters and receivers are often spatially distant, the distance-based threshold is…

Information Theory · Computer Science 2024-06-04 Lili Chen , Jingge Zhu , Jamie Evans

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph neural networks (GNNs) have achieved breakthroughs in various real-world downstream tasks due to their powerful expressiveness. As the scale of real-world graphs has been continuously growing, a storage-based approach to GNN training…

Machine Learning · Computer Science 2026-01-07 Myung-Hwan Jang , Jeong-Min Park , Yunyong Ko , Sang-Wook Kim

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

Machine Learning · Computer Science 2026-02-03 Yassine Abbahaddou

Graph Neural Networks (GNNs) excel in various graph learning tasks but face computational challenges when applied to large-scale graphs. A promising solution is to remove non-essential edges to reduce the computational overheads in GNN.…

Machine Learning · Computer Science 2024-02-05 Guibin Zhang , Yanwei Yue , Kun Wang , Junfeng Fang , Yongduo Sui , Kai Wang , Yuxuan Liang , Dawei Cheng , Shirui Pan , Tianlong Chen

We present distributed algorithms for training dynamic Graph Neural Networks (GNN) on large scale graphs spanning multi-node, multi-GPU systems. To the best of our knowledge, this is the first scaling study on dynamic GNN. We devise…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-17 Venkatesan T. Chakaravarthy , Shivmaran S. Pandian , Saurabh Raje , Yogish Sabharwal , Toyotaro Suzumura , Shashanka Ubaru

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Graph Neural Networks (GNNs) have shown significant promise in various domains, such as recommendation systems, bioinformatics, and network analysis. However, the irregularity of graph data poses unique challenges for efficient computation,…

Machine Learning · Computer Science 2024-11-26 Pol Puigdemont , Enrico Russo , Axel Wassington , Abhijit Das , Sergi Abadal , Maurizio Palesi

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

As the performance of computer systems stagnates due to the end of Moore's Law, there is a need for new models that can understand and optimize the execution of general purpose code. While there is a growing body of work on using Graph…

Machine Learning · Computer Science 2020-03-12 Zhan Shi , Kevin Swersky , Daniel Tarlow , Parthasarathy Ranganathan , Milad Hashemi