中文
相关论文

相关论文: AdaptGear: Accelerating GNN Training via Adaptive …

200 篇论文

In many important graph data processing applications the acquired information includes both node features and observations of the graph topology. Graph neural networks (GNNs) are designed to exploit both sources of evidence but they do not…

机器学习 · 计算机科学 2021-10-28 Eli Chien , Jianhao Peng , Pan Li , Olgica Milenkovic

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which…

分布式、并行与集群计算 · 计算机科学 2022-04-19 Haiyang Lin , Mingyu Yan , Xiaocheng Yang , Mo Zou , Wenming Li , Xiaochun Ye , Dongrui Fan

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

机器学习 · 计算机科学 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

机器学习 · 计算机科学 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Graph neural networks (GNNs) start to gain momentum after showing significant performance improvement in a variety of domains including molecular science, recommendation, and transportation. Turning such performance improvement of GNNs into…

硬件体系结构 · 计算机科学 2021-07-20 Zhihui Zhang , Jingwen Leng , Shuwen Lu , Youshan Miao , Yijia Diao , Minyi Guo , Chao Li , Yuhao Zhu

Graph Neural Networks (GNNs) have shown significant promise in various domains, such as recommendation systems, bioinformatics, and network analysis. However, the irregularity of graph data poses unique challenges for efficient computation,…

机器学习 · 计算机科学 2024-11-26 Pol Puigdemont , Enrico Russo , Axel Wassington , Abhijit Das , Sergi Abadal , Maurizio Palesi

Graph neural networks (GNNs) have achieved breakthroughs in various real-world downstream tasks due to their powerful expressiveness. As the scale of real-world graphs has been continuously growing, a storage-based approach to GNN training…

机器学习 · 计算机科学 2026-01-07 Myung-Hwan Jang , Jeong-Min Park , Yunyong Ko , Sang-Wook Kim

Graph Neural Networks (GNNs) are becoming a promising technique in various domains due to their excellent capabilities in modeling non-Euclidean data. Although a spectrum of accelerators has been proposed to accelerate the inference of…

硬件体系结构 · 计算机科学 2023-11-17 Zeyu Zhu , Fanrong Li , Gang Li , Zejian Liu , Zitao Mo , Qinghao Hu , Xiaoyao Liang , Jian Cheng

Graph Neural Networks (GNNs) have achieved significant success in addressing node classification tasks. However, the effectiveness of traditional GNNs degrades on heterophilic graphs, where connected nodes often belong to different labels…

机器学习 · 计算机科学 2025-11-11 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

\textit{Graph Neural Network} (GNN) is a promising approach for analyzing graph-structured data that tactfully captures their dependency information via node-level message passing. It has achieved state-of-the-art performances in many…

机器学习 · 计算机科学 2021-05-05 Feng Shi , Ahren Yiqiao Jin , Song-Chun Zhu

Graph Neural Networks (GNNs) are a form of deep learning that enable a wide range of machine learning applications on graph-structured data. The learning of GNNs, however, is known to pose challenges for memory-constrained devices such as…

机器学习 · 计算机科学 2023-05-01 Jeroen Bollen , Jasper Steegmans , Jan Van den Bussche , Stijn Vansummeren

Graph Convolutional Networks (GCNs) have emerged as powerful tools for learning on network structured data. Although empirically successful, GCNs exhibit certain behaviour that has no rigorous explanation -- for instance, the performance of…

机器学习 · 计算机科学 2023-11-07 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Graph Neural Networks (GNNs) have drawn tremendous attention due to their unique capability to extend Machine Learning (ML) approaches to applications broadly-defined as having unstructured data, especially graphs. Compared with other…

硬件体系结构 · 计算机科学 2022-06-29 Chengming Zhang , Tong Geng , Anqi Guo , Jiannan Tian , Martin Herbordt , Ang Li , Dingwen Tao

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

机器学习 · 计算机科学 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

机器学习 · 计算机科学 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of…

分布式、并行与集群计算 · 计算机科学 2023-03-02 Yi-Chien Lin , Viktor Prasanna

Graph Convolutional Networks (GCNs) are pivotal in extracting latent information from graph data across various domains, yet their acceleration on mainstream GPUs is challenged by workload imbalance and memory access irregularity. To…

硬件体系结构 · 计算机科学 2023-08-24 Xi Xie , Hongwu Peng , Amit Hasan , Shaoyi Huang , Jiahui Zhao , Haowen Fang , Wei Zhang , Tong Geng , Omer Khan , Caiwen Ding

We propose a unified framework for adaptive connection sampling in graph neural networks (GNNs) that generalizes existing stochastic regularization methods for training GNNs. The proposed framework not only alleviates over-smoothing and…

Mesh-based Graph Neural Networks (GNNs) have recently shown capabilities to simulate complex multiphysics problems with accelerated performance times. However, mesh-based GNNs require a large number of message-passing (MP) steps and suffer…

计算工程、金融与科学 · 计算机科学 2024-02-15 Roberto Perera , Vinamra Agrawal

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

机器学习 · 计算机科学 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen