中文
相关论文

相关论文: VISAGNN: Versatile Staleness-Aware Efficient Train…

200 篇论文

We present distributed algorithms for training dynamic Graph Neural Networks (GNN) on large scale graphs spanning multi-node, multi-GPU systems. To the best of our knowledge, this is the first scaling study on dynamic GNN. We devise…

分布式、并行与集群计算 · 计算机科学 2021-09-17 Venkatesan T. Chakaravarthy , Shivmaran S. Pandian , Saurabh Raje , Yogish Sabharwal , Toyotaro Suzumura , Shashanka Ubaru

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

机器学习 · 计算机科学 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph representation learning is a fundamental research issue and benefits a wide range of applications on graph-structured data. Conventional artificial neural network-based methods such as graph neural networks (GNNs) and variational…

神经与进化计算 · 计算机科学 2022-11-04 Hanxuan Yang , Ruike Zhang , Qingchao Kong , Wenji Mao

Neural forecasting of spatiotemporal time series drives both research and industrial innovation in several relevant application domains. Graph neural networks (GNNs) are often the core component of the forecasting architecture. However, in…

机器学习 · 计算机科学 2023-02-21 Andrea Cini , Ivan Marisca , Filippo Maria Bianchi , Cesare Alippi

Graph neural networks (GNNs) can extract features by learning both the representation of each objects (i.e., graph nodes) and the relationship across different objects (i.e., the edges that connect nodes), achieving state-of-the-art…

硬件体系结构 · 计算机科学 2022-05-11 Yunjae Lee , Jinha Chung , Minsoo Rhu

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph without node features,…

Graph embedding, aiming to learn low-dimensional representations (aka. embeddings) of nodes, has received significant attention recently. Recent years have witnessed a surge of efforts made on static graphs, among which Graph Convolutional…

机器学习 · 计算机科学 2021-04-08 Zeyu Cui , Zekun Li , Shu Wu , Xiaoyu Zhang , Qiang Liu , Liang Wang , Mengmeng Ai

Recently, Graph Neural Networks (GNNs) have become state-of-the-art algorithms for analyzing non-euclidean graph data. However, to realize efficient GNN training is challenging, especially on large graphs. The reasons are many-folded: 1)…

机器学习 · 计算机科学 2022-08-17 Zhe Zhou , Cong Li , Xuechao Wei , Xiaoyang Wang , Guangyu Sun

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

机器学习 · 计算机科学 2023-01-10 Yeskendir Koishekenov

We present GERN, a novel scalable framework for training GNNs in node classification tasks, based on effective resistance, a standard tool in spectral graph theory. Our method progressively refines the GNN weights on a sequence of random…

机器学习 · 计算机科学 2025-02-25 Francesco Bonchi , Claudio Gentile , Francesco Paolo Nerini , André Panisson , Fabio Vitale

Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are…

机器学习 · 计算机科学 2021-06-14 Jialin Dong , Da Zheng , Lin F. Yang , Geroge Karypis

Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of…

分布式、并行与集群计算 · 计算机科学 2023-03-02 Yi-Chien Lin , Viktor Prasanna

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

机器学习 · 计算机科学 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph Neural Networks (GNNs) have shown great superiority on non-Euclidean graph data, achieving ground-breaking performance on various graph-related tasks. As a practical solution to train GNN on large graphs with billions of nodes and…

机器学习 · 计算机科学 2024-09-24 Zeyu Zhu , Peisong Wang , Qinghao Hu , Gang Li , Xiaoyao Liang , Jian Cheng

Graph neural networks (GNNs) have emerged as the standard method for numerous tasks on graph-structured data such as node classification. However, real-world graphs are often evolving over time and even new classes may arise. We model these…

机器学习 · 计算机科学 2021-12-21 Lukas Galke , Benedikt Franke , Tobias Zielke , Ansgar Scherp

Graph Neural Networks (GNNs) have achieved state-of-the-art (SOTA) performance in diverse domains. However, training GNNs on large-scale graphs poses significant challenges due to high memory demands and significant communication overhead…

分布式、并行与集群计算 · 计算机科学 2025-05-19 Arefin Niam , M S Q Zulkar Nine

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

机器学习 · 计算机科学 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Learning powerful data embeddings has become a center piece in machine learning, especially in natural language processing and computer vision domains. The crux of these embeddings is that they are pretrained on huge corpus of data in a…

机器学习 · 计算机科学 2019-11-28 Saurabh Verma , Zhi-Li Zhang

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

机器学习 · 计算机科学 2025-11-13 Yuyao Long

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

机器学习 · 计算机科学 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli