中文
相关论文

相关论文: Accelerating Storage-Based Training for Graph Neur…

200 篇论文

A key performance bottleneck when training graph neural network (GNN) models on large, real-world graphs is loading node features onto a GPU. Due to limited GPU memory, expensive data movement is necessary to facilitate the storage of these…

Graph neural networks (GNNs) is widely used to learn a powerful representation of graph-structured data. Recent work demonstrates that transferring knowledge from self-supervised tasks to downstream tasks could further improve graph…

机器学习 · 计算机科学 2021-07-21 Xueting Han , Zhenhuan Huang , Bang An , Jing Bai

Graph Neural Networks (GNNs) have emerged as powerful tools for supervised machine learning over graph-structured data, while sampling-based node representation learning is widely utilized in unsupervised learning. However, scalability…

机器学习 · 计算机科学 2024-07-23 Vipul Gupta , Xin Chen , Ruoyun Huang , Fanlong Meng , Jianjun Chen , Yujun Yan

Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several…

机器学习 · 计算机科学 2023-01-10 Chenhui Deng , Xiuyu Li , Zhuo Feng , Zhiru Zhang

Graph Neural Networks (GNNs) have shown exceptional success in graph representation learning and a wide range of real-world applications. However, scaling deeper GNNs poses challenges due to the neighbor explosion problem when training on…

机器学习 · 计算机科学 2025-11-18 Rui Xue

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

机器学习 · 计算机科学 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

机器学习 · 计算机科学 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph neural networks (GNN) analysis engines are vital for real-world problems that use large graph models. Challenges for a GNN hardware platform include the ability to (a) host a variety of GNNs, (b) handle high sparsity in input vertex…

硬件体系结构 · 计算机科学 2021-08-10 Sudipta Mondal , Susmita Dey Manasi , Kishor Kunal , S. Ramprasath , Sachin S. Sapatnekar

Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data. GNNs achieve state-of-the-art performance on many tasks, but they face scalability challenges when it comes to real-world applications that…

机器学习 · 计算机科学 2026-04-02 Shichang Zhang , Atefeh Sohrabizadeh , Cheng Wan , Zijie Huang , Ziniu Hu , Yewen Wang , Yingyan , Lin , Jason Cong , Yizhou Sun

Graph Neural Networks (GNNs) have superior capability in learning graph data. Full-graph GNN training generally has high accuracy, however, it suffers from large peak memory usage and encounters the Out-of-Memory problem when handling large…

机器学习 · 计算机科学 2024-06-10 Xizhi Gu , Hongzheng Li , Shihong Gao , Xinyan Zhang , Lei Chen , Yingxia Shao

Graph Neural Networks (GNNs) are a form of deep learning that enable a wide range of machine learning applications on graph-structured data. The learning of GNNs, however, is known to pose challenges for memory-constrained devices such as…

机器学习 · 计算机科学 2023-05-01 Jeroen Bollen , Jasper Steegmans , Jan Van den Bussche , Stijn Vansummeren

Graph neural networks have achieved state-of-the-art accuracy for graph node classification. However, GNNs are difficult to scale to large graphs, for example frequently encountering out-of-memory errors on even moderate size graphs. Recent…

机器学习 · 计算机科学 2022-10-26 Ziyuan Wang , Feiming Yang , Rui Fan

Graph Neural Networks (GNNs) have demonstrated effectiveness in various graph-based tasks. However, their inefficiency in training and inference presents challenges for scaling up to real-world and large-scale graph applications. To address…

机器学习 · 计算机科学 2024-05-08 Lu Ma , Zeang Sheng , Xunkai Li , Xinyi Gao , Zhezheng Hao , Ling Yang , Wentao Zhang , Bin Cui

Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla GNNs usually fail to scale up, limited by the GPU memory…

机器学习 · 计算机科学 2023-03-02 Keyu Duan , Zirui Liu , Peihao Wang , Wenqing Zheng , Kaixiong Zhou , Tianlong Chen , Xia Hu , Zhangyang Wang

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

机器学习 · 计算机科学 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

机器学习 · 计算机科学 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

Graph neural networks (GNNs) are emerging as a powerful technique for modeling graph structures. Due to the sparsity of real-world graph data, GNN performance is limited by extensive sparse matrix multiplication (SpMM) operations involved…

机器学习 · 计算机科学 2021-11-02 Shenghao Qiu , You Liang , Zheng Wang

The advent of Graph Neural Networks (GNNs) has revolutionized the field of machine learning, offering a novel paradigm for learning on graph-structured data. Unlike traditional neural networks, GNNs are capable of capturing complex…

硬件体系结构 · 计算机科学 2024-06-26 Kaustubh Shivdikar

Graph neural networks (GNNs), which have emerged as an effective method for handling machine learning tasks on graphs, bring a new approach to building recommender systems, where the task of recommendation can be formulated as the link…

信息检索 · 计算机科学 2022-11-03 Yuwei Hu , Jiajie Li , Zhongming Yu , Zhiru Zhang

Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of…

分布式、并行与集群计算 · 计算机科学 2023-03-02 Yi-Chien Lin , Viktor Prasanna