中文
相关论文

相关论文: BiFeat: Supercharge GNN Training via Graph Feature…

200 篇论文

Deep convolutional neural network (CNN) training via iterative optimization has had incredible success in finding optimal parameters. However, modern CNN architectures often contain millions of parameters. Thus, any given model for a single…

机器学习 · 计算机科学 2023-08-21 Stone Yun , Alexander Wong

Graph Neural Networks (GNN) is an emerging field for learning on non-Euclidean data. Recently, there has been increased interest in designing GNN that scales to large graphs. Most existing methods use "graph sampling" or "layer-wise…

机器学习 · 计算机科学 2021-09-03 Ming Chen , Zhewei Wei , Bolin Ding , Yaliang Li , Ye Yuan , Xiaoyong Du , Ji-Rong Wen

Graph Neural Networks (GNNs) have shown promising performance, but at the cost of resource-intensive operations on graph-scale matrices. To reduce computational overhead, previous studies attempt to sparsify the graph or network parameters,…

机器学习 · 计算机科学 2025-07-11 Ningyi Liao , Zihao Yu , Ruixiao Zeng , Siqiang Luo

Graph Neural Networks (GNNs) are becoming a promising technique in various domains due to their excellent capabilities in modeling non-Euclidean data. Although a spectrum of accelerators has been proposed to accelerate the inference of…

硬件体系结构 · 计算机科学 2023-11-17 Zeyu Zhu , Fanrong Li , Gang Li , Zejian Liu , Zitao Mo , Qinghao Hu , Xiaoyao Liang , Jian Cheng

Scalability of Graph Neural Networks (GNNs) remains a significant challenge. To tackle this, methods like coarsening, condensation, and computation trees are used to train on a smaller graph, resulting in faster computation. Nonetheless,…

机器学习 · 计算机科学 2026-04-13 Shubhajit Roy , Hrriday Ruparel , Kishan Ved , Anirban Dasgupta

Owing to their remarkable representation capabilities for heterogeneous graph data, Heterogeneous Graph Neural Networks (HGNNs) have been widely adopted in many critical real-world domains such as recommendation systems and medical…

机器学习 · 计算机科学 2024-10-30 Dengke Han , Mingyu Yan , Xiaochun Ye , Dongrui Fan

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

机器学习 · 计算机科学 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec

As graphs grow larger, full-batch GNN training becomes hard for single GPU memory. Therefore, to enhance the scalability of GNN training, some studies have proposed sampling-based mini-batch training and distributed graph learning. However,…

机器学习 · 计算机科学 2024-08-22 Zhengjia Xu , Dingyang Lyu , Jinghui Zhang

As graph data size increases, the vast latency and memory consumption during inference pose a significant challenge to the real-world deployment of Graph Neural Networks (GNNs). While quantization is a powerful approach to reducing GNNs…

机器学习 · 计算机科学 2023-02-02 Zeyu Zhu , Fanrong Li , Zitao Mo , Qinghao Hu , Gang Li , Zejian Liu , Xiaoyao Liang , Jian Cheng

Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is associated with a scalar, GNNs attach a feature tensor to…

机器学习 · 计算机科学 2020-09-30 Yuwei Hu , Zihao Ye , Minjie Wang , Jiali Yu , Da Zheng , Mu Li , Zheng Zhang , Zhiru Zhang , Yida Wang

Graph Neural Networks (GNNs) have emerged as a powerful and flexible framework for representation learning on irregular data. As they generalize the operations of classical CNNs on grids to arbitrary topologies, GNNs also bring much of the…

机器学习 · 计算机科学 2021-03-31 Mehdi Bahri , Gaétan Bahl , Stefanos Zafeiriou

Graph Neural Networks (GNNs) have shown great superiority on non-Euclidean graph data, achieving ground-breaking performance on various graph-related tasks. As a practical solution to train GNN on large graphs with billions of nodes and…

机器学习 · 计算机科学 2024-09-24 Zeyu Zhu , Peisong Wang , Qinghao Hu , Gang Li , Xiaoyao Liang , Jian Cheng

The emergence of Graph Neural Networks (GNNs) in graph data analysis and their deployment on Machine Learning as a Service platforms have raised critical concerns about data misuse during model training. This situation is further…

机器学习 · 计算机科学 2023-12-14 Bang Wu , He Zhang , Xiangwen Yang , Shuo Wang , Minhui Xue , Shirui Pan , Xingliang Yuan

Training Graph Neural Networks (GNNs) on large graphs is challenging due to the conflict between the high memory demand and limited GPU memory. Recently, distributed full-graph GNN training has been widely adopted to tackle this problem.…

分布式、并行与集群计算 · 计算机科学 2023-03-03 Meng Zhang , Qinghao Hu , Peng Sun , Yonggang Wen , Tianwei Zhang

Graph Neural Networks (GNNs) are emerging as a powerful tool for learning from graph-structured data and performing sophisticated inference tasks in various application domains. Although GNNs have been shown to be effective on modest-sized…

分布式、并行与集群计算 · 计算机科学 2025-05-29 Jeongmin Brian Park , Vikram Sharma Mailthody , Zaid Qureshi , Wen-mei Hwu

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which…

分布式、并行与集群计算 · 计算机科学 2022-04-19 Haiyang Lin , Mingyu Yan , Xiaocheng Yang , Mo Zou , Wenming Li , Xiaochun Ye , Dongrui Fan

Graph neural networks (GNNs) have been demonstrated as a powerful tool for analyzing non-Euclidean graph data. However, the lack of efficient distributed graph learning systems severely hinders applications of GNNs, especially when graphs…

Graph neural networks (GNNs) can extract features by learning both the representation of each objects (i.e., graph nodes) and the relationship across different objects (i.e., the edges that connect nodes), achieving state-of-the-art…

硬件体系结构 · 计算机科学 2022-05-11 Yunjae Lee , Jinha Chung , Minsoo Rhu

Graph neural networks (GNN) analysis engines are vital for real-world problems that use large graph models. Challenges for a GNN hardware platform include the ability to (a) host a variety of GNNs, (b) handle high sparsity in input vertex…

硬件体系结构 · 计算机科学 2021-08-10 Sudipta Mondal , Susmita Dey Manasi , Kishor Kunal , S. Ramprasath , Sachin S. Sapatnekar

The graph convolutional network (GCN) is a go-to solution for machine learning on graphs, but its training is notoriously difficult to scale both in terms of graph size and the number of model parameters. Although some work has explored…