中文
相关论文

相关论文: Ginex: SSD-enabled Billion-scale Graph Neural Netw…

200 篇论文

Graph Neural Networks (GNNs) are becoming a promising technique in various domains due to their excellent capabilities in modeling non-Euclidean data. Although a spectrum of accelerators has been proposed to accelerate the inference of…

硬件体系结构 · 计算机科学 2023-11-17 Zeyu Zhu , Fanrong Li , Gang Li , Zejian Liu , Zitao Mo , Qinghao Hu , Xiaoyao Liang , Jian Cheng

Graph neural networks (GNNs) have emerged as a promising direction. Training large-scale graphs that relies on distributed computing power poses new challenges. Existing distributed GNN systems leverage data parallelism by partitioning the…

分布式、并行与集群计算 · 计算机科学 2024-12-31 Xin Ai , Hao Yuan , Zeyu Ling , Qiange Wang , Yanfeng Zhang , Zhenbo Fu , Chaoyi Chen , Yu Gu , Ge Yu

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

机器学习 · 计算机科学 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

Graph Neural Networks (GNNs) have emerged as potent models for graph learning. Distributing the training process across multiple computing nodes is the most promising solution to address the challenges of ever-growing real-world graphs.…

机器学习 · 计算机科学 2024-05-13 Yuxiang Zhang , Xin Liu , Meng Wu , Wei Yan , Mingyu Yan , Xiaochun Ye , Dongrui Fan

Many widely used datasets for graph machine learning tasks have generally been homophilous, where nodes with similar labels connect to each other. Recently, new Graph Neural Networks (GNNs) have been developed that move beyond the homophily…

机器学习 · 计算机科学 2021-10-28 Derek Lim , Felix Hohne , Xiuyu Li , Sijia Linda Huang , Vaishnavi Gupta , Omkar Bhalerao , Ser-Nam Lim

Despite recent advances in Graph Neural Networks (GNNs), their training strategies remain largely under-explored. The conventional training strategy learns over all nodes in the original graph(s) equally, which can be sub-optimal as certain…

Deep learning thrives with large neural networks and large datasets. However, larger networks and larger datasets result in longer training times that impede research and development progress. Distributed synchronous SGD offers a potential…

计算机视觉与模式识别 · 计算机科学 2018-05-02 Priya Goyal , Piotr Dollár , Ross Girshick , Pieter Noordhuis , Lukasz Wesolowski , Aapo Kyrola , Andrew Tulloch , Yangqing Jia , Kaiming He

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

机器学习 · 计算机科学 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

Full-graph training on graph neural networks (GNN) has emerged as a promising training method for its effectiveness. Full-graph training requires extensive memory and computation resources. To accelerate this training process, researchers…

分布式、并行与集群计算 · 计算机科学 2023-11-28 Qiange Wang , Yao Chen , Weng-Fai Wong , Bingsheng He

Graph neural networks have achieved state-of-the-art accuracy for graph node classification. However, GNNs are difficult to scale to large graphs, for example frequently encountering out-of-memory errors on even moderate size graphs. Recent…

机器学习 · 计算机科学 2022-10-26 Ziyuan Wang , Feiming Yang , Rui Fan

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

机器学习 · 计算机科学 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

Graph Neural Networks (GNNs) have demonstrated a great potential in a variety of graph-based applications, such as recommender systems, drug discovery, and object recognition. Nevertheless, resource-efficient GNN learning is a rarely…

机器学习 · 计算机科学 2022-02-18 Zihui Xue , Yuedong Yang , Mengtian Yang , Radu Marculescu

Graph Neural Networks (GNNs) excel in various graph learning tasks but face computational challenges when applied to large-scale graphs. A promising solution is to remove non-essential edges to reduce the computational overheads in GNN.…

机器学习 · 计算机科学 2024-02-05 Guibin Zhang , Yanwei Yue , Kun Wang , Junfeng Fang , Yongduo Sui , Kai Wang , Yuxuan Liang , Dawei Cheng , Shirui Pan , Tianlong Chen

Graph Neural Networks (GNNs) have demonstrated outstanding performance in various applications. Existing frameworks utilize CPU-GPU heterogeneous environments to train GNN models and integrate mini-batch and sampling techniques to overcome…

分布式、并行与集群计算 · 计算机科学 2023-12-13 Xin Ai , Qiange Wang , Chunyu Cao , Yanfeng Zhang , Chaoyi Chen , Hao Yuan , Yu Gu , Ge Yu

Neural forecasting of spatiotemporal time series drives both research and industrial innovation in several relevant application domains. Graph neural networks (GNNs) are often the core component of the forecasting architecture. However, in…

机器学习 · 计算机科学 2023-02-21 Andrea Cini , Ivan Marisca , Filippo Maria Bianchi , Cesare Alippi

Graph Neural Networks (GNNs) have demonstrated significant achievements in processing graph data, yet scalability remains a substantial challenge. To address this, numerous graph coarsening methods have been developed. However, most…

机器学习 · 计算机科学 2024-12-19 Shuyin Xia , Xinjun Ma , Zhiyuan Liu , Cheng Liu , Sen Zhao , Guoyin Wang

Recently, Graph Transformers have emerged as a promising solution to alleviate the inherent limitations of Graph Neural Networks (GNNs) and enhance graph representation performance. Unfortunately, Graph Transformers are computationally…

神经与进化计算 · 计算机科学 2024-03-26 Yundong Sun , Dongjie Zhu , Yansong Wang , Zhaoshuo Tian , Ning Cao , Gregory O'Hared

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

机器学习 · 计算机科学 2021-06-15 Marco Serafini , Hui Guan

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle…

分布式、并行与集群计算 · 计算机科学 2024-11-05 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

机器学习 · 计算机科学 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang