English
Related papers

Related papers: SmartSAGE: Training Large-scale Graph Neural Netwo…

200 papers

Graph Neural Networks (GNNs) have emerged as highly successful tools for graph-related tasks. However, real-world problems involve very large graphs, and the compute resources needed to fit GNNs to those problems grow rapidly. Moreover, the…

Machine Learning · Computer Science 2021-11-11 Eitan Kosman , Joel Oren , Dotan Di Castro

Deep neural networks (DNNs) have succeeded in many different perception tasks, e.g., computer vision, natural language processing, reinforcement learning, etc. The high-performed DNNs heavily rely on intensive resource consumption. For…

Machine Learning · Computer Science 2022-10-10 Zhongnan Qu

Graph Neural Networks (GNNs) have demonstrated significant achievements in processing graph data, yet scalability remains a substantial challenge. To address this, numerous graph coarsening methods have been developed. However, most…

Machine Learning · Computer Science 2024-12-19 Shuyin Xia , Xinjun Ma , Zhiyuan Liu , Cheng Liu , Sen Zhao , Guoyin Wang

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

We propose a theoretical framework for training Graph Neural Networks (GNNs) on large input graphs via training on small, fixed-size sampled subgraphs. This framework is applicable to a wide range of models, including popular sampling-based…

Machine Learning · Computer Science 2023-10-18 Yeganeh Alimohammadi , Luana Ruiz , Amin Saberi

Graph neural network (GNN) based methods have saturated the field of recommender systems. The gains of these systems have been significant, showing the advantages of interpreting data through a network structure. However, despite the…

Machine Learning · Computer Science 2022-09-12 Rebecca Salganik , Fernando Diaz , Golnoosh Farnadi

Low-latency deep spiking neural networks (SNNs) have become a promising alternative to conventional artificial neural networks (ANNs) because of their potential for increased energy efficiency on event-driven neuromorphic hardware. Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Souvik Kundu , Massoud Pedram , Peter A. Beerel

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

Machine Learning · Computer Science 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

Graph Neural Networks (GNNs) have shown significant success for graph-based tasks. Motivated by the prevalence of large datasets in real-world applications, pooling layers are crucial components of GNNs. By reducing the size of input…

Machine Learning · Computer Science 2026-01-13 Katharina Limbeck , Lydia Mezrag , Guy Wolf , Bastian Rieck

Graph Neural Networks (GNNs) have been widely employed for feature representation learning in molecular graphs. Therefore, it is crucial to enhance the expressiveness of feature representation to ensure the effectiveness of GNNs. However, a…

Machine Learning · Computer Science 2024-09-16 Chengyu Yao , Hong Huang , Hang Gao , Fengge Wu , Haiming Chen , Junsuo Zhao

Graph neural networks (GNNs) have demonstrated excellent performance in a wide range of applications. However, the enormous size of large-scale graphs hinders their applications under real-time inference scenarios. Although existing…

Machine Learning · Computer Science 2022-12-29 Xinyi Gao , Wentao Zhang , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph neural networks (GNNs) are a class of deep models that operate on data with arbitrary topology represented as graphs. We introduce an efficient memory layer for GNNs that can jointly learn node representations and coarsen the graph.…

Machine Learning · Computer Science 2020-06-11 Amir Hosein Khasahmadi , Kaveh Hassani , Parsa Moradi , Leo Lee , Quaid Morris

Graph Neural Networks (GNNs) are a computationally efficient method to learn embeddings and classifications on graph data. However, GNN training has low computational intensity, making communication costs the bottleneck for scalability.…

Machine Learning · Computer Science 2025-04-08 Ujjaini Mukhodopadhyay , Alok Tripathy , Oguz Selvitopi , Katherine Yelick , Aydin Buluc

Graphs are omnipresent and GNNs are a powerful family of neural networks for learning over graphs. Despite their popularity, scaling GNNs either by deepening or widening suffers from prevalent issues of unhealthy gradients,…

Machine Learning · Computer Science 2023-08-25 Ajay Jaiswal , Shiwei Liu , Tianlong Chen , Ying Ding , Zhangyang Wang

Machine learning over graphs have been emerging as powerful learning tools for graph data. However, it is challenging for industrial communities to leverage the techniques, such as graph neural networks (GNNs), and solve real-world problems…

Social and Information Networks · Computer Science 2020-03-17 Dalong Zhang , Xin Huang , Ziqi Liu , Zhiyang Hu , Xianzheng Song , Zhibang Ge , Zhiqiang Zhang , Lin Wang , Jun Zhou , Yang Shuang , Yuan Qi

Graph neural networks (GNNs) are often trained on individual datasets, requiring specialized models and significant hyperparameter tuning due to the unique structures and features of each dataset. This approach limits the scalability and…

Machine Learning · Computer Science 2026-02-17 Divyansha Lachi , Mehdi Azabou , Vinam Arora , Eva Dyer

Partitioning is a known problem in computer science and is critical in chip design workflows, as advancements in this area can significantly influence design quality and efficiency. Deep Learning (DL) techniques, particularly those…

Hardware Architecture · Computer Science 2024-09-04 Muhammad Hadir Khan , Bugra Onal , Eren Dogan , Matthew R. Guthaus

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

Machine Learning · Computer Science 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang

Traffic flow forecasting is a critical spatio-temporal data mining task with wide-ranging applications in intelligent route planning and dynamic traffic management. Recent advancements in deep learning, particularly through Graph Neural…

Machine Learning · Computer Science 2025-05-14 Weiyang Kong , Kaiqi Wu , Sen Zhang , Yubao Liu