English
Related papers

Related papers: LSM-GNN: Large-scale Storage-based Multi-GPU GNN T…

200 papers

Graph Neural Networks (GNNs) are a class of neural networks designed to extract information from the graphical structure of data. Graph Convolutional Networks (GCNs) are a widely used type of GNN for transductive graph learning problems…

Machine Learning · Computer Science 2022-12-05 Matthew Adiletta , David Brooks , Gu-Yeon Wei

Most state-of-the-art Graph Neural Networks (GNNs) can be defined as a form of graph convolution which can be realized by message passing between direct neighbors or beyond. To scale such GNNs to large graphs, various neighbor-, layer-, or…

Machine Learning · Computer Science 2021-10-28 Mucong Ding , Kezhi Kong , Jingling Li , Chen Zhu , John P Dickerson , Furong Huang , Tom Goldstein

A recent Graph Neural Network (GNN) approach for learning to branch has been shown to successfully reduce the running time of branch-and-bound algorithms for Mixed Integer Linear Programming (MILP). While the GNN relies on a GPU for…

Machine Learning · Computer Science 2020-10-26 Prateek Gupta , Maxime Gasse , Elias B. Khalil , M. Pawan Kumar , Andrea Lodi , Yoshua Bengio

Graph Neural Networks (GNNs) are emerging ML models to analyze graph-structure data. Graph Neural Network (GNN) execution involves both compute-intensive and memory-intensive kernels, the latter dominates the total time, being significantly…

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Foundation Models (FMs) serve as a general class for the development of artificial intelligence systems, offering broad potential for generalization across a spectrum of downstream tasks. Despite extensive research into self-supervised…

Machine Learning · Computer Science 2024-06-17 Yuhao Xu , Xinqi Liu , Keyu Duan , Yi Fang , Yu-Neng Chuang , Daochen Zha , Qiaoyu Tan

Recently, graph neural networks (GNNs) have shown its unprecedented success in many graph-related tasks. However, GNNs face the label scarcity issue as other neural networks do. Thus, recent efforts try to pre-train GNNs on a large-scale…

Machine Learning · Computer Science 2024-03-04 Zhili Wang , Shimin Di , Lei Chen , Xiaofang Zhou

Graph Neural Networks (GNNs) are widely adopted in advanced AI systems due to their capability of representation learning on graph data. Even though GNN explanation is crucial to increase user trust in the systems, it is challenging due to…

Machine Learning · Computer Science 2022-08-08 Tien-Cuong Bui , Wen-syan Li , Sang-Kyun Cha

Graph neural networks (GNNs) gain wide popularity. Large graphs with high-dimensional features become common and training GNNs on them is non-trivial on an ordinary machine. Given a gigantic graph, even sample-based GNN training cannot work…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-21 Qisheng Jiang , Lei Jia , Chundong Wang

Partitioning is a known problem in computer science and is critical in chip design workflows, as advancements in this area can significantly influence design quality and efficiency. Deep Learning (DL) techniques, particularly those…

Hardware Architecture · Computer Science 2024-09-04 Muhammad Hadir Khan , Bugra Onal , Eren Dogan , Matthew R. Guthaus

Graph embeddings map graph nodes to continuous vectors and are foundational to community detection, recommendation, and many scientific applications. At billion-scale, however, existing graph embedding systems face a trade-off: they either…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Yunjun Gao , Feifei Li

Graph neural networks (GNNs) have recently emerged as a promising learning paradigm in learning graph-structured data and have demonstrated wide success across various domains such as recommendation systems, social networks, and electronic…

Machine Learning · Computer Science 2023-04-25 Ruixuan Wang , Fred Lin , Daniel Moore , Sriram Sankar , Xun Jiao

In recent years, pre-trained graph neural networks (GNNs) have been developed as general models which can be effectively fine-tuned for various potential downstream tasks in materials science, and have shown significant improvements in…

Materials Science · Physics 2025-03-04 Shuyi Jia , Shitij Govil , Manav Ramprasad , Victor Fung

End-to-end training of graph neural networks (GNN) on large graphs presents several memory and computational challenges, and limits the application to shallow architectures as depth exponentially increases the memory and space complexities.…

Machine Learning · Computer Science 2023-09-06 Oscar Pina , Verónica Vilaplana

Graph Neural Networks (GNNs) are increasingly important given their popularity and the diversity of applications. Yet, existing studies of their vulnerability to adversarial attacks rely on relatively small graphs. We address this gap and…

Machine Learning · Computer Science 2023-05-02 Simon Geisler , Tobias Schmidt , Hakan Şirin , Daniel Zügner , Aleksandar Bojchevski , Stephan Günnemann

Deep neural networks (DNNs) continue to grow rapidly in size, making them infeasible to train on a single device. Pipeline parallelism is commonly used in existing DNN systems to support large-scale DNN training by partitioning a DNN into…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-29 Byungsoo Jeon , Mengdi Wu , Shiyi Cao , Sunghyun Kim , Sunghyun Park , Neeraj Aggarwal , Colin Unger , Daiyaan Arfeen , Peiyuan Liao , Xupeng Miao , Mohammad Alizadeh , Gregory R. Ganger , Tianqi Chen , Zhihao Jia

Recent works have demonstrated the potential of Graph Neural Networks (GNN) for network intrusion detection. Despite their advantages, a significant gap persists between real-world scenarios, where detection speed is critical, and existing…

Machine Learning · Computer Science 2024-06-21 Louis Van Langendonck , Ismael Castell-Uroz , Pere Barlet-Ros

Graph Neural Networks (GNN) is an emerging field for learning on non-Euclidean data. Recently, there has been increased interest in designing GNN that scales to large graphs. Most existing methods use "graph sampling" or "layer-wise…

Machine Learning · Computer Science 2021-09-03 Ming Chen , Zhewei Wei , Bolin Ding , Yaliang Li , Ye Yuan , Xiaoyong Du , Ji-Rong Wen

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically large…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-15 Da Zheng , Xiang Song , Chengru Yang , Dominique LaSalle , George Karypis