English
Related papers

Related papers: Towards Affordable, Adaptive and Automatic GNN Tra…

200 papers

Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are…

Machine Learning · Computer Science 2021-06-14 Jialin Dong , Da Zheng , Lin F. Yang , Geroge Karypis

This paper explores the applications and challenges of graph neural networks (GNNs) in processing complex graph data brought about by the rapid development of the Internet. Given the heterogeneity and redundancy problems that graph data…

Machine Learning · Computer Science 2024-10-24 Jianjun Wei , Yue Liu , Xin Huang , Xin Zhang , Wenyi Liu , Xu Yan

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

Machine Learning · Computer Science 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

Machine Learning · Computer Science 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

Several distributed frameworks have been developed to scale Graph Neural Networks (GNNs) on billion-size graphs. On several benchmarks, we observe that the graph partitions generated by these frameworks have heterogeneous data distributions…

Machine Learning · Computer Science 2023-11-07 Dhruv Deshmukh , Gagan Raj Gupta , Manisha Chawla , Vishwesh Jatala , Anirban Haldar

The device-edge co-inference paradigm effectively bridges the gap between the high resource demands of Graph Neural Networks (GNNs) and limited device resources, making it a promising solution for advancing edge GNN applications. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Ao Zhou , Jianlei Yang , Tong Qiao , Yingjie Qi , Xinming Wei , Cenlin Duan , Weisheng Zhao , Chunming Hu

We propose a framework that automatically transforms non-scalable GNNs into precomputation-based GNNs which are efficient and scalable for large-scale graphs. The advantages of our framework are two-fold; 1) it transforms various…

Machine Learning · Computer Science 2022-07-26 Seiji Maekawa , Yuya Sasaki , George Fletcher , Makoto Onizuka

Recently graph neural network (GNN) based algorithms were proposed to solve a variety of combinatorial optimization problems, including Maximum Cut problem, Maximum Independent Set problem and similar other…

Machine Learning · Computer Science 2023-06-06 David Gamarnik

Graph Neural Networks (GNNs) have received much attention in the graph deep learning domain. However, recent research empirically and theoretically shows that deep GNNs suffer from over-fitting and over-smoothing problems. The usual…

Machine Learning · Computer Science 2022-09-05 Chuxiong Sun , Jie Hu , Hongming Gu , Jinpeng Chen , Mingchuan Yang

We present GraphTensor, a comprehensive open-source framework that supports efficient parallel neural network processing on large graphs. GraphTensor offers a set of easy-to-use programming primitives that appreciate both graph and neural…

Hardware Architecture · Computer Science 2023-05-30 Junhyeok Jang , Miryeong Kwon , Donghyun Gouk , Hanyeoreum Bae , Myoungsoo Jung

In real-world applications, spectral Graph Neural Networks (GNNs) are powerful tools for processing diverse types of graphs. However, a single GNN often struggles to handle different graph types-such as homogeneous and heterogeneous…

Machine Learning · Computer Science 2024-12-19 Shibing Mo , Kai Wu , Qixuan Gao , Xiangyi Teng , Jing Liu

Graph Neural Networks (GNNs) have revolutionized many Machine Learning (ML) applications, such as social network analysis, bioinformatics, etc. GNN inference can be accelerated by exploiting data sparsity in the input graph, vertex…

Hardware Architecture · Computer Science 2023-08-08 Paul Chen , Pavan Manjunath , Sasindu Wijeratne , Bingyi Zhang , Viktor Prasanna

Deep learning systems have been successfully applied to Euclidean data such as images, video, and audio. In many applications, however, information and their relationships are better expressed with graphs. Graph Convolutional Networks…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-14 Tong Geng , Ang Li , Runbin Shi , Chunshu Wu , Tianqi Wang , Yanfei Li , Pouya Haghi , Antonino Tumeo , Shuai Che , Steve Reinhardt , Martin Herbordt

Graph neural networks (GNNs) face significant challenges with class imbalance, leading to biased inference results. To address this issue in heterogeneous graphs, we propose a novel framework that combines Graph Neural Network (GNN) and…

Machine Learning · Computer Science 2024-11-26 Hung-Chun Hsu , Bo-Jun Wu , Ming-Yi Hong , Che Lin , Chih-Yu Wang

We present our work on developing and training scalable, trustworthy, and energy-efficient predictive graph foundation models (GFMs) using HydraGNN, a multi-headed graph convolutional neural network architecture. HydraGNN expands the…

In the last few years, the memory requirements to train state-of-the-art neural networks have far exceeded the DRAM capacities of modern hardware accelerators. This has necessitated the development of efficient algorithms to train these…

Machine Learning · Computer Science 2023-05-16 Siddharth Singh , Abhinav Bhatele

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

Graph Neural Networks (GNNs) use a fully-connected layer to extract features from the nodes of a graph and aggregate these features using message passing between nodes, combining two distinct computational patterns: dense, regular…

Hardware Architecture · Computer Science 2021-03-22 Jacob R. Stevens , Dipankar Das , Sasikanth Avancha , Bharat Kaul , Anand Raghunathan

Optimizing power control in multi-cell cellular networks with deep learning enables such a non-convex problem to be implemented in real-time. When channels are time-varying, the deep neural networks (DNNs) need to be re-trained frequently,…

Machine Learning · Computer Science 2020-11-09 Jia Guo , Chenyang Yang

Social recommendation based on social network has achieved great success in improving the performance of recommendation system. Since social network (user-user relations) and user-item interactions are both naturally represented as…

Information Retrieval · Computer Science 2021-09-27 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Ethan Chang , Bo Long
‹ Prev 1 3 4 5 6 7 10 Next ›