English
Related papers

Related papers: Characterizing and Understanding HGNNs on GPUs

200 papers

Edge intelligence has arisen as a promising computing paradigm for supporting miscellaneous smart applications that rely on machine learning techniques. While the community has extensively investigated multi-tier edge deployment for…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Liekang Zeng , Chongyu Yang , Peng Huang , Zhi Zhou , Shuai Yu , Xu Chen

The growing interest in hypergraph neural networks (HGNNs) is driven by their capacity to capture the complex relationships and patterns within hypergraph structured data across various domains, including computer vision, complex networks,…

Machine Learning · Computer Science 2025-03-12 Murong Yang , Xin-Jian Xu

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making them…

Machine Learning · Computer Science 2020-03-04 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Yizhou Sun

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent…

Machine Learning · Computer Science 2024-09-04 Jun Hu , Bryan Hooi , Bingsheng He

Graph neural networks (GNNs) process large-scale graphs consisting of a hundred billion edges. In contrast to traditional deep learning, unique behaviors of the emerging GNNs are engaged with a large set of graphs and embedding data on…

Hardware Architecture · Computer Science 2022-01-25 Miryeong Kwon , Donghyun Gouk , Sangwon Lee , Myoungsoo Jung

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

As the performance of computer systems stagnates due to the end of Moore's Law, there is a need for new models that can understand and optimize the execution of general purpose code. While there is a growing body of work on using Graph…

Machine Learning · Computer Science 2020-03-12 Zhan Shi , Kevin Swersky , Daniel Tarlow , Parthasarathy Ranganathan , Milad Hashemi

Graph neural networks (GNNs) have been widely used in deep learning on graphs. They can learn effective node representations that achieve superior performances in graph analysis tasks such as node classification and node clustering.…

Machine Learning · Computer Science 2021-04-19 Jianxin Li , Hao Peng , Yuwei Cao , Yingtong Dou , Hekai Zhang , Philip S. Yu , Lifang He

We present BatchGNN, a distributed CPU system that showcases techniques that can be used to efficiently train GNNs on terabyte-sized graphs. It reduces communication overhead with macrobatching in which multiple minibatches' subgraph…

Machine Learning · Computer Science 2023-06-27 Loc Hoang , Rita Brugarolas Brufau , Ke Ding , Bo Wu

Graph neural networks (GNNs) emerge as a powerful approach to process non-euclidean data structures and have been proved powerful in various application domains such as social networks and e-commerce. While such graph data maintained in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-06 Shengwen Liang , Ying Wang , Cheng Liu , Lei He , Huawei Li , Xiaowei Li

Heterogeneous graph neural networks (HGNNs) excel at processing heterogeneous graph data and are widely applied in critical domains. In HGNN inference, the neighbor aggregation stage is the primary performance determinant, yet it suffers…

Hardware Architecture · Computer Science 2025-08-12 Dengke Han , Duo Wang , Mingyu Yan , Xiaochun Ye , Dongrui Fan

The study of Graph Neural Networks has received considerable interest in the past few years. By extending deep learning to graph-structured data, GNNs can solve a diverse set of tasks in fields including social science, chemistry, and…

Machine Learning · Computer Science 2024-03-12 Ashwin Nalwade , Kelly Marshall , Axel Eladi , Umang Sharma

Relational graph neural networks (RGNNs) are graph neural networks with dedicated structures for modeling the different types of nodes and edges in heterogeneous graphs. While RGNNs have been increasingly adopted in many real-world…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Kun Wu , Mert Hidayetoğlu , Xiang Song , Sitao Huang , Da Zheng , Israt Nisa , Wen-mei Hwu

Graph neural networks (GNNs) have demonstrated excellent performance in semi-supervised node classification tasks. Despite this, two primary challenges persist: heterogeneity and heterophily. Each of these two challenges can significantly…

Machine Learning · Computer Science 2025-04-14 Kangkang Lu , Yanhua Yu , Zhiyong Huang , Yunshan Ma , Xiao Wang , Meiyu Liang , Yuling Wang , Yimeng Ren , Tat-Seng Chua

Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent years owing to their capability to model and learn from graph-structured data. Such an ability has strong implications in a wide variety of fields whose…

Machine Learning · Computer Science 2021-07-26 Sergi Abadal , Akshay Jain , Robert Guirado , Jorge López-Alonso , Eduard Alarcón

Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla GNNs usually fail to scale up, limited by the GPU memory…

Machine Learning · Computer Science 2023-03-02 Keyu Duan , Zirui Liu , Peihao Wang , Wenqing Zheng , Kaixiong Zhou , Tianlong Chen , Xia Hu , Zhangyang Wang

Message passing on hypergraphs has been a standard framework for learning higher-order correlations between hypernodes. Recently-proposed hypergraph neural networks (HGNNs) can be categorized into spatial and spectral methods based on their…

Machine Learning · Computer Science 2024-05-28 Siddhant Saxena , Shounak Ghatak , Raghu Kolla , Debashis Mukherjee , Tanmoy Chakraborty