English
Related papers

Related papers: DF-GNN: Dynamic Fusion Framework for Attention Gra…

200 papers

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to ubiquitous graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel…

Machine Learning · Computer Science 2022-01-24 Stefan Abi-Karam , Yuqi He , Rishov Sarkar , Lakshmi Sathidevi , Zihang Qiao , Cong Hao

Graph neural networks (GNNs) have recently emerged as a promising learning paradigm in learning graph-structured data and have demonstrated wide success across various domains such as recommendation systems, social networks, and electronic…

Machine Learning · Computer Science 2023-04-25 Ruixuan Wang , Fred Lin , Daniel Moore , Sriram Sankar , Xun Jiao

Dynamic graph neural networks (DGNNs) have emerged and been widely deployed in various web applications (e.g., Reddit) to serve users (e.g., personalized content delivery) due to their remarkable ability to learn from complex and dynamic…

Machine Learning · Computer Science 2025-02-04 He Zhang , Bang Wu , Xiangwen Yang , Xingliang Yuan , Xiaoning Liu , Xun Yi

Heterogeneous graph neural networks (HGNNs) have emerged as powerful algorithms for processing heterogeneous graphs (HetGs), widely used in many critical fields. To capture both structural and semantic information in HetGs, HGNNs first…

Hardware Architecture · Computer Science 2024-04-29 Runzhen Xue , Dengke Han , Mingyu Yan , Mo Zou , Xiaocheng Yang , Duo Wang , Wenming Li , Zhimin Tang , John Kim , Xiaochun Ye , Dongrui Fan

Full batch training of Graph Convolutional Network (GCN) models is not feasible on a single GPU for large graphs containing tens of millions of vertices or more. Recent work has shown that, for the graphs used in the machine learning…

Machine Learning · Computer Science 2021-10-19 Muhammed Fatih Balın , Kaan Sancak , Ümit V. Çatalyürek

With the increasing adoption of graph neural networks (GNNs) in the machine learning community, GPUs have become an essential tool to accelerate GNN training. However, training GNNs on very large graphs that do not fit in GPU memory is…

Machine Learning · Computer Science 2021-01-21 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu

This paper proposes a Fast Graph Convolutional Neural Network (FGRNN) architecture to predict sequences with an underlying graph structure. The proposed architecture addresses the limitations of the standard recurrent neural network (RNN),…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Sai Kiran Kadambari , Sundeep Prabhakar Chepuri

Graph analytics are vital in fields such as social networks, biomedical research, and graph neural networks (GNNs). However, traditional CPUs and GPUs struggle with the memory bottlenecks caused by large graph datasets and their…

Hardware Architecture · Computer Science 2024-11-25 Oluwole Jaiyeoba , Abdullah T. Mughrabi , Morteza Baradaran , Beenish Gul , Kevin Skadron

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Advancement in finite element methods have become essential in various disciplines, and in particular for Computational Fluid Dynamics (CFD), driving research efforts for improved precision and efficiency. While Convolutional Neural…

Machine Learning · Computer Science 2025-08-27 Paul Garnier , Jonathan Viquerat , Elie Hachem

Equivariant Graph Neural Networks (GNNs) have achieved remarkable success across diverse scientific applications. However, existing approaches face critical efficiency challenges when scaling to large geometric graphs and suffer significant…

Machine Learning · Computer Science 2025-06-25 Yuelin Zhang , Jiacheng Cen , Jiaqi Han , Wenbing Huang

Graph Neural Networks (GNNs) have been widely used for modeling graph-structured data. With the development of numerous GNN variants, recent years have witnessed groundbreaking results in improving the scalability of GNNs to work on static…

Machine Learning · Computer Science 2022-06-06 Yanping Zheng , Hanzhi Wang , Zhewei Wei , Jiajun Liu , Sibo Wang

Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dynamics of biological neural networks. While SNNs show…

Artificial Intelligence · Computer Science 2024-08-02 Yanchen Li , Jiachun Li , Kebin Sun , Luziwei Leng , Ran Cheng

The device-edge co-inference paradigm effectively bridges the gap between the high resource demands of Graph Neural Networks (GNNs) and limited device resources, making it a promising solution for advancing edge GNN applications. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Ao Zhou , Jianlei Yang , Tong Qiao , Yingjie Qi , Xinming Wei , Cenlin Duan , Weisheng Zhao , Chunming Hu

Graph Neural Networks (GNNs) have recently become increasingly popular due to their ability to learn complex systems of relations or interactions arising in a broad spectrum of problems ranging from biology and particle physics to social…

Machine Learning · Computer Science 2020-10-12 Emanuele Rossi , Ben Chamberlain , Fabrizio Frasca , Davide Eynard , Federico Monti , Michael Bronstein

Training a Graph Neural Network (GNN) model on large-scale graphs involves a high volume of data communication and computations. While state-of-the-art CPUs and GPUs feature high computing power, the Standard GNN training protocol adopted…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-28 Yi-Chien Lin , Gangda Deng , Viktor Prasanna

GPUs are currently the platform of choice for training neural networks. However, training a deep neural network (DNN) is a time-consuming process even on GPUs because of the massive number of parameters that have to be learned. As a result,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Behnam Pourghassemi , Chenghao Zhang , Joo Hwan Lee , Aparna Chandramowlishwaran

In recent years, Graph Neural Networks (GNNs) appear to be state-of-the-art algorithms for analyzing non-euclidean graph data. By applying deep-learning to extract high-level representations from graph structures, GNNs achieve extraordinary…

Artificial Intelligence · Computer Science 2021-06-28 Zhe Zhou , Bizhao Shi , Zhe Zhang , Yijin Guan , Guangyu Sun , Guojie Luo

Graph neural networks (GNNs) emerge as a powerful approach to process non-euclidean data structures and have been proved powerful in various application domains such as social networks and e-commerce. While such graph data maintained in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-06 Shengwen Liang , Ying Wang , Cheng Liu , Lei He , Huawei Li , Xiaowei Li

Deep learning (DL) frameworks take advantage of GPUs to improve the speed of DL inference and training. Ideally, DL frameworks should be able to fully utilize the computation power of GPUs such that the running time depends on the amount of…

Machine Learning · Computer Science 2020-12-07 Woosuk Kwon , Gyeong-In Yu , Eunji Jeong , Byung-Gon Chun