English
Related papers

Related papers: Improving Graph Neural Networks at Scale: Combinin…

200 papers

While kernel methods and Graph Neural Networks offer complementary strengths, integrating the two has posed challenges in efficiency and scalability. The Graph Neural Tangent Kernel provides a theoretical bridge by interpreting GNNs through…

Machine Learning · Computer Science 2025-07-17 Lin Wang , Shijie Wang , Sirui Huang , Qing Li

Heterogeneous graphs offer powerful data representations for traffic, given their ability to model the complex interaction effects among a varying number of traffic participants and the underlying road infrastructure. With the recent advent…

Machine Learning · Computer Science 2023-04-25 Eivind Meyer , Maurice Brenner , Bowen Zhang , Max Schickert , Bilal Musani , Matthias Althoff

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Graph Neural Networks (GNNs) have shown success in learning from graph structured data containing node/edge feature information, with application to social networks, recommendation, fraud detection and knowledge graph reasoning. In this…

Machine Learning · Computer Science 2021-11-24 Xiang Song , Runjie Ma , Jiahang Li , Muhan Zhang , David Paul Wipf

Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise relevance propagation for GNN), emerged as powerful tools for unraveling how different…

Machine Learning · Computer Science 2026-05-22 Ping Xiong , Thomas Schnake , Grégoire Montavon , Klaus-Robert Müller , Shinichi Nakajima

Recent advancements in Graph Neural Networks (GNN) have facilitated their widespread adoption in various applications, including recommendation systems. GNNs have proven to be effective in addressing the challenges posed by recommendation…

Information Retrieval · Computer Science 2026-03-24 Antonio Purificato , Giulia Cassarà , Federico Siciliano , Pietro Liò , Fabrizio Silvestri

Researches on analyzing graphs with Graph Neural Networks (GNNs) have been receiving more and more attention because of the great expressive power of graphs. GNNs map the adjacency matrix and node features to node representations by message…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Hanyue Chen , Guojie Song

Time series forecasting is an extensively studied subject in statistics, economics, and computer science. Exploration of the correlation and causation among the variables in a multivariate time series shows promise in enhancing the…

Machine Learning · Computer Science 2021-04-22 Chao Shang , Jie Chen , Jinbo Bi

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

Machine Learning · Computer Science 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

We explore the feasibility of combining Graph Neural Network-based policy architectures with Deep Reinforcement Learning as an approach to problems in systems. This fits particularly well with operations on networks, which naturally take…

Machine Learning · Computer Science 2021-12-02 Oliver Hope , Eiko Yoneki

Graph Neural Networks (GNNs) have emerged as a powerful tool to learn from graph-structured data. A paramount example of such data is the brain, which operates as a network, from the micro-scale of neurons, to the macro-scale of regions.…

Machine Learning · Computer Science 2022-11-17 Ahmed ElGazzar , Rajat Thomas , Guido van Wingen

Graph Neural Networks (GNNs) have advanced spatiotemporal forecasting by leveraging relational inductive biases among sensors (or any other measuring scheme) represented as nodes in a graph. However, current methods often rely on Recurrent…

Machine Learning · Computer Science 2024-05-30 Aref Einizade , Fragkiskos D. Malliaros , Jhony H. Giraldo

Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields…

Machine Learning · Computer Science 2024-12-03 Chendi Qian , Andrei Manolache , Christopher Morris , Mathias Niepert

Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-02 Yi-Chien Lin , Viktor Prasanna

In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-based tasks. However, current neural-message passing…

Machine Learning · Computer Science 2021-04-21 Wentao Zhang , Yu Shen , Zheyu Lin , Yang Li , Xiaosen Li , Wen Ouyang , Yangyu Tao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs), especially message-passing-based models, have become prominent in top-k recommendation tasks, outperforming matrix factorization models due to their ability to efficiently aggregate information from a broader…

Information Retrieval · Computer Science 2024-07-12 Yannis Karmim , Elias Ramzi , Raphaël Fournier-S'niehotta , Nicolas Thome

Recent advances in neural algorithmic reasoning with graph neural networks (GNNs) are propped up by the notion of algorithmic alignment. Broadly, a neural network will be better at learning to execute a reasoning task (in terms of sample…

Machine Learning · Computer Science 2022-10-12 Andrew Dudzik , Petar Veličković

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan