English
Related papers

Related papers: Learning How to Propagate Messages in Graph Neural…

200 papers

Graph neural architecture search has sparked much attention as Graph Neural Networks (GNNs) have shown powerful reasoning capability in many relational tasks. However, the currently used graph search space overemphasizes learning node…

Machine Learning · Computer Science 2022-06-01 Shaofei Cai , Liang Li , Xinzhe Han , Jiebo Luo , Zheng-Jun Zha , Qingming Huang

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

Machine Learning · Computer Science 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

Machine Learning · Computer Science 2026-02-03 Yassine Abbahaddou

Graphs are ubiquitous in many applications, such as social networks, knowledge graphs, smart grids, etc.. Graph neural networks (GNN) are the current state-of-the-art for these applications, and yet remain obscure to humans. Explaining the…

Machine Learning · Computer Science 2021-11-22 Yazheng Liu , Xi Zhang , Sihong Xie

The dominant paradigm for machine learning on graphs uses Message Passing Graph Neural Networks (MP-GNNs), in which node representations are updated by aggregating information in their local neighborhood. Recently, there have been…

Machine Learning · Computer Science 2023-03-02 Daniel Glickman , Eran Yahav

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph neural networks (GNN) are deep learning architectures for graphs. Essentially, a GNN is a distributed message passing algorithm, which is controlled by parameters learned from data. It operates on the vertices of a graph: in each…

Logic in Computer Science · Computer Science 2024-05-21 Martin Grohe , Eran Rosenbluth

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

Graph neural networks (GNNs) have demonstrated excellent performance in a wide range of applications. However, the enormous size of large-scale graphs hinders their applications under real-time inference scenarios. Although existing…

Machine Learning · Computer Science 2022-12-29 Xinyi Gao , Wentao Zhang , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each…

Machine Learning · Computer Science 2022-05-25 Lukas Faber , Roger Wattenhofer

Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require careful domain-specific architecture designs and training from…

Machine Learning · Computer Science 2025-05-30 Jingzhe Liu , Haitao Mao , Zhikai Chen , Bingheng Li , Wenqi Fan , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

This paper presents a novel transformer architecture for graph representation learning. The core insight of our method is to fully consider the information propagation among nodes and edges in a graph when building the attention module in…

Machine Learning · Computer Science 2024-10-10 Zhe Chen , Hao Tan , Tao Wang , Tianrun Shen , Tong Lu , Qiuying Peng , Cheng Cheng , Yue Qi

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

Machine Learning · Computer Science 2021-06-15 Marco Serafini , Hui Guan

We study the generalization capabilities of Message Passing Neural Networks (MPNNs), a prevalent class of Graph Neural Networks (GNN). We derive generalization bounds specifically for MPNNs with normalized sum aggregation and mean…

Machine Learning · Computer Science 2024-04-05 Sohir Maskey , Gitta Kutyniok , Ron Levie

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data across various domains. Despite their great successful, one critical challenge is often overlooked by existing works, i.e., the…

Machine Learning · Computer Science 2024-02-15 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Potential-based reward shaping provides an approach for designing good reward functions, with the purpose of speeding up learning. However, automatically finding potential functions for complex environments is a difficult problem (in fact,…

Machine Learning · Computer Science 2021-02-22 Martin Klissarov , Doina Precup

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

With the wide-spread availability of complex relational data, semi-supervised node classification in graphs has become a central machine learning problem. Graph neural networks are a recent class of easy-to-train and accurate methods for…

Machine Learning · Computer Science 2021-06-08 Junteng Jia , Cenk Baykal , Vamsi K. Potluru , Austin R. Benson

Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application domains and achieved promising performance. However, GNNs…

Machine Learning · Computer Science 2021-12-14 Zeyu Zhang , Yulong Pei