English
Related papers

Related papers: Beyond Message Passing: A Symbolic Alternative for…

200 papers

Graph Neural Networks (GNNs) have emerged as prominent models for representation learning on graph structured data. GNNs follow an approach of message passing analogous to 1-dimensional Weisfeiler Lehman (1-WL) test for graph isomorphism…

Machine Learning · Computer Science 2022-03-18 Mohammed Haroon Dupty , Wee Sun Lee

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

Machine Learning · Computer Science 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-based tasks. However, current neural-message passing…

Machine Learning · Computer Science 2021-04-21 Wentao Zhang , Yu Shen , Zheyu Lin , Yang Li , Xiaosen Li , Wen Ouyang , Yangyu Tao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have emerged as a dominant paradigm for graph classification. Specifically, most existing GNNs mainly rely on the message passing strategy between neighbor nodes, where the expressivity is limited by the…

Machine Learning · Computer Science 2025-12-12 Lin Du , Lu Bai , Jincheng Li , Lixin Cui , Hangyuan Du , Lichi Zhang , Yuting Chen , Zhao Li

Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees…

Machine Learning · Computer Science 2024-01-10 Jiaxing Xu , Aihu Zhang , Qingtian Bian , Vijay Prakash Dwivedi , Yiping Ke

Message passing Graph Neural Networks (GNNs) are known to be limited in expressive power by the 1-WL color-refinement test for graph isomorphism. Other more expressive models either are computationally expensive or need preprocessing to…

Machine Learning · Computer Science 2024-02-01 Mohammed Haroon Dupty , Yanfei Dong , Wee Sun Lee

Graph neural networks (GNNs) are widely used in graph learning and most architectures propagate information by passing messages between vertices. In this work, we shift our attention to GNNs that perform message passing on edges and…

Machine Learning · Computer Science 2026-02-03 Pablo Barceló , Fabian Jogl , Alexander Kozachinskiy , Matthias Lanzinger , Stefan Neumann , Cristóbal Rojas

Graph Neural Networks (GNNs) are widely used to compute representations of node pairs for downstream tasks such as link prediction. Yet, theoretical understanding of their expressive power has focused almost entirely on graph-level…

Machine Learning · Computer Science 2025-07-01 Veronica Lachi , Francesco Ferrini , Antonio Longa , Bruno Lepri , Andrea Passerini , Manfred Jaeger

Most Graph Neural Networks (GNNs) propagate messages by treating node embeddings as holistic feature vectors, implicitly assuming uniform relevance across feature dimensions. This limits their ability to selectively transmit informative…

Machine Learning · Computer Science 2025-12-24 Longlong Li , Mengyang Zhao , Guanghui Wang , Cunquan Qu

Graph Neural Networks (GNNs) face fundamental limitations in expressivity and capturing structural heterogeneity. Standard message-passing architectures are constrained by the 1-dimensional Weisfeiler-Leman (1-WL) test, unable to…

Machine Learning · Computer Science 2026-05-19 Asela Hevapathige , Ahad N. Zehmakan , Asiri Wijesinghe , Saman Halgamuge

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt

Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure…

Machine Learning · Computer Science 2024-01-17 Bohang Zhang , Jingchu Gai , Yiheng Du , Qiwei Ye , Di He , Liwei Wang

Similarly to other connectionist models, Graph Neural Networks (GNNs) lack transparency in their decision-making. A number of sub-symbolic approaches have been developed to provide insights into the GNN decision making process. These are…

Artificial Intelligence · Computer Science 2021-12-06 Anna Himmelhuber , Stephan Grimm , Sonja Zillner , Mitchell Joblin , Martin Ringsquandl , Thomas Runkler

Message-passing neural networks (MPNNs) are the leading architecture for deep learning on graph-structured data, in large part due to their simplicity and scalability. Unfortunately, it was shown that these architectures are limited in…

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

Machine Learning · Computer Science 2022-06-24 Jacob Bamberger

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Graph neural networks (GNNs) have become a standard paradigm for graph representation learning, yet their message passing mechanism implicitly assumes that messages can be represented by source node embeddings, an assumption that fails in…

Artificial Intelligence · Computer Science 2026-03-02 Dawei Cheng , Wenjun Wang , Mingjian Guang

Graph neural networks (GNNs) are the standard for learning on graphs, yet they have limited expressive power, often expressed in terms of the Weisfeiler-Leman (WL) hierarchy or within the framework of first-order logic. In this context,…

Machine Learning · Computer Science 2026-04-22 Amirreza Akbari , Amauri H. Souza , Vikas Garg

Graph Neural Networks (GNNs) have shown great power in various domains. However, their predictions may inherit societal biases on sensitive attributes, limiting their adoption in real-world applications. Although many efforts have been…

Machine Learning · Computer Science 2023-06-21 Huaisheng Zhu , Guoji Fu , Zhimeng Guo , Zhiwei Zhang , Teng Xiao , Suhang Wang

Numerous recent works have analyzed the expressive power of message-passing graph neural networks (MPNNs), primarily utilizing combinatorial techniques such as the $1$-dimensional Weisfeiler-Leman test ($1$-WL) for the graph isomorphism…

Machine Learning · Computer Science 2023-11-03 Jan Böker , Ron Levie , Ningyuan Huang , Soledad Villar , Christopher Morris