English
Related papers

Related papers: Going Deeper into Permutation-Sensitive Graph Neur…

200 papers

Graph Neural Networks (GNNs) have emerged as a dominant approach in graph representation learning, yet they often struggle to capture consistent similarity relationships among graphs. While graph kernel methods such as the Weisfeiler-Lehman…

Machine Learning · Computer Science 2024-12-12 Xuyuan Liu , Yinghao Cai , Qihui Yang , Yujun Yan

Graph neural networks (GNNs) have been shown promising in improving the efficiency of learning communication policies by leveraging their permutation properties. Nonetheless, existing works design GNNs only for specific wireless policies,…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Shengjie Liu , Jia Guo , Chenyang Yang

Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees…

Machine Learning · Computer Science 2024-01-10 Jiaxing Xu , Aihu Zhang , Qingtian Bian , Vijay Prakash Dwivedi , Yiping Ke

Graph Neural Networks (GNNs) have emerged as prominent models for representation learning on graph structured data. GNNs follow an approach of message passing analogous to 1-dimensional Weisfeiler Lehman (1-WL) test for graph isomorphism…

Machine Learning · Computer Science 2022-03-18 Mohammed Haroon Dupty , Wee Sun Lee

Graph neural networks (GNNs) have emerged recently as a powerful architecture for learning node and graph representations. Standard GNNs have the same expressive power as the Weisfeiler-Leman test of graph isomorphism in terms of…

Machine Learning · Statistics 2020-08-11 Giannis Nikolentzos , George Dasoulas , Michalis Vazirgiannis

We propose an end-to-end deep learning learning model for graph classification and representation learning that is invariant to permutation of the nodes of the input graphs. We address the challenge of learning a fixed size graph…

Machine Learning · Computer Science 2019-05-09 Peter Meltzer , Marcelo Daniel Gutierrez Mallea , Peter J. Bentley

Graph Neural Networks (GNNs) are a large class of relational models for graph processing. Recent theoretical studies on the expressive power of GNNs have focused on two issues. On the one hand, it has been proven that GNNs are as powerful…

Graph Neural Networks (GNNs) face fundamental limitations in expressivity and capturing structural heterogeneity. Standard message-passing architectures are constrained by the 1-dimensional Weisfeiler-Leman (1-WL) test, unable to…

Machine Learning · Computer Science 2026-05-19 Asela Hevapathige , Ahad N. Zehmakan , Asiri Wijesinghe , Saman Halgamuge

Graph neural networks are designed to learn functions on graphs. Typically, the relevant target functions are invariant with respect to actions by permutations. Therefore the design of some graph neural network architectures has been…

Machine Learning · Statistics 2022-11-03 Ningyuan Huang , Soledad Villar

The expressive power of message passing GNNs is upper-bounded by Weisfeiler-Lehman (WL) test. To achieve high expressive GNNs beyond WL test, we propose a novel graph isomorphism test method, namely Twin-WL, which simultaneously passes node…

Machine Learning · Computer Science 2022-03-23 Zhaohui Wang , Qi Cao , Huawei Shen , Bingbing Xu , Xueqi Cheng

In recent years, graph neural networks (GNNs) have emerged as a powerful neural architecture to learn vector representations of nodes and graphs in a supervised, end-to-end fashion. Up to now, GNNs have only been evaluated empirically --…

Graph matching refers to finding node correspondence between graphs, such that the corresponding node and edge's affinity can be maximized. In addition with its NP-completeness nature, another important challenge is effective modeling of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Runzhong Wang , Junchi Yan , Xiaokang Yang

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

Graph neural networks have been widely used on modeling graph data, achieving impressive results on node classification and link prediction tasks. Yet, obtaining an accurate representation for a graph further requires a pooling function…

Machine Learning · Computer Science 2021-06-29 Jinheon Baek , Minki Kang , Sung Ju Hwang

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not scale to large…

Machine Learning · Computer Science 2022-08-31 Christopher Morris , Gaurav Rattan , Sandra Kiefer , Siamak Ravanbakhsh

Graph Neural Networks (GNNs) have achieved much success on graph-structured data. In light of this, there have been increasing interests in studying their expressive power. One line of work studies the capability of GNNs to approximate…

Machine Learning · Computer Science 2023-02-14 Zhengdao Chen , Soledad Villar , Lei Chen , Joan Bruna

Diffusion models based on permutation-equivariant networks can learn permutation-invariant distributions for graph data. However, in comparison to their non-invariant counterparts, we have found that these invariant models encounter greater…

Machine Learning · Computer Science 2024-06-21 Qi Yan , Zhengyang Liang , Yang Song , Renjie Liao , Lele Wang

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

Machine Learning · Computer Science 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

Machine Learning · Computer Science 2024-04-02 Quang Truong , Peter Chin

Despite the remarkable success of Graph Neural Networks (GNNs), the common belief is that their representation power is limited and that they are at most as expressive as the Weisfeiler-Lehman (WL) algorithm. In this paper, we argue the…

Machine Learning · Computer Science 2023-07-25 Charilaos I. Kanatsoulis , Alejandro Ribeiro