English
Related papers

Related papers: EDEN: A Plug-in Equivariant Distance Encoding to B…

200 papers

The $k$-Weisfeiler-Leman ($k$-WL) graph isomorphism test hierarchy is a common method for assessing the expressive power of graph neural networks (GNNs). Recently, GNNs whose expressive power is equivalent to the $2$-WL test were proven to…

Machine Learning · Computer Science 2024-06-27 Snir Hordan , Tal Amir , Nadav Dym

Graph neural networks (GNNs) largely rely on the message-passing paradigm, where nodes iteratively aggregate information from their neighbors. Yet, standard message passing neural networks (MPNNs) face well-documented theoretical and…

Machine Learning · Computer Science 2026-05-15 Juan Amboage , Ernst Röell , Patrick Schnider , Bastian Rieck

In this paper we cast neural networks defined on graphs as message-passing neural networks (MPNNs) in order to study the distinguishing power of different classes of such models. We are interested in whether certain architectures are able…

Machine Learning · Computer Science 2020-04-07 Floris Geerts , Filip Mazowiecki , Guillermo A. Pérez

Graph Transformer has recently received wide attention in the research community with its outstanding performance, yet its structural expressive power has not been well analyzed. Inspired by the connections between Weisfeiler-Lehman (WL)…

Machine Learning · Computer Science 2023-05-24 Wenhao Zhu , Tianyu Wen , Guojie Song , Liang Wang , Bo Zheng

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

Machine Learning · Computer Science 2021-05-04 Jing Huang , Jie Yang

Geometric deep learning enables the encoding of physical symmetries in modeling 3D objects. Despite rapid progress in encoding 3D symmetries into Graph Neural Networks (GNNs), a comprehensive evaluation of the expressiveness of these…

Machine Learning · Computer Science 2023-04-12 Weitao Du , Yuanqi Du , Limei Wang , Dieqiao Feng , Guifeng Wang , Shuiwang Ji , Carla Gomes , Zhi-Ming Ma

Designing neural network architectures that can handle data symmetry is crucial. This is especially important for geometric graphs whose properties are equivariance under Euclidean transformations. Current equivariant graph neural networks…

Machine Learning · Computer Science 2025-03-14 Viet-Hoang Tran , Thieu N. Vo , Tho Tran Huu , Tan Minh Nguyen

This paper introduces E(n) Equivariant Message Passing Cellular Networks (EMPCNs), an extension of E(n) Equivariant Graph Neural Networks to CW-complexes. Our approach addresses two aspects of geometric message passing networks: 1)…

Machine Learning · Computer Science 2024-07-19 Veljko Kovač , Erik J. Bekkers , Pietro Liò , Floor Eijkelboom

Message passing neural networks (MPNNs) have become a dominant flavor of graph neural networks (GNNs) in recent years. Yet, MPNNs come with notable limitations; namely, they are at most as powerful as the 1-dimensional Weisfeiler-Leman…

Machine Learning · Computer Science 2022-11-04 Lingxiao Zhao , Louis Härtel , Neil Shah , Leman Akoglu

Graph Edit Distance (GED) is a fundamental, albeit NP-hard, metric for structural graph similarity. Recent neural graph matching architectures approximate GED by first encoding graphs with a Graph Neural Network (GNN) and then applying…

Machine Learning · Computer Science 2026-05-08 Jyotirmaya Shivottam , Subhankar Mishra

The accurate prediction of changes in protein stability under multiple amino acid substitutions is essential for realising true in-silico protein re-design. To this purpose, we propose improvements to state-of-the-art Deep learning (DL)…

Biomolecules · Quantitative Biology 2023-06-01 Sebastien Boyer , Sam Money-Kyrle , Oliver Bent

Graph neural networks (GNNs) have been widely used in graph-related contexts. It is known that the separation power of GNNs is equivalent to that of the Weisfeiler-Lehman (WL) test; hence, GNNs are imperfect at identifying all…

Machine Learning · Computer Science 2025-02-07 Ziang Chen , Qiao Zhang , Runzhong Wang

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein

In recent years, graph neural networks (GNNs) have emerged as a promising tool for solving machine learning problems on graphs. Most GNNs are members of the family of message passing neural networks (MPNNs). There is a close connection…

Machine Learning · Computer Science 2023-03-01 Giannis Nikolentzos , Michail Chatzianastasis , Michalis Vazirgiannis

Learning to reason about relations and dynamics over multiple interacting objects is a challenging topic in machine learning. The challenges mainly stem from that the interacting systems are exponentially-compositional, symmetrical, and…

Machine Learning · Computer Science 2022-03-15 Wenbing Huang , Jiaqi Han , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Graph Neural Networks (GNNs) are a large class of relational models for graph processing. Recent theoretical studies on the expressive power of GNNs have focused on two issues. On the one hand, it has been proven that GNNs are as powerful…

Incorporating Euclidean symmetries (e.g. rotation equivariance) as inductive biases into graph neural networks has improved their generalization ability and data efficiency in unbounded physical dynamics modeling. However, in various…

Machine Learning · Computer Science 2024-06-25 Zinan Zheng , Yang Liu , Jia Li , Jianhua Yao , Yu Rong

Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees…

Machine Learning · Computer Science 2024-01-10 Jiaxing Xu , Aihu Zhang , Qingtian Bian , Vijay Prakash Dwivedi , Yiping Ke

In this work we develop a new method, named Sub-graph Permutation Equivariant Networks (SPEN), which provides a framework for building graph neural networks that operate on sub-graphs, while using a base update function that is permutation…

Machine Learning · Computer Science 2022-10-18 Joshua Mitton , Roderick Murray-Smith

The expressive power of message passing GNNs is upper-bounded by Weisfeiler-Lehman (WL) test. To achieve high expressive GNNs beyond WL test, we propose a novel graph isomorphism test method, namely Twin-WL, which simultaneously passes node…

Machine Learning · Computer Science 2022-03-23 Zhaohui Wang , Qi Cao , Huawei Shen , Bingbing Xu , Xueqi Cheng