English
Related papers

Related papers: Walk Message Passing Neural Networks and Second-Or…

200 papers

We present many-body Message Passing Neural Network (MPNN) framework that models higher-order node interactions ($\ge 2$ nodes). We model higher-order terms as tree-shaped motifs, comprising a central node with its neighborhood, and apply…

Machine Learning · Computer Science 2024-07-17 Jiatong Han

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

Machine Learning · Computer Science 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

Graph Neural Networks (GNNs) are a broad class of connectionist models for graph processing. Recent studies have shown that GNNs can approximate any function on graphs, modulo the equivalence relation on graphs defined by the…

Machine Learning · Computer Science 2024-08-21 Giuseppe Alessio D'Inverno , Monica Bianchini , Maria Lucia Sampoli , Franco Scarselli

Accurate RNA secondary structure prediction is vital for understanding cellular regulation and disease mechanisms. Deep learning (DL) methods have surpassed traditional algorithms by predicting complex features like pseudoknots and…

Biomolecules · Quantitative Biology 2024-01-12 Frederic Runge , Jörg K. H. Franke , Daniel Fertmann , Frank Hutter

Graph Neural Networks (GNNs) have become important machine learning tools for graph analysis, and its explainability is crucial for safety, fairness, and robustness. Layer-wise relevance propagation for GNNs (GNN-LRP) evaluates the…

Machine Learning · Computer Science 2026-05-25 Ping Xiong , Thomas Schnake , Michael Gastegger , Grégoire Montavon , Klaus-Robert Müller , Shinichi Nakajima

Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world…

Machine Learning · Computer Science 2024-11-11 Luis Müller , Daniel Kusuma , Blai Bonet , Christopher Morris

In this article we present new results about the expressivity of Graph Neural Networks (GNNs). We prove that for any GNN with piecewise polynomial activations, whose architecture size does not grow with the graph input sizes, there exists a…

Machine Learning · Computer Science 2024-05-16 Sammy Khalife , Amitabh Basu

We investigate the distance function learned by message passing neural networks (MPNNs) in specific tasks, aiming to capture the functional distance between prediction targets that MPNNs implicitly learn. This contrasts with previous work,…

Machine Learning · Computer Science 2025-06-02 Masahiro Negishi , Thomas Gärtner , Pascal Welke

Graph neural networks (GNNs) have limited expressive power, failing to represent many graph classes correctly. While more expressive graph representation learning (GRL) alternatives can distinguish some of these classes, they are…

Machine Learning · Computer Science 2021-12-08 Leonardo Cotta , Christopher Morris , Bruno Ribeiro

We perform the first adversarial robustness study into Graph Neural Networks (GNNs) that are provably more powerful than traditional Message Passing Neural Networks (MPNNs). In particular, we use adversarial robustness as a tool to uncover…

Machine Learning · Computer Science 2024-07-04 Francesco Campi , Lukas Gosch , Tom Wollschläger , Yan Scholten , Stephan Günnemann

Combinatorial complexes have unified set-based (e.g., graphs, hypergraphs) and part-whole (e.g., simplicial, cellular complexes) structures into a common topological framework. Existing topological neural networks and Weisfeiler-Lehman…

Machine Learning · Computer Science 2026-05-04 Jiawen Chen , Qi Shao , Duxin Chen , Wenwu Yu

Applying machine learning to molecules is challenging because of their natural representation as graphs rather than vectors.Several architectures have been recently proposed for deep learning from molecular graphs, but they suffer from…

Machine Learning · Statistics 2020-09-15 Jaak Simm , Adam Arany , Edward De Brouwer , Yves Moreau

Graph neural networks (GNNs) have drawn increasing attention in recent years and achieved remarkable performance in many graph-based tasks, especially in semi-supervised learning on graphs. However, most existing GNNs are based on the…

Machine Learning · Computer Science 2024-01-24 Li Zhou , Wenyu Chen , Dingyi Zeng , Shaohuan Cheng , Wanlong Liu , Malu Zhang , Hong Qu

Message-passing graph neural networks (MPGNNs) are commonly compared with the Weisfeiler-Lehman (WL) color-refinement procedure, but this comparison does not quantify the resource parameters a network needs to realize color refinement with…

Machine Learning · Computer Science 2026-05-11 Guanyu Cui , Yuhe Guo , Zhewei Wei , Hsin-Hao Su

Message passing neural networks (MPNNs) operate on graphs by exchanging information between neigbouring nodes. MPNNs have been successfully applied to various node-, edge-, and graph-level tasks in areas like molecular science, computer…

Machine Learning · Computer Science 2025-11-05 Lisi Qarkaxhija , Anatol E. Wegner , Ingo Scholtes

The $k$-dimensional Weisfeiler-Leman algorithm ($k$-WL) is a fruitful approach to the Graph Isomorphism problem. 2-WL corresponds to the original algorithm suggested by Weisfeiler and Leman over 50 years ago. 1-WL is the classical color…

Discrete Mathematics · Computer Science 2019-04-10 V. Arvind , Frank Fuhlbrück , Johannes Köbler , Oleg Verbitsky

Neural architectures that learn potential energy surfaces from molecular data have undergone fast improvement in recent years. A key driver of this success is the Message Passing Neural Network (MPNN) paradigm. Its favorable scaling with…

Machine Learning · Computer Science 2023-06-07 Arthur Kosmala , Johannes Gasteiger , Nicholas Gao , Stephan Günnemann

Graph Neural Networks (GNNs) suffer from over-smoothing in deep architectures and expressiveness bounded by the 1-Weisfeiler-Leman (1-WL) test. We adapt Manifold-Constrained Hyper-Connections (\mhc)~\citep{xie2025mhc}, recently proposed for…

Machine Learning · Computer Science 2026-01-07 Subhankar Mishra

In pioneering work from 2019, Barcel\'o and coauthors identified logics that precisely match the expressive power of constant iteration-depth graph neural networks (GNNs) relative to properties definable in first-order logic. In this…

Logic in Computer Science · Computer Science 2025-05-05 Veeti Ahvonen , Damian Heiman , Antti Kuusisto , Carsten Lutz

Random walk kernels have been introduced in seminal work on graph learning and were later largely superseded by kernels based on the Weisfeiler-Leman test for graph isomorphism. We give a unified view on both classes of graph kernels. We…

Machine Learning · Computer Science 2023-01-18 Nils M. Kriege