English
Related papers

Related papers: Understanding Expressivity of GNN in Rule Learning

200 papers

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

Machine Learning · Statistics 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

The expressive power of Graph Neural Networks (GNNs) is often analysed via correspondence to the Weisfeiler-Leman (WL) algorithm and fragments of first-order logic. Standard GNNs are limited to performing aggregation over immediate…

Machine Learning · Computer Science 2026-02-23 Huan Luo , Jonni Virtema

How can we learn effective node representations on textual graphs? Graph Neural Networks (GNNs) that use Language Models (LMs) to encode textual information of graphs achieve state-of-the-art performance in many node classification tasks.…

Message passing neural networks (MPNNs) have become a dominant flavor of graph neural networks (GNNs) in recent years. Yet, MPNNs come with notable limitations; namely, they are at most as powerful as the 1-dimensional Weisfeiler-Leman…

Machine Learning · Computer Science 2022-11-04 Lingxiao Zhao , Louis Härtel , Neil Shah , Leman Akoglu

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Graph Neural Networks (GNNs) are widely adopted in advanced AI systems due to their capability of representation learning on graph data. Even though GNN explanation is crucial to increase user trust in the systems, it is challenging due to…

Machine Learning · Computer Science 2022-08-08 Tien-Cuong Bui , Wen-syan Li , Sang-Kyun Cha

Graph Neural Networks (GNNs) have achieved promising results for semi-supervised learning tasks on graphs such as node classification. Despite the great success of GNNs, many real-world graphs are often sparsely and noisily labeled, which…

Machine Learning · Computer Science 2021-06-10 Enyan Dai , Charu Aggarwal , Suhang Wang

Recent research on graph neural network (GNN) models successfully applied GNNs to classical graph algorithms and combinatorial optimisation problems. This has numerous benefits, such as allowing applications of algorithms when preconditions…

Machine Learning · Computer Science 2021-07-16 Dobrik Georgiev , Pietro Barbiero , Dmitry Kazhdan , Petar Veličković , Pietro Liò

Graph Neural Networks (GNNs) learn from graph-structured data by passing local messages between neighboring nodes along edges on certain topological layouts. Typically, these topological layouts in modern GNNs are deterministically computed…

Machine Learning · Computer Science 2024-02-27 Xinjian Zhao , Chaolong Ying , Tianshu Yu

Graph neural networks (GNNs) appear to be powerful tools to learn state representations for agents in distributed, decentralized multi-agent systems, but generate catastrophically incorrect predictions when nodes update asynchronously…

Machine Learning · Computer Science 2025-07-23 Olga Solodova , Nick Richardson , Deniz Oktay , Ryan P. Adams

Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in…

Machine Learning · Computer Science 2022-04-19 Stefanie Jegelka

Markov Logic Networks (MLNs), which elegantly combine logic rules and probabilistic graphical models, can be used to address many knowledge graph problems. However, inference in MLN is computationally intensive, making the industrial-scale…

Artificial Intelligence · Computer Science 2020-02-05 Yuyu Zhang , Xinshi Chen , Yuan Yang , Arun Ramamurthy , Bo Li , Yuan Qi , Le Song

Recent research has highlighted the role of relational inductive biases in building learning agents that can generalize and reason in a compositional manner. However, while relational learning algorithms such as graph neural networks (GNNs)…

Machine Learning · Computer Science 2020-03-17 Koustuv Sinha , Shagun Sodhani , Joelle Pineau , William L. Hamilton

Graph Neural Networks (GNNs) have established themselves as a key component in addressing diverse graph-based tasks. Despite their notable successes, GNNs remain susceptible to input perturbations in the form of adversarial attacks. This…

Machine Learning · Computer Science 2024-09-13 Moshe Eliasof , Davide Murari , Ferdia Sherry , Carola-Bibiane Schönlieb

Graph Neural Networks (GNNs) have gained considerable traction for their capability to effectively process topological data, yet their interpretability remains a critical concern. Current interpretation methods are dominated by post-hoc…

Machine Learning · Computer Science 2024-02-08 Jiahua Rao , Jiancong Xie , Hanjing Lin , Shuangjia Zheng , Zhen Wang , Yuedong Yang

In recent years, there has been growing interest in understanding the expressive power of graph neural networks (GNNs) by relating them to logical languages. This research has been been initialised by an influential result of Barcel\'o et…

Artificial Intelligence · Computer Science 2025-08-11 Stan P Hauke , Przemysław Andrzej Wałęga

Explainability techniques for Graph Neural Networks still have a long way to go compared to explanations available for both neural and decision decision tree-based models trained on tabular data. Using a task that straddles both graphs and…

Machine Learning · Computer Science 2021-06-25 Anjali Singh , Shamanth R Nayak K , Balaji Ganesan

Graph neural networks (GNNs) have become a popular approach to integrating structural inductive biases into NLP models. However, there has been little work on interpreting them, and specifically on understanding which parts of the graphs…

Computation and Language · Computer Science 2022-10-04 Michael Sejr Schlichtkrull , Nicola De Cao , Ivan Titov

Knowledge distillation (KD) techniques have emerged as a powerful tool for transferring expertise from complex teacher models to lightweight student models, particularly beneficial for deploying high-performance models in…

Machine Learning · Computer Science 2025-10-28 Paul Agbaje , Arkajyoti Mitra , Afia Anjum , Pranali Khose , Ebelechukwu Nwafor , Habeeb Olufowobi

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun