中文
相关论文

相关论文: Provably Powerful Graph Networks

200 篇论文

The ability of graph neural networks (GNNs) to count homomorphisms has recently been proposed as a practical and fine-grained measure of their expressive power. Although several existing works have investigated the homomorphism counting…

机器学习 · 计算机科学 2024-10-07 Junru Zhou , Muhan Zhang

The expressive power of graph neural networks (GNNs) is typically understood through their correspondence with graph isomorphism tests such as the Weisfeiler-Leman (WL) hierarchy. While more expressive GNNs can distinguish a richer set of…

Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world…

机器学习 · 计算机科学 2024-11-11 Luis Müller , Daniel Kusuma , Blai Bonet , Christopher Morris

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

机器学习 · 计算机科学 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Although recent advances in higher-order Graph Neural Networks (GNNs) improve the theoretical expressiveness and molecular property predictive performance, they often fall short of the empirical performance of models that explicitly use…

机器学习 · 计算机科学 2024-07-26 Tom Wollschläger , Niklas Kemper , Leon Hetzel , Johanna Sommer , Stephan Günnemann

Graph Neural Networks (GNNs) excel in handling graph-structured data but often underperform in link prediction tasks compared to classical methods, mainly due to the limitations of the commonly used message-passing principle. Notably, their…

机器学习 · 计算机科学 2025-02-18 Niloofar Azizi , Nils Kriege , Horst Bischof

From the perspective of expressive power, this work compares multi-layer Graph Neural Networks (GNNs) with a simplified alternative that we call Graph-Augmented Multi-Layer Perceptrons (GA-MLPs), which first augments node features with…

机器学习 · 计算机科学 2020-12-03 Lei Chen , Zhengdao Chen , Joan Bruna

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

机器学习 · 计算机科学 2021-01-07 Kenta Oono , Taiji Suzuki

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

机器学习 · 计算机科学 2021-06-08 Waïss Azizian , Marc Lelarge

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

机器学习 · 计算机科学 2021-05-04 Jing Huang , Jie Yang

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

机器学习 · 计算机科学 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush

Graph Neural Networks (GNNs) have achieved much success on graph-structured data. In light of this, there have been increasing interests in studying their expressive power. One line of work studies the capability of GNNs to approximate…

机器学习 · 计算机科学 2023-02-14 Zhengdao Chen , Soledad Villar , Lei Chen , Joan Bruna

The $k$-dimensional Weisfeiler-Leman algorithm ($k$-WL) is a very useful combinatorial tool in graph isomorphism testing. We address the applicability of $k$-WL to recognition of graph properties. Let $G$ be an input graph with $n$…

组合数学 · 数学 2020-07-31 Frank Fuhlbrück , Johannes Köbler , Ilia Ponomarenko , Oleg Verbitsky

The ability of a graph neural network (GNN) to leverage both the graph topology and graph labels is fundamental to building discriminative node and graph embeddings. Building on previous work, we theoretically show that edGNN, our model for…

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

机器学习 · 计算机科学 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

Famously, the ability of Message Passing Neural Networks (MPNN) to distinguish between graphs is limited to graphs separable by the Weisfeiler-Lemann (WL) graph isomorphism test, and the strongest MPNNs, in terms of separation power, are…

机器学习 · 计算机科学 2026-03-03 Yonatan Sverdlov , Yair Davidson , Nadav Dym , Tal Amir

We present results concerning the expressiveness and decidability of a popular graph learning formalism, graph neural networks (GNNs), exploiting connections with logic. We use a family of recently-discovered decidable logics involving…

计算机科学中的逻辑 · 计算机科学 2025-01-31 Michael Benedikt , Chia-Hsuan Lu , Tony Tan

Graph neural networks are prominent models for representation learning over graph-structured data. While the capabilities and limitations of these models are well-understood for simple graphs, our understanding remains incomplete in the…

机器学习 · 计算机科学 2023-10-27 Xingyue Huang , Miguel Romero Orth , İsmail İlkan Ceylan , Pablo Barceló

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

机器学习 · 计算机科学 2022-06-24 Jacob Bamberger

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

机器学习 · 计算机科学 2024-04-02 Quang Truong , Peter Chin