English
Related papers

Related papers: On Graph Neural Networks versus Graph-Augmented ML…

200 papers

Recently, the Weisfeiler-Lehman (WL) graph isomorphism test was used to measure the expressive power of graph neural networks (GNN). It was shown that the popular message passing GNN cannot distinguish between graphs that are…

Machine Learning · Computer Science 2020-06-11 Haggai Maron , Heli Ben-Hamu , Hadar Serviansky , Yaron Lipman

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Graph Neural Networks (GNNs) have achieved much success on graph-structured data. In light of this, there have been increasing interests in studying their expressive power. One line of work studies the capability of GNNs to approximate…

Machine Learning · Computer Science 2023-02-14 Zhengdao Chen , Soledad Villar , Lei Chen , Joan Bruna

Recently, the Weisfeiler-Lehman (WL) graph isomorphism test was used to measure the expressiveness of graph neural networks (GNNs), showing that the neighborhood aggregation GNNs were at most as powerful as 1-WL test in distinguishing graph…

Machine Learning · Computer Science 2020-12-15 Mingqi Yang , Yanming Shen , Heng Qi , Baocai Yin

Graph Neural Networks (GNNs) are a large class of relational models for graph processing. Recent theoretical studies on the expressive power of GNNs have focused on two issues. On the one hand, it has been proven that GNNs are as powerful…

In recent years, Graph Neural Network (GNN) has bloomly progressed for its power in processing graph-based data. Most GNNs follow a message passing scheme, and their expressive power is mathematically limited by the discriminative ability…

Machine Learning · Computer Science 2021-04-06 Alan J. X. Guo , Qing-Hu Hou , Ou Wu

In recent years, there has been a growing interest in mapping data from different domains to graph structures. Among others, neural network models such as the multi-layer perceptron (MLP) can be modeled as graphs. In fact, MLPs can be…

Machine Learning · Statistics 2024-02-06 Giannis Nikolentzos , Siyun Wang , Johannes Lutzeyer , Michalis Vazirgiannis

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

Machine Learning · Computer Science 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

We focus on graph classification using a graph neural network (GNN) model that precomputes the node features using a bank of neighborhood aggregation graph operators arranged in parallel. These GNN models have a natural advantage of reduced…

Machine Learning · Computer Science 2022-11-23 Siddhant Doshi , Sundeep Prabhakar Chepuri

Numerous recent works have analyzed the expressive power of message-passing graph neural networks (MPNNs), primarily utilizing combinatorial techniques such as the $1$-dimensional Weisfeiler-Leman test ($1$-WL) for the graph isomorphism…

Machine Learning · Computer Science 2023-11-03 Jan Böker , Ron Levie , Ningyuan Huang , Soledad Villar , Christopher Morris

The expressive power of message passing neural networks (MPNNs) is known to match the expressive power of the 1-dimensional Weisfeiler-Leman graph (1-WL) isomorphism test. To boost the expressive power of MPNNs, a number of graph neural…

Machine Learning · Computer Science 2020-06-18 Floris Geerts

Characterizing the separation power of graph neural networks (GNNs) provides an understanding of their limitations for graph learning tasks. Results regarding separation power are, however, usually geared at specific GNN architectures, and…

Machine Learning · Computer Science 2022-04-12 Floris Geerts , Juan L. Reutter

Learning to optimize is a rapidly growing area that aims to solve optimization problems or improve existing optimization algorithms using machine learning (ML). In particular, the graph neural network (GNN) is considered a suitable ML model…

Machine Learning · Computer Science 2023-05-29 Ziang Chen , Jialin Liu , Xinshang Wang , Jianfeng Lu , Wotao Yin

Graph Neural Networks (GNNs) are popular for graph machine learning and have shown great results on wide node classification tasks. Yet, they are less popular for practical deployments in the industry owing to their scalability challenges…

Machine Learning · Computer Science 2022-03-24 Shichang Zhang , Yozen Liu , Yizhou Sun , Neil Shah

Graph neural networks (GNNs) have recently achieved state-of-the-art performance in many graph-based applications. Despite the high expressive power, they typically need to perform an expensive recursive neighborhood expansion in multiple…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Ziqi Yin , Zeang Sheng , Wen Ouyang , Xiaosen Li , Yangyu Tao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have emerged as prominent models for representation learning on graph structured data. GNNs follow an approach of message passing analogous to 1-dimensional Weisfeiler Lehman (1-WL) test for graph isomorphism…

Machine Learning · Computer Science 2022-03-18 Mohammed Haroon Dupty , Wee Sun Lee

Graph neural networks (GNNs) have achieved great success in many graph-based applications. However, the enormous size and high sparsity level of graphs hinder their applications under industrial scenarios. Although some scalable GNNs are…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Ziqi Yin , Zeang Sheng , Yang Li , Wen Ouyang , Xiaosen Li , Yangyu Tao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

Machine Learning · Computer Science 2022-06-24 Jacob Bamberger

Graph neural networks (GNNs) can effectively model structural information of graphs, making them widely used in knowledge graph (KG) reasoning. However, existing studies on the expressive power of GNNs mainly focuses on simple…

Artificial Intelligence · Computer Science 2026-02-02 Han Yu , Xiaojuan Zhao , Aiping Li , Kai Chen , Ziniu Liu , Zhichao Peng

Graph neural networks (GNNs) are a class of deep models that operate on data with arbitrary topology represented as graphs. We introduce an efficient memory layer for GNNs that can jointly learn node representations and coarsen the graph.…

Machine Learning · Computer Science 2020-06-11 Amir Hosein Khasahmadi , Kaveh Hassani , Parsa Moradi , Leo Lee , Quaid Morris