English
Related papers

Related papers: Aggregate-Combine-Readout GNNs Are More Expressive…

200 papers

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Graph neural networks (GNNs) have gained significant popularity due to the powerful capability to extract useful representations from graph data. As the need for efficient GNN computation intensifies, a variety of programming abstractions…

Machine Learning · Computer Science 2023-10-24 Yingjie Qi , Jianlei Yang , Ao Zhou , Tong Qiao , Chunming Hu

Explainable Graph Neural Network (GNN) has emerged recently to foster the trust of using GNNs. Existing GNN explainers are developed from various perspectives to enhance the explanation performance. We take the first step to study GNN…

Cryptography and Security · Computer Science 2024-06-06 Jiate Li , Meng Pang , Yun Dong , Jinyuan Jia , Binghui Wang

Graph neural networks (GNNs) have recently become the standard approach for learning with graph-structured data. Prior work has shed light into their potential, but also their limitations. Unfortunately, it was shown that standard GNNs are…

Machine Learning · Computer Science 2023-06-12 Gaspard Michel , Giannis Nikolentzos , Johannes Lutzeyer , Michalis Vazirgiannis

Graphs can represent relational information among entities and graph structures are widely used in many intelligent tasks such as search, recommendation, and question answering. However, most of the graph-structured data in practice suffers…

Information Retrieval · Computer Science 2021-12-30 Hanxiong Chen , Yunqi Li , Shaoyun Shi , Shuchang Liu , He Zhu , Yongfeng Zhang

Message-passing graph neural networks (MPGNNs) dominate modern graph learning. Typical efforts enhance MPGNN's expressive power by enriching the adjacency-based aggregation. In contrast, we introduce an efficient aggregation over walk…

Machine Learning · Computer Science 2025-09-29 Marek Černý

Graph Neural Networks (GNNs) have achieved remarkable success across diverse applications, yet they remain limited by oversmoothing and poor performance on heterophilic graphs. To address these challenges, we introduce a novel framework…

Machine Learning · Computer Science 2025-11-19 Cristina López Amado , Tassilo Schwarz , Yu Tian , Renaud Lambiotte

It is well established that spectral graph neural networks (GNNs) can universally approximate node signals; however, their expressive power remains bounded by the 1-dimensional Weisfeiler-Lehman test, which is mirrored in their lack of…

Machine Learning · Computer Science 2026-05-26 Xiaohan Wang , Deyu Bo , Longlong Li , Kelin Xia

This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly…

Machine Learning · Computer Science 2021-11-12 Pál András Papp , Karolis Martinkus , Lukas Faber , Roger Wattenhofer

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

Graph neural networks (GNNs) update the hidden representations of vertices (called Vertex-GNNs) or hidden representations of edges (called Edge-GNNs) by processing and pooling the information of neighboring vertices and edges and combining…

Machine Learning · Computer Science 2023-12-27 Yao Peng , Jia Guo , Chenyang Yang

The counting power of Message Passing Neural Networks (MPNN) has been the subject of many recent papers, showing that they can express logic that involves counting up to a threshold or more generally satisfy a linear arithmetic constraint.…

Machine Learning · Computer Science 2026-05-12 Marco Sälzer , Pascal Bergsträßer , Anthony W. Lin

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

Machine Learning · Computer Science 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Despite the rapid progress of large language models (LLMs), knowledge graph-based question answering (KGQA) remains essential for producing verifiable and hallucination-resistant answers in many real-world settings where answer…

Computation and Language · Computer Science 2026-01-21 Ruijie Wang , Luca Rossetto , Michael Cochez , Abraham Bernstein

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Semidefinite programs (SDPs) are a powerful framework for convex optimization and for constructing strong relaxations of hard combinatorial problems. However, solving large SDPs can be computationally expensive, motivating the use of…

Machine Learning · Computer Science 2026-05-05 Chendi Qian , Christopher Morris

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo