English
Related papers

Related papers: Going Deeper into Permutation-Sensitive Graph Neur…

200 papers

In this paper, we fully answer the above question through a key algebraic condition on graph functions, called \textit{permutation compatibility}, that relates permutations of weights and features of the graph to functional constraints. We…

Machine Learning · Computer Science 2022-06-22 Mohammad Fereydounian , Hamed Hassani , Amin Karbasi

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

Graph Neural Network (GNN) is a powerful model to learn representations and make predictions on graph data. Existing efforts on GNN have largely defined the graph convolution as a weighted sum of the features of the connected nodes to form…

Machine Learning · Computer Science 2020-06-02 Hongmin Zhu , Fuli Feng , Xiangnan He , Xiang Wang , Yan Li , Kai Zheng , Yongdong Zhang

From the perspective of expressive power, this work compares multi-layer Graph Neural Networks (GNNs) with a simplified alternative that we call Graph-Augmented Multi-Layer Perceptrons (GA-MLPs), which first augments node features with…

Machine Learning · Computer Science 2020-12-03 Lei Chen , Zhengdao Chen , Joan Bruna

Graph similarity learning, crucial for tasks such as graph classification and similarity search, focuses on measuring the similarity between two graph-structured entities. The core challenge in this field is effectively managing the…

Information Retrieval · Computer Science 2025-02-26 Zenghui Chang , Yiqiao Zhang , Hong Cai Chen

Graph Convolutional Networks (GCNs) have been widely applied in various fields due to their significant power on processing graph-structured data. Typical GCN and its variants work under a homophily assumption (i.e., nodes with same class…

Machine Learning · Computer Science 2021-12-28 Tao Wang , Rui Wang , Di Jin , Dongxiao He , Yuxiao Huang

Recently, subgraph GNNs have emerged as an important direction for developing expressive graph neural networks (GNNs). While numerous architectures have been proposed, so far there is still a limited understanding of how various design…

Machine Learning · Computer Science 2023-03-30 Bohang Zhang , Guhao Feng , Yiheng Du , Di He , Liwei Wang

In recent years, a wide variety of graph neural network (GNN) architectures have emerged, each with its own strengths, weaknesses, and complexities. Various techniques, including rewiring, lifting, and node annotation with centrality…

Machine Learning · Computer Science 2024-10-14 Zhifei Li , Gerrit Großmann , Verena Wolf

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

The Weisfeiler-Leman algorithm ($1$-WL) is a well-studied heuristic for the graph isomorphism problem. Recently, the algorithm has played a prominent role in understanding the expressive power of message-passing graph neural networks…

Machine Learning · Computer Science 2024-05-29 Billy J. Franks , Christopher Morris , Ameya Velingker , Floris Geerts

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

It is challenging for generative models to learn a distribution over graphs because of the lack of permutation invariance: nodes may be ordered arbitrarily across graphs, and standard graph alignment is combinatorial and notoriously…

Social and Information Networks · Computer Science 2023-01-27 Kimia Shayestehfard , Dana Brooks , Stratis Ioannidis

Graph Neural Networks (GNNs) have shown remarkable success in learning from graph-structured data. However, their application to directed graphs (digraphs) presents unique challenges, primarily due to the inherent asymmetry in node…

Machine Learning · Computer Science 2025-05-16 Wei Zhuo , Han Yu , Guang Tan , Xiaoxiao Li

Graph isomorphism testing is usually approached via the comparison of graph invariants. Two popular alternatives that offer a good trade-off between expressive power and computational efficiency are combinatorial (i.e., obtained via the…

Machine Learning · Computer Science 2022-03-03 Or Feldman , Amit Boyarski , Shai Feldman , Dani Kogan , Avi Mendelson , Chaim Baskin

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Graph Neural Networks (GNN) come in many flavors, but should always be either invariant (permutation of the nodes of the input graph does not affect the output) or equivariant (permutation of the input permutes the output). In this paper,…

Machine Learning · Computer Science 2019-10-25 Nicolas Keriven , Gabriel Peyré

The expressive power of graph neural network formalisms is commonly measured by their ability to distinguish graphs. For many formalisms, the k-dimensional Weisfeiler-Leman (k-WL) graph isomorphism test is used as a yardstick. In this paper…

Machine Learning · Computer Science 2020-07-24 Floris Geerts

A reliable perception has to be robust against challenging environmental conditions. Therefore, recent efforts focused on the use of radar sensors in addition to camera and lidar sensors for perception applications. However, the sparsity of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Felix Fent , Philipp Bauerschmidt , Markus Lienkamp

Traditional Graph Neural Networks (GNNs) rely on message passing, which amounts to permutation-invariant local aggregation of neighbour features. Such a process is isotropic and there is no notion of `direction' on the graph. We present a…

Machine Learning · Computer Science 2022-05-03 Ahmed A. A. Elhag , Gabriele Corso , Hannes Stärk , Michael M. Bronstein

Generative models of graph structure have applications in biology and social sciences. The state of the art is GraphRNN, which decomposes the graph generation process into a series of sequential steps. While effective for modest sizes, it…

Machine Learning · Computer Science 2019-10-18 Tony Duan , Juho Lee