English
Related papers

Related papers: SpeqNets: Sparsity-aware Permutation-equivariant G…

200 papers

Many combinatorial optimization problems can be phrased in the language of constraint satisfaction problems. We introduce a graph neural network architecture for solving such optimization problems. The architecture is generic; it works for…

Artificial Intelligence · Computer Science 2020-02-12 Jan Toenshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Graph Neural Networks (GNNs) are powerful tools for learning on structured data, yet the relationship between their expressivity and predictive performance remains unclear. We introduce a family of premetrics that capture different degrees…

Machine Learning · Computer Science 2025-05-19 Sohir Maskey , Raffaele Paolino , Fabian Jogl , Gitta Kutyniok , Johannes F. Lutzeyer

Graph Neural Networks (GNNs) have achieved much success on graph-structured data. In light of this, there have been increasing interests in studying their expressive power. One line of work studies the capability of GNNs to approximate…

Machine Learning · Computer Science 2023-02-14 Zhengdao Chen , Soledad Villar , Lei Chen , Joan Bruna

Graph processes exhibit a temporal structure determined by the sequence index and and a spatial structure determined by the graph support. To learn from graph processes, an information processing architecture must then be able to exploit…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

Graph Neural Networks (GNN) come in many flavors, but should always be either invariant (permutation of the nodes of the input graph does not affect the output) or equivariant (permutation of the input permutes the output). In this paper,…

Machine Learning · Computer Science 2019-10-25 Nicolas Keriven , Gabriel Peyré

Neural networks efficiently encode learned information within their parameters. Consequently, many tasks can be unified by treating neural networks themselves as input data. When doing so, recent studies demonstrated the importance of…

Machine Learning · Computer Science 2024-01-02 Derek Lim , Haggai Maron , Marc T. Law , Jonathan Lorraine , James Lucas

Graph Neural Networks (GNNs), especially message-passing neural networks (MPNNs), have emerged as powerful architectures for learning on graphs in diverse applications. However, MPNNs face challenges when modeling non-local interactions in…

Machine Learning · Statistics 2024-01-31 Ilyes Batatia , Lars L. Schaaf , Huajie Chen , Gábor Csányi , Christoph Ortner , Felix A. Faber

The irreducible complexity of natural phenomena has led Graph Neural Networks to be employed as a standard model to perform representation learning tasks on graph-structured data. While their capacity to capture local and global patterns is…

Machine Learning · Computer Science 2024-02-13 Lorenzo Giusti

Learning and reasoning about 3D molecular structures with varying size is an emerging and important challenge in machine learning and especially in drug discovery. Equivariant Graph Neural Networks (GNNs) can simultaneously leverage the…

Machine Learning · Computer Science 2022-03-03 Tuan Le , Frank Noé , Djork-Arné Clevert

Graph neural networks are prominent models for representation learning over graphs, where the idea is to iteratively compute representations of nodes of an input graph through a series of transformations in such a way that the learned graph…

Machine Learning · Computer Science 2023-10-26 Radoslav Dimitrov , Zeyang Zhao , Ralph Abboud , İsmail İlkan Ceylan

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph neural networks (GNNs) have been shown promising in improving the efficiency of learning communication policies by leveraging their permutation properties. Nonetheless, existing works design GNNs only for specific wireless policies,…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Shengjie Liu , Jia Guo , Chenyang Yang

This paper explores the applications and challenges of graph neural networks (GNNs) in processing complex graph data brought about by the rapid development of the Internet. Given the heterogeneity and redundancy problems that graph data…

Machine Learning · Computer Science 2024-10-24 Jianjun Wei , Yue Liu , Xin Huang , Xin Zhang , Wenyi Liu , Xu Yan

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both…

Machine Learning · Computer Science 2020-11-05 Fabrizio Frasca , Emanuele Rossi , Davide Eynard , Ben Chamberlain , Michael Bronstein , Federico Monti

Supervised learning with deep models has tremendous potential for applications in materials science. Recently, graph neural networks have been used in this context, drawing direct inspiration from models for molecules. However, materials…

Materials Science · Physics 2023-01-18 Sékou-Oumar Kaba , Siamak Ravanbakhsh

Graph neural networks (GNNs) are a popular class of parametric model for learning over graph-structured data. Recent work has argued that GNNs primarily use the graph for feature smoothing, and have shown competitive results on benchmark…

Machine Learning · Computer Science 2020-11-20 Lingfan Yu , Jiajun Shen , Jinyang Li , Adam Lerer

Representing and reasoning about 3D structures of macromolecules is emerging as a distinct challenge in machine learning. Here, we extend recent work on geometric vector perceptrons and apply equivariant graph neural networks to a wide…

Machine Learning · Computer Science 2021-07-14 Bowen Jing , Stephan Eismann , Pratham N. Soni , Ron O. Dror

Graph Neural Networks (GNNs) are information processing architectures for signals supported on graphs. They are presented here as generalizations of convolutional neural networks (CNNs) in which individual layers contain banks of graph…

Machine Learning · Computer Science 2021-02-01 Luana Ruiz , Fernando Gama , Alejandro Ribeiro