English
Related papers

Related papers: Stability Properties of Graph Neural Networks

200 papers

This work establishes rigorous, novel and widely applicable stability guarantees and transferability bounds for graph convolutional networks -- without reference to any underlying limit object or statistical distribution. Crucially,…

Machine Learning · Computer Science 2023-10-03 Christian Koke

We study properties of Graph Convolutional Networks (GCNs) by analyzing their behavior on standard models of random graphs, where nodes are represented by random latent variables and edges are drawn according to a similarity kernel. This…

Machine Learning · Statistics 2020-10-26 Nicolas Keriven , Alberto Bietti , Samuel Vaiter

We study algebraic neural networks (AlgNNs) with commutative algebras which unify diverse architectures such as Euclidean convolutional neural networks, graph neural networks, and group neural networks under the umbrella of algebraic signal…

Machine Learning · Computer Science 2021-07-07 Alejandro Parada-Mayorga , Alejandro Ribeiro

Graph neural networks (GNNs) rely on graph convolutions to extract local features from network data. These graph convolutions combine information from adjacent nodes using coefficients that are shared across all nodes. Since these…

Machine Learning · Computer Science 2020-10-22 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

We introduce space-time graph neural network (ST-GNN), a novel GNN architecture, tailored to jointly process the underlying space-time topology of time-varying network data. The cornerstone of our proposed architecture is the composition of…

Machine Learning · Computer Science 2022-01-25 Samar Hadou , Charilaos I. Kanatsoulis , Alejandro Ribeiro

Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based learning tasks. While their performance is often attributed to the powerful neighborhood aggregation mechanism, recent studies suggest that other…

Machine Learning · Computer Science 2024-12-11 Yushun Dong , Patrick Soga , Yinhan He , Song Wang , Jundong Li

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Analyzing the stability of graph neural networks (GNNs) under topological perturbations is key to understanding their transferability and the role of each architecture component. However, stability has been investigated only for particular…

Signal Processing · Electrical Eng. & Systems 2023-12-06 Zhan Gao , Amanda Prorok , Elvin Isufi

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

Graph Neural Networks (GNNs) show impressive performance in many practical scenarios, which can be largely attributed to their stability properties. Empirically, GNNs can scale well on large size graphs, but this is contradicted by the fact…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Zhiyang Wang , Luana Ruiz , Alejandro Ribeiro

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Graph Neural Networks (GNN) come in many flavors, but should always be either invariant (permutation of the nodes of the input graph does not affect the output) or equivariant (permutation of the input permutes the output). In this paper,…

Machine Learning · Computer Science 2019-10-25 Nicolas Keriven , Gabriel Peyré

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

Recently, the stability of graph filters has been studied as one of the key theoretical properties driving the highly successful graph convolutional neural networks (GCNs). The stability of a graph filter characterizes the effect of…

Signal Processing · Electrical Eng. & Systems 2021-10-15 Hoang-Son Nguyen , Yiran He , Hoi-To Wai

Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis…

Machine Learning · Statistics 2024-11-04 Xinjue Wang , Esa Ollila , Sergiy A. Vorobyov

Over the last few years, we have witnessed the availability of an increasing data generated from non-Euclidean domains, which are usually represented as graphs with complex relationships, and Graph Neural Networks (GNN) have gained a high…

Machine Learning · Computer Science 2023-08-15 Andrea Apicella , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

In this work, we study the problem of stability of Graph Convolutional Neural Networks (GCNs) under random small perturbations in the underlying graph topology, i.e. under a limited number of insertions or deletions of edges. We derive a…

Machine Learning · Computer Science 2023-12-21 Lucia Testa , Claudio Battiloro , Stefania Sardellitti , Sergio Barbarossa

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin