English
Related papers

Related papers: Convergence of Message Passing Graph Neural Networ…

200 papers

Graph coarsening aims to reduce the size of a large graph while preserving some of its key properties, which has been used in many applications to reduce computational load and memory footprint. For instance, in graph machine learning,…

Machine Learning · Computer Science 2024-05-29 Antonin Joly , Nicolas Keriven

The core operation of current Graph Neural Networks (GNNs) is the aggregation enabled by the graph Laplacian or message passing, which filters the neighborhood node information. Though effective for various tasks, in this paper, we show…

Machine Learning · Computer Science 2022-11-04 Sitao Luan , Mingde Zhao , Chenqing Hua , Xiao-Wen Chang , Doina Precup

Graph neural networks (GNNs) achieve strong performance on graph learning tasks, but training on large-scale networks remains computationally challenging. Transferability results show that GNNs with fixed weights can generalize from smaller…

Signal Processing · Electrical Eng. & Systems 2026-04-17 Haoyu Wang , Renyuan Ma , Gonzalo Mateos , Luana Ruiz

This work provides a theoretical framework for assessing the generalization error of graph neural networks in the over-parameterized regime, where the number of parameters surpasses the quantity of data points. We explore two widely…

Machine Learning · Statistics 2024-07-02 Gholamali Aminian , Yixuan He , Gesine Reinert , Łukasz Szpruch , Samuel N. Cohen

The push-sum algorithm allows distributed computing of the average on a directed graph, and is particularly relevant when one is restricted to one-way and/or asynchronous communications. We investigate its behavior in the presence of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-01 Balázs Gerencsér , Julien M. Hendrickx

Convolutional neural networks are the most widely used type of neural networks in applications. In mathematical analysis, however, mostly fully-connected networks are studied. In this paper, we establish a connection between both network…

Functional Analysis · Mathematics 2021-01-29 Philipp Petersen , Felix Voigtlaender

Graph convolutional learning has led to many exciting discoveries in diverse areas. However, in some applications, traditional graphs are insufficient to capture the structure and intricacies of the data. In such scenarios, multigraphs…

Machine Learning · Computer Science 2023-04-26 Landon Butler , Alejandro Parada-Mayorga , Alejandro Ribeiro

While the celebrated graph neural networks yield effective representations for individual nodes of a graph, there has been relatively less success in extending to the task of graph similarity learning. Recent work on graph similarity…

Machine Learning · Computer Science 2021-08-20 Xiang Ling , Lingfei Wu , Saizhuo Wang , Tengfei Ma , Fangli Xu , Alex X. Liu , Chunming Wu , Shouling Ji

Graph Neural Networks (GNNs) have achieved notable success in the analysis of non-Euclidean data across a wide range of domains. However, their applicability is constrained by the dependence on the observed graph structure. To solve this…

Machine Learning · Computer Science 2024-09-19 Ziyan Wang , Yaxuan He , Bin Liu

Graph Neural Network (GNN) has been demonstrated its effectiveness in dealing with non-Euclidean structural data. Both spatial-based and spectral-based GNNs are relying on adjacency matrix to guide message passing among neighbors during…

Machine Learning · Computer Science 2021-06-09 Yang Hu , Haoxuan You , Zhecan Wang , Zhicheng Wang , Erjin Zhou , Yue Gao

Graph Neural Networks (GNNs) have been successfully adopted in recommender systems by virtue of the message-passing that implicitly captures collaborative effect. Nevertheless, most of the existing message-passing mechanisms for…

Information Retrieval · Computer Science 2023-02-21 Yu Wang , Yuying Zhao , Yi Zhang , Tyler Derr

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

Information Theory · Computer Science 2012-08-15 Sundeep Rangan

The similarity of graph structures, such as Meaning Representations (MRs), is often assessed via structural matching algorithms, such as Smatch (Cai and Knight, 2013). However, Smatch involves a combinatorial problem that suffers from…

Computation and Language · Computer Science 2023-06-02 Juri Opitz , Philipp Meier , Anette Frank

Most graph neural network models rely on a particular message passing paradigm, where the idea is to iteratively propagate node representations of a graph to each node in the direct neighborhood. While very prominent, this paradigm leads to…

Machine Learning · Computer Science 2023-01-24 Ralph Abboud , Radoslav Dimitrov , İsmail İlkan Ceylan

Graph similarity learning, crucial for tasks such as graph classification and similarity search, focuses on measuring the similarity between two graph-structured entities. The core challenge in this field is effectively managing the…

Information Retrieval · Computer Science 2025-02-26 Zenghui Chang , Yiqiao Zhang , Hong Cai Chen

Modern machine learning techniques are successfully being adapted to data modeled as graphs. However, many real-world graphs are typically very large and do not fit in memory, often making the problem of training machine learning models on…

Machine Learning · Computer Science 2020-12-10 Alexandra Angerd , Keshav Balasubramanian , Murali Annavaram

We study the node classification problem on feature-decorated graphs in the sparse setting, i.e., when the expected degree of a node is $O(1)$ in the number of nodes, in the fixed-dimensional asymptotic regime, i.e., the dimension of the…

Machine Learning · Computer Science 2025-01-10 Aseem Baranwal , Kimon Fountoulakis , Aukosh Jagannath

We precisely characterize the expressivity of computable Recurrent Graph Neural Networks (recurrent GNNs). We prove that recurrent GNNs with finite-precision parameters, sum aggregation, and ReLU activation, can compute any graph algorithm…

Machine Learning · Computer Science 2026-03-17 Eran Rosenbluth , Martin Grohe

We analyze how the transient dynamics of large dynamical systems in the vicinity of a stationary point, modeled by a set of randomly coupled linear differential equations, depends on the network topology. We characterize the transient…

Adaptation and Self-Organizing Systems · Physics 2024-01-17 Wojciech Tarnowski , Izaak Neri , Pierpaolo Vivo

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo