English
Related papers

Related papers: Memory-based Message Passing: Decoupling the Messa…

200 papers

Hypergraphs are crucial for modelling higher-order interactions in real-world data. Hypergraph neural networks (HNNs) effectively utilise these structures by message passing to generate informative node features for various downstream tasks…

Machine Learning · Computer Science 2025-03-12 Bohan Tang , Zexi Liu , Keyue Jiang , Siheng Chen , Xiaowen Dong

Message-passing graph neural networks (MPGNNs) dominate modern graph learning. Typical efforts enhance MPGNN's expressive power by enriching the adjacency-based aggregation. In contrast, we introduce an efficient aggregation over walk…

Machine Learning · Computer Science 2025-09-29 Marek Černý

This paper proposes Graph Signal Adaptive Message Passing (GSAMP), a novel message passing method that simultaneously conducts online prediction, missing data imputation, and noise removal on time-varying graph signals. Unlike conventional…

Signal Processing · Electrical Eng. & Systems 2024-11-26 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

Subgraph-wise sampling -- a promising class of mini-batch training techniques for graph neural networks (GNNs -- is critical for real-world applications. During the message passing (MP) in GNNs, subgraph-wise sampling methods discard…

Machine Learning · Computer Science 2024-08-22 Jie Wang , Zhihao Shi , Xize Liang , Defu Lian , Shuiwang Ji , Bin Li , Enhong Chen , Feng Wu

Message Passing Neural Networks (MPNNs) have demonstrated remarkable success in node classification on homophilic graphs. It has been shown that they do not solely rely on homophily but on neighborhood distributions of nodes, i.e.,…

Machine Learning · Computer Science 2024-12-12 Matthias Kohn , Marcel Hoffmann , Ansgar Scherp

Graph coarsening aims to reduce the size of a large graph while preserving some of its key properties, which has been used in many applications to reduce computational load and memory footprint. For instance, in graph machine learning,…

Machine Learning · Computer Science 2024-05-29 Antonin Joly , Nicolas Keriven

Generalized approximate message passing (GAMP) is a promising technique for unknown signal reconstruction of generalized linear models (GLM). However, it requires that the transformation matrix has independent and identically distributed…

Information Theory · Computer Science 2021-10-18 Feiyan Tian , Lei Liu , Xiaoming Chen

Hypergraphs are vital in modelling data with higher-order relations containing more than two entities, gaining prominence in machine learning and signal processing. Many hypergraph neural networks leverage message passing over hypergraph…

Machine Learning · Computer Science 2025-08-09 Bohan Tang , Siheng Chen , Xiaowen Dong

We propose Dynamically Pruned Message Passing Networks (DPMPN) for large-scale knowledge graph reasoning. In contrast to existing models, embedding-based or path-based, we learn an input-dependent subgraph to explicitly model reasoning…

Artificial Intelligence · Computer Science 2020-04-09 Xiaoran Xu , Wei Feng , Yunsheng Jiang , Xiaohui Xie , Zhiqing Sun , Zhi-Hong Deng

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

Information Theory · Computer Science 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Graph Neural Networks (GNNs) have achieved remarkable success in various graph mining tasks by aggregating information from neighborhoods for representation learning. The success relies on the homophily assumption that nearby nodes exhibit…

Machine Learning · Computer Science 2024-06-03 Zhuonan Zheng , Sheng Zhou , Hongjia Xu , Ming Gu , Yilun Xu , Ao Li , Yuhong Li , Jingjun Gu , Jiajun Bu

The most prevalent class of neural networks operating on graphs are message passing neural networks (MPNNs), in which the representation of a node is updated iteratively by aggregating information in the 1-hop neighborhood. Since this…

Machine Learning · Computer Science 2023-10-25 Floor Eijkelboom , Erik Bekkers , Michael Bronstein , Francesco Di Giovanni

Predicting stochastic spreading processes on complex networks is critical in epidemic control, opinion propagation, and viral marketing. We focus on the problem of inferring the time-dependent marginal probabilities of states for each node…

Social and Information Networks · Computer Science 2022-02-15 Fei Gao , Yan Zhang , Jiang Zhang

Graph Neural Networks (GNNs) have shown great power in various domains. However, their predictions may inherit societal biases on sensitive attributes, limiting their adoption in real-world applications. Although many efforts have been…

Machine Learning · Computer Science 2023-06-21 Huaisheng Zhu , Guoji Fu , Zhimeng Guo , Zhiwei Zhang , Teng Xiao , Suhang Wang

The ability of message-passing neural networks (MPNNs) to fit complex functions over graphs is limited as most graph convolutions amplify the same signal across all feature channels, a phenomenon known as rank collapse, and over-smoothing…

Machine Learning · Computer Science 2024-12-10 Andreas Roth , Franka Bause , Nils M. Kriege , Thomas Liebig

Graph Neural Networks (GNNs) have proven to be highly effective in various graph learning tasks. A key characteristic of GNNs is their use of a fixed number of message-passing steps for all nodes in the graph, regardless of each node's…

Machine Learning · Computer Science 2025-09-03 Yassine Abbahaddou , Fragkiskos D. Malliaros , Johannes F. Lutzeyer , Michalis Vazirgiannis

There has been tremendous success in the field of graph neural networks (GNNs) as a result of the development of the message-passing (MP) layer, which updates the representation of a node by combining it with its neighbors to address…

Machine Learning · Computer Science 2022-02-11 Hyeokjin Kwon , Jong-Min Lee

Message passing neural networks (MPNNs) operate on graphs by exchanging information between neigbouring nodes. MPNNs have been successfully applied to various node-, edge-, and graph-level tasks in areas like molecular science, computer…

Machine Learning · Computer Science 2025-11-05 Lisi Qarkaxhija , Anatol E. Wegner , Ingo Scholtes

Modern methods for learning over graph input data have shown the fruitfulness of accounting for relationships among elements in a collection. However, most methods that learn over set input data use only rudimentary approaches to exploit…

Machine Learning · Computer Science 2019-09-24 Yifeng Shi , Junier Oliva , Marc Niethammer

Supervised learning on molecules has incredible potential to be useful in chemistry, drug discovery, and materials science. Luckily, several promising and closely related neural network models invariant to molecular symmetries have already…

Machine Learning · Computer Science 2017-06-14 Justin Gilmer , Samuel S. Schoenholz , Patrick F. Riley , Oriol Vinyals , George E. Dahl