English
Related papers

Related papers: Half-Hop: A graph upsampling approach for slowing …

200 papers

We propose Scalable Message Passing Neural Networks (SMPNNs) and demonstrate that, by integrating standard convolutional message passing into a Pre-Layer Normalization Transformer-style block instead of attention, we can produce…

Machine Learning · Computer Science 2026-03-11 Haitz Sáez de Ocáriz Borde , Artem Lukoianov , Anastasis Kratsios , Michael Bronstein , Xiaowen Dong

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

In recent years, graph neural networks (GNNs) have been widely adopted in the representation learning of graph-structured data and provided state-of-the-art performance in various applications such as link prediction, node classification,…

Machine Learning · Computer Science 2021-04-14 Dasol Hwang , Jinyoung Park , Sunyoung Kwon , Kyung-Min Kim , Jung-Woo Ha , Hyunwoo J. Kim

Graph Neural Networks (GNNs) typically scale with the number of graph edges, making them well suited for sparse graphs but less efficient on dense graphs, such as point clouds or molecular interactions. A common remedy is to sparsify the…

Machine Learning · Computer Science 2025-12-03 Shiyu Chen , Ningyuan Huang , Soledad Villar

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song

When studying interacting systems, computing their statistical properties is a fundamental problem in various fields such as physics, applied mathematics, and machine learning. However, this task can be quite challenging due to the…

Statistical Mechanics · Physics 2023-05-04 Yijia Wang , Yuwen Ebony Zhang , Feng Pan , Pan Zhang

Graph representation learning has been extensively studied in recent years. Despite its potential in generating continuous embeddings for various networks, both the effectiveness and efficiency to infer high-quality representations toward…

Machine Learning · Computer Science 2020-06-26 Zhen Yang , Ming Ding , Chang Zhou , Hongxia Yang , Jingren Zhou , Jie Tang

Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing…

Machine Learning · Computer Science 2022-10-27 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Analyzing massive data sets has been one of the key motivations for studying streaming algorithms. In recent years, there has been significant progress in analysing distributions in a streaming setting, but the progress on graph problems…

Data Structures and Algorithms · Computer Science 2009-05-05 Kook Jin Ahn , Sudipto Guha

The dominant paradigm for learning on graph-structured data is message passing. Despite being a strong inductive bias, the local message passing mechanism suffers from pathological issues such as over-smoothing, over-squashing, and limited…

Machine Learning · Computer Science 2025-04-15 Jacob Bamberger , Federico Barbero , Xiaowen Dong , Michael M. Bronstein

Graph neural networks (GNNs) learn to represent nodes by aggregating information from their neighbors. As GNNs increase in depth, their receptive field grows exponentially, leading to high memory costs. Several existing methods address this…

Machine Learning · Computer Science 2025-07-16 Taraneh Younesian , Daniel Daza , Emile van Krieken , Thiviyan Thanapalasingam , Peter Bloem

Graph Neural Networks (GNNs) are powerful tools for graph representation learning. Despite their rapid development, GNNs also face some challenges, such as over-fitting, over-smoothing, and non-robustness. Previous works indicate that these…

Machine Learning · Computer Science 2023-07-04 Taoran Fang , Zhiqing Xiao , Chunping Wang , Jiarong Xu , Xuan Yang , Yang Yang

Graph spanners are sparse subgraphs which approximately preserve all pairwise shortest-path distances in an input graph. The notion of approximation can be additive, multiplicative, or both, and many variants of this problem have been…

Data Structures and Algorithms · Computer Science 2019-11-19 Manuel Fernandez , David P. Woodruff , Taisuke Yasuda

The paper presents a solution to the problem of universal representation of graphs exemplifying communication network topologies with the help of neural networks. The proposed approach is based on message-passing neural networks (MPNN). The…

Networking and Internet Architecture · Computer Science 2019-04-15 Krzysztof Rusek , Piotr Chołda

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Ghania Fatima , Aakash Arora , Prabhu Babu , Petre Stoica

Self-supervised node representation learning aims to learn node representations from unlabelled graphs that rival the supervised counterparts. The key towards learning informative node representations lies in how to effectively gain…

Machine Learning · Computer Science 2023-02-13 Wei Dong , Dawei Yan , Peng Wang

Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability,…

Spectral Theory · Mathematics 2026-05-20 Yuanhong Jiang , Dongmian Zou , Xiaoqun Zhang , Yu Guang Wang

Random walk-based node embedding algorithms have attracted a lot of attention due to their scalability and ease of implementation. Previous research has focused on different walk strategies, optimization objectives, and embedding learning…

Machine Learning · Computer Science 2025-01-23 Konstantin Kutzkov

Graph Neural Networks (GNNs) have achieved remarkable performance in modeling graphs for various applications. However, most existing GNNs assume the graphs exhibit strong homophily in node labels, i.e., nodes with similar labels are…

Machine Learning · Computer Science 2023-02-20 Enyan Dai , Shijie Zhou , Zhimeng Guo , Suhang Wang