English
Related papers

Related papers: Learning Long Range Dependencies on Graphs via Ran…

200 papers

Modern sequence models (e.g., Transformers, linear RNNs, etc.) emerged as dominant backbones of recent deep learning frameworks, mainly due to their efficiency, representational power, and/or ability to capture long-range dependencies.…

Machine Learning · Computer Science 2024-11-26 Ali Behrouz , Ali Parviz , Mahdi Karami , Clayton Sanford , Bryan Perozzi , Vahab Mirrokni

Message Passing Neural Networks (MPNNs) model local relations effectively but struggle to propagate information over long distances. Graph Transformers (GTs) mitigate this via global self-attention, yet their quadratic cost in the number of…

Machine Learning · Computer Science 2025-09-03 Shuo Wang , Ge Cheng , Yun Zhang

Graph structural information such as topologies or connectivities provides valuable guidance for graph convolutional networks (GCNs) to learn nodes' representations. Existing GCN models that capture nodes' structural information weight in-…

Machine Learning · Computer Science 2021-07-22 Yunxiang Zhao , Jianzhong Qi , Qingwei Liu , Rui Zhang

Graphs (networks) are ubiquitous and allow us to model entities (nodes) and the dependencies (edges) between them. Learning a useful feature representation from graph data lies at the heart and success of many machine learning tasks such as…

Network data can be conveniently modeled as a graph signal, where data values are assigned to nodes of a graph that describes the underlying network topology. Successful learning from network data is built upon methods that effectively…

Machine Learning · Computer Science 2021-05-26 Fernando Gama , Elvin Isufi , Geert Leus , Alejandro Ribeiro

Message passing is a core mechanism in Graph Neural Networks (GNNs), enabling the iterative update of node embeddings by aggregating information from neighboring nodes. Graph Convolutional Networks (GCNs) exemplify this approach by adapting…

Machine Learning · Computer Science 2026-03-26 Mayssa Soussia , Gita Ayu Salsabila , Mohamed Ali Mahjoub , Islem Rekik

Graphs are a powerful data structure to represent relational data and are widely used to describe complex real-world data structures. Probabilistic Graphical Models (PGMs) have been well-developed in the past years to mathematically model…

Artificial Intelligence · Computer Science 2023-01-31 Chenqing Hua , Sitao Luan , Qian Zhang , Jie Fu

Graph Neural Networks (GNNs) learn from graph-structured data by passing local messages between neighboring nodes along edges on certain topological layouts. Typically, these topological layouts in modern GNNs are deterministically computed…

Machine Learning · Computer Science 2024-02-27 Xinjian Zhao , Chaolong Ying , Tianshu Yu

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

The growing interest in Temporal Graph Neural Networks (TGNNs) stems from their ability to model complex dynamics and deliver superior performance. However, TGNNs encounter fundamental challenges in capturing long-term dependencies and…

Machine Learning · Computer Science 2026-05-26 Hongjiang Chen , Pengfei Jiao , Ming Du , Xuan Guo , Zhidong Zhao , Di Jin , Xiao Liu

A wide range of models have been proposed for Graph Generative Models, necessitating effective methods to evaluate their quality. So far, most techniques use either traditional metrics based on subgraph counting, or the representations of…

Machine Learning · Statistics 2022-06-14 Hamed Shirzad , Kaveh Hassani , Danica J. Sutherland

Dynamical systems consisting of a set of autonomous agents face the challenge of having to accomplish a global task, relying only on local information. While centralized controllers are readily available, they face limitations in terms of…

Machine Learning · Computer Science 2022-03-24 Fernando Gama , Qingbiao Li , Ekaterina Tolstaya , Amanda Prorok , Alejandro Ribeiro

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Graph Neural Networks (GNNs) is an architecture for structural data, and has been adopted in a mass of tasks and achieved fabulous results, such as link prediction, node classification, graph classification and so on. Generally, for a…

Machine Learning · Computer Science 2022-05-12 Ye Tang , Xuesong Yang , Xinrui Liu , Xiwei Zhao , Zhangang Lin , Changping Peng

Graph Neural Networks (GNNs) are efficient approaches to process graph-structured data. Modelling long-distance node relations is essential for GNN training and applications. However, conventional GNNs suffer from bad performance in…

Machine Learning · Computer Science 2020-05-19 Deli Chen , Xiaoqian Liu , Yankai Lin , Peng Li , Jie Zhou , Qi Su , Xu Sun

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. We investigate the power of GCNs, as a function of their number of layers, to distinguish between different random graph models on the basis of…

Machine Learning · Statistics 2020-02-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

Graph Neural Networks (GNNs) have recently emerged as a robust framework for graph-structured data. They have been applied to many problems such as knowledge graph analysis, social networks recommendation, and even Covid19 detection and…

Software Engineering · Computer Science 2022-01-04 Thanh-Dat Nguyen , Thanh Le-Cong , ThanhVu H. Nguyen , Xuan-Bach D. Le , Quyet-Thang Huynh

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

Graph Neural Networks (GNNs) are widely used deep learning models that learn meaningful representations from graph-structured data. Due to the finite nature of the underlying recurrent structure, current GNN methods may struggle to capture…

Machine Learning · Computer Science 2021-06-02 Fangda Gu , Heng Chang , Wenwu Zhu , Somayeh Sojoudi , Laurent El Ghaoui

Modeling long-range interactions, the propagation of information across distant parts of a graph, is a central challenge in graph machine learning. Graph wavelets, inspired by multi-resolution signal processing, provide a principled way to…

Machine Learning · Computer Science 2025-10-14 Filippo Guerranti , Fabrizio Forte , Simon Geisler , Stephan Günnemann