English
Related papers

Related papers: Over-squashing in Spatiotemporal Graph Neural Netw…

200 papers

Spatiotemporal forecasting plays an essential role in various applications in intelligent transportation systems (ITS), such as route planning, navigation, and traffic control and management. Deep Spatiotemporal graph neural networks…

Machine Learning · Computer Science 2021-09-13 Fuqiang Liu , Luis Miranda-Moreno , Lijun Sun

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

The growing complexity of wireless systems has accelerated the move from traditional methods to learning-based solutions. Graph Neural Networks (GNNs) are especially well-suited here, since wireless networks can be naturally represented as…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Romina Garcia Camargo , Zhiyang Wang , Alejandro Ribeiro

Graph neural networks are emerging as continuation of deep learning success w.r.t. graph data. Tens of different graph neural network variants have been proposed, most following a neighborhood aggregation scheme, where the node features are…

Machine Learning · Computer Science 2021-02-09 Dawei Leng , Jinjiang Guo , Lurong Pan , Jie Li , Xinyu Wang

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

Machine Learning · Computer Science 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

Message Passing Neural Networks (MPNNs) are a class of Graph Neural Networks (GNNs) that propagate information across the graph via local neighborhoods. The scheme gives rise to two key challenges: over-smoothing and over-squashing. While…

Machine Learning · Computer Science 2025-05-30 Jasraj Singh , Keyue Jiang , Brooks Paige , Laura Toni

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studies have proposed…

Machine Learning · Computer Science 2025-02-28 Chaohao Yuan , Kangfei Zhao , Ercan Engin Kuruoglu , Liang Wang , Tingyang Xu , Wenbing Huang , Deli Zhao , Hong Cheng , Yu Rong

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent years owing to their capability to model and learn from graph-structured data. Such an ability has strong implications in a wide variety of fields whose…

Machine Learning · Computer Science 2021-07-26 Sergi Abadal , Akshay Jain , Robert Guirado , Jorge López-Alonso , Eduard Alarcón

Accurate forecasting of citywide traffic flow has been playing critical role in a variety of spatial-temporal mining applications, such as intelligent traffic control and public risk assessment. While previous work has made significant…

Machine Learning · Computer Science 2021-10-11 Xiyue Zhang , Chao Huang , Yong Xu , Lianghao Xia , Peng Dai , Liefeng Bo , Junbo Zhang , Yu Zheng

The significant increase in world population and urbanisation has brought several important challenges, in particular regarding the sustainability, maintenance and planning of urban mobility. At the same time, the exponential increase of…

Machine Learning · Computer Science 2021-04-28 João Rico , José Barateiro , Arlindo Oliveira

Deep learning-based approaches have been developed to solve challenging problems in wireless communications, leading to promising results. Early attempts adopted neural network architectures inherited from applications such as computer…

Information Theory · Computer Science 2022-11-07 Yifei Shen , Jun Zhang , S. H. Song , Khaled B. Letaief

Graph neural architecture search has sparked much attention as Graph Neural Networks (GNNs) have shown powerful reasoning capability in many relational tasks. However, the currently used graph search space overemphasizes learning node…

Machine Learning · Computer Science 2022-06-01 Shaofei Cai , Liang Li , Xinzhe Han , Jiebo Luo , Zheng-Jun Zha , Qingming Huang

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series…

Machine Learning · Computer Science 2025-08-19 Bang Hu , Changze Lv , Mingjie Li , Yunpeng Liu , Xiaoqing Zheng , Fengzhe Zhang , Wei cao , Fan Zhang

Modern IoT deployments for environmental sensing produce high volume spatiotemporal data to support downstream tasks such as forecasting, typically powered by machine learning models. While existing filtering and strategic deployment…

Machine Learning · Computer Science 2025-12-02 Ragini Gupta , Naman Raina , Bo Chen , Li Chen , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

Recently, transformer architectures for graphs emerged as an alternative to established techniques for machine learning with graphs, such as (message-passing) graph neural networks. So far, they have shown promising empirical results, e.g.,…

Machine Learning · Computer Science 2024-04-01 Luis Müller , Mikhail Galkin , Christopher Morris , Ladislav Rampášek

Graph Neural Networks (GNNs) are widely applied to graph learning problems such as node classification. When scaling up the underlying graphs of GNNs to a larger size, we are forced to either train on the complete graph and keep the full…

Machine Learning · Computer Science 2024-06-25 Mucong Ding , Tahseen Rabbani , Bang An , Evan Z Wang , Furong Huang

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Graph Neural Networks (GNNs) have been proposed as a tool for learning sparse matrix preconditioners, which are key components in accelerating linear solvers. We present theoretical and empirical evidence that message-passing GNNs are…

Machine Learning · Computer Science 2026-05-26 Vladislav Trifonov , Ekaterina Muravleva , Ivan Oseledets