中文
相关论文

相关论文: Mitigating Over-Smoothing and Over-Squashing using…

200 篇论文

Graph Neural Networks (GNNs) had been demonstrated to be inherently susceptible to the problems of over-smoothing and over-squashing. These issues prohibit the ability of GNNs to model complex graph interactions by limiting their…

机器学习 · 计算机科学 2023-06-01 Khang Nguyen , Hieu Nong , Vinh Nguyen , Nhat Ho , Stanley Osher , Tan Nguyen

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph Neural Networks are highly effective at learning from relational data, leveraging node and edge features while maintaining the symmetries inherent to graph structures. However, many real-world systems, such as social or biological…

机器学习 · 计算机科学 2025-08-18 Michael Banf , Dominik Filipiak , Max Schattauer , Liliya Imasheva

Graph neural networks (GNNs) are able to leverage the structure of graph data by passing messages along the edges of the graph. While this allows GNNs to learn features depending on the graph structure, for certain graph topologies it leads…

机器学习 · 计算机科学 2023-02-17 Kedar Karhadkar , Pradeep Kr. Banerjee , Guido Montúfar

Graph neural networks (GNNs) have exhibited state-of-the-art performance across wide-range of domains such as recommender systems, material design, and drug repurposing. Yet message-passing GNNs suffer from over-squashing -- exponential…

机器学习 · 计算机科学 2025-08-14 Danial Saber , Amirali Salehi-Abari

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

机器学习 · 计算机科学 2026-03-30 Mostafa Haghir Chehreghani

Graph Neural Networks (GNNs) have succeeded in various computer science applications, yet deep GNNs underperform their shallow counterparts despite deep learning's success in other domains. Over-smoothing and over-squashing are key…

机器学习 · 计算机科学 2023-08-14 Jhony H. Giraldo , Konstantinos Skianis , Thierry Bouwmans , Fragkiskos D. Malliaros

Graph neural networks compute node representations by performing multiple message-passing steps that consist in local aggregations of node features. Having deep models that can leverage longer-range interactions between nodes is hindered by…

机器学习 · 计算机科学 2025-06-27 Alessio Micheli , Domenico Tortorella

Information over-squashing is a phenomenon of inefficient information propagation between distant nodes on networks. It is an important problem that is known to significantly impact the training of graph neural networks (GNNs), as the…

机器学习 · 统计学 2022-07-19 Jakub Bober , Anthea Monod , Emil Saucan , Kevin N. Webster

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

机器学习 · 计算机科学 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

The message-passing paradigm of Graph Neural Networks often struggles with exchanging information across distant nodes typically due to structural bottlenecks in certain graph regions, a limitation known as \textit{over-squashing}. To…

机器学习 · 计算机科学 2025-06-23 Langzhang Liang , Fanchen Bu , Zixing Song , Zenglin Xu , Shirui Pan , Kijung Shin

Graph Neural Networks (GNNs) have shown great power for learning and mining on graphs, and Graph Structure Learning (GSL) plays an important role in boosting GNNs with a refined graph. In the literature, most GSL solutions either primarily…

机器学习 · 计算机科学 2024-01-24 Li Sun , Zhenhao Huang , Hua Wu , Junda Ye , Hao Peng , Zhengtao Yu , Philip S. Yu

Most graph neural networks (GNNs) are prone to the phenomenon of over-squashing in which node features become insensitive to information from distant nodes in the graph. Recent works have shown that the topology of the graph has the…

机器学习 · 计算机科学 2023-11-30 Julia Balla

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Message passing is the dominant paradigm in Graph Neural Networks (GNNs). The efficiency of message passing, however, can be limited by the topology of the graph. This happens when information is lost during propagation due to being…

机器学习 · 计算机科学 2024-11-05 Floriano Tori , Vincent Holst , Vincent Ginis

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the…

Graph Neural Networks struggle to capture long-range dependencies due to over-squashing, where information from exponentially growing neighborhoods must pass through a small number of structural bottlenecks. While recent rewiring methods…

机器学习 · 计算机科学 2026-03-13 Bertran Miquel-Oliver , Manel Gil-Sorribes , Victor Guallar , Alexis Molina

Mesh-based simulation using Graph Neural Networks (GNNs) has been recognized as a promising approach for modeling fluid dynamics. However, the mesh refinement techniques which allocate finer resolution to regions with steep gradients can…

机器学习 · 计算机科学 2025-11-18 Sangwoo Seo , Hyunsung Kim , Jiwan Kim , Chanyoung Park

Graph Convolutional Network (GCN) with the powerful capacity to explore graph-structural data has gained noticeable success in recent years. Nonetheless, most of the existing GCN-based models suffer from the notorious over-smoothing issue,…

机器学习 · 计算机科学 2023-04-17 Zhaoliang Chen , Zhihao Wu , Zhenghong Lin , Shiping Wang , Claudia Plant , Wenzhong Guo
‹ 上一页 1 2 3 10 下一页 ›