中文
相关论文

相关论文: How Wide and How Deep? Mitigating Over-Squashing o…

200 篇论文

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

机器学习 · 计算机科学 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas

Graph Neural Networks (GNNs) leverage the graph structure to transmit information between nodes, typically through the message-passing mechanism. While these models have found a wide variety of applications, they are known to suffer from…

机器学习 · 计算机科学 2025-10-23 Hugh Blayney , Álvaro Arroyo , Xiaowen Dong , Michael M. Bronstein

Graph neural networks operate on graph-structured data via exchanging messages along edges. One limitation of this message passing paradigm is the over-squashing problem. Over-squashing occurs when messages from a node's expanded receptive…

机器学习 · 计算机科学 2023-11-15 Thomas Christie , Yu He

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

机器学习 · 计算机科学 2026-03-30 Mostafa Haghir Chehreghani

Deploying graph neural networks (GNNs) on whole-graph classification or regression tasks is known to be challenging: it often requires computing node features that are mindful of both local interactions in their neighbourhood and the global…

机器学习 · 计算机科学 2022-12-22 Andreea Deac , Marc Lackenby , Petar Veličković

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph Neural Networks (GNNs) revolutionize machine learning for graph-structured data, effectively capturing complex relationships. They disseminate information through interconnected nodes, but long-range interactions face challenges known…

人工智能 · 计算机科学 2025-03-18 Singh Akansha

In spite of the plethora of success stories with graph neural networks (GNNs) on modelling graph-structured data, they are notoriously vulnerable to over-squashing, whereby tasks necessitate the mixing of information between distance pairs…

机器学习 · 计算机科学 2025-05-20 JJ Wilson , Maya Bechler-Speicher , Petar Veličković

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

机器学习 · 计算机科学 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the…

Graph neural networks (GNNs) have exhibited state-of-the-art performance across wide-range of domains such as recommender systems, material design, and drug repurposing. Yet message-passing GNNs suffer from over-squashing -- exponential…

机器学习 · 计算机科学 2025-08-14 Danial Saber , Amirali Salehi-Abari

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

机器学习 · 计算机科学 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan

Message Passing Graph Neural Networks are known to suffer from two problems that are sometimes believed to be diametrically opposed: over-squashing and over-smoothing. The former results from topological bottlenecks that hamper the…

机器学习 · 计算机科学 2024-10-31 Adarsh Jamadandi , Celia Rubio-Madrigal , Rebekka Burkholz

Most graph neural networks (GNNs) are prone to the phenomenon of over-squashing in which node features become insensitive to information from distant nodes in the graph. Recent works have shown that the topology of the graph has the…

机器学习 · 计算机科学 2023-11-30 Julia Balla

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Information over-squashing is a phenomenon of inefficient information propagation between distant nodes on networks. It is an important problem that is known to significantly impact the training of graph neural networks (GNNs), as the…

机器学习 · 统计学 2022-07-19 Jakub Bober , Anthea Monod , Emil Saucan , Kevin N. Webster

Graph Neural Networks (GNNs) are the state-of-the-art model for machine learning on graph-structured data. The most popular class of GNNs operate by exchanging information between adjacent nodes, and are known as Message Passing Neural…

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a…

机器学习 · 计算机科学 2021-10-29 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi
‹ 上一页 1 2 3 10 下一页 ›