中文
相关论文

相关论文: Position: Don't be Afraid of Over-Smoothing And Ov…

200 篇论文

Node features of graph neural networks (GNNs) tend to become more similar with the increase of the network depth. This effect is known as over-smoothing, which we axiomatically define as the exponential convergence of suitable similarity…

机器学习 · 计算机科学 2023-03-21 T. Konstantin Rusch , Michael M. Bronstein , Siddhartha Mishra

Oversmoothing is a fundamental challenge in graph neural networks (GNNs): as the number of layers increases, node embeddings become increasingly similar, and model performance drops sharply. Traditionally, oversmoothing has been quantified…

机器学习 · 计算机科学 2026-02-24 Kaicheng Zhang , Piero Deidda , Desmond Higham , Francesco Tudisco

Graph Neural Networks (GNNs) have shown great potential in graph data analysis due to their powerful representation capabilities. However, as the network depth increases, the issue of over-smoothing becomes more severe, causing node…

机器学习 · 计算机科学 2025-07-09 Kaichen Ouyang

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Oversmoothing has been recognized as a main obstacle to building deep Graph Neural Networks (GNNs), limiting the performance. This position paper argues that the influence of oversmoothing has been overstated and advocates for a further…

机器学习 · 计算机科学 2025-06-06 MoonJeong Park , Sunghyun Choi , Jaeseung Heo , Eunhyeok Park , Dongwoo Kim

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

机器学习 · 计算机科学 2023-01-10 Yeskendir Koishekenov

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph Neural Networks (GNNs) have achieved remarkable success across various domains. However, recent theoretical advances have identified fundamental limitations in their information propagation capabilities, such as over-squashing, where…

机器学习 · 计算机科学 2025-11-04 Ivan Marisca , Jacob Bamberger , Cesare Alippi , Michael M. Bronstein

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

机器学习 · 计算机科学 2026-03-30 Mostafa Haghir Chehreghani

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

机器学习 · 计算机科学 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph Neural Networks (GNNs) leverage the graph structure to transmit information between nodes, typically through the message-passing mechanism. While these models have found a wide variety of applications, they are known to suffer from…

机器学习 · 计算机科学 2025-10-23 Hugh Blayney , Álvaro Arroyo , Xiaowen Dong , Michael M. Bronstein

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

机器学习 · 计算机科学 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

机器学习 · 计算机科学 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan

This paper addresses key challenges in enhancing recommendation systems by leveraging Graph Neural Networks (GNNs) and addressing inherent limitations such as over-smoothing, which reduces model effectiveness as network hierarchy deepens.…

信息检索 · 计算机科学 2024-12-05 Wenyi Liu , Ziqi Zhang , Xinshi Li , Jiacheng Hu , Yuanshuai Luo , Junliang Du

We analyze graph smoothing with \emph{mean aggregation}, where each node successively receives the average of the features of its neighbors. Indeed, it has quickly been observed that Graph Neural Networks (GNNs), which generally follow some…

机器学习 · 统计学 2022-10-11 Nicolas Keriven

The drastic performance degradation of Graph Neural Networks (GNNs) as the depth of the graph propagation layers exceeds 8-10 is widely attributed to a phenomenon of Over-smoothing. Although recent research suggests that Over-smoothing may…

机器学习 · 计算机科学 2024-08-08 Jie Peng , Runlin Lei , Zhewei Wei

Graph Neural Networks (GNNs) revolutionize machine learning for graph-structured data, effectively capturing complex relationships. They disseminate information through interconnected nodes, but long-range interactions face challenges known…

人工智能 · 计算机科学 2025-03-18 Singh Akansha

Graph Neural Networks (GNNs) had been demonstrated to be inherently susceptible to the problems of over-smoothing and over-squashing. These issues prohibit the ability of GNNs to model complex graph interactions by limiting their…

机器学习 · 计算机科学 2023-06-01 Khang Nguyen , Hieu Nong , Vinh Nguyen , Nhat Ho , Stanley Osher , Tan Nguyen

Oversmoothing has long been identified as a major limitation of Graph Neural Networks (GNNs): input node features are smoothed at each layer and converge to a non-informative representation, if the weights of the GNN are sufficiently…

机器学习 · 计算机科学 2026-03-16 Nicolas Keriven
‹ 上一页 1 2 3 10 下一页 ›