中文
相关论文

相关论文: SkipNode: On Alleviating Performance Degradation f…

200 篇论文

Graph Neural Networks (GNNs) suffer from over-smoothing in deep architectures and expressiveness bounded by the 1-Weisfeiler-Leman (1-WL) test. We adapt Manifold-Constrained Hyper-Connections (\mhc)~\citep{xie2025mhc}, recently proposed for…

机器学习 · 计算机科学 2026-01-07 Subhankar Mishra

Graph Convolutional Networks (GCNs) have become pivotal in recommendation systems for learning user and item embeddings by leveraging the user-item interaction graph's node information and topology. However, these models often face the…

信息检索 · 计算机科学 2024-04-23 Leilei Ding , Dazhong Shen , Chao Wang , Tianfu Wang , Le Zhang , Yanyong Zhang

Graph Convolutional Networks (GCNs) have achieved impressive empirical advancement across a wide variety of semi-supervised node classification tasks. Despite their great success, training GCNs on large graphs suffers from computational and…

机器学习 · 计算机科学 2021-11-02 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Oversmoothing in Graph Neural Networks (GNNs) poses a significant challenge as network depth increases, leading to homogenized node representations and a loss of expressiveness. In this work, we approach the oversmoothing problem from a…

机器学习 · 计算机科学 2024-12-11 Biswadeep Chakraborty , Harshit Kumar , Saibal Mukhopadhyay

Message Passing Neural Networks (MPNNs) is the building block of graph foundation models, but fundamentally suffer from oversmoothing and oversquashing. There has recently been a surge of interest in fixing both issues. Existing efforts…

机器学习 · 计算机科学 2025-10-21 Li Sun , Zhenhao Huang , Ming Zhang , Philip S. Yu

The performance limit of Graph Convolutional Networks (GCNs) and the fact that we cannot stack more of them to increase the performance, which we usually do for other deep learning paradigms, are pervasively thought to be caused by the…

机器学习 · 计算机科学 2023-11-07 Sitao Luan , Mingde Zhao , Xiao-Wen Chang , Doina Precup

The vanilla Graph Convolutional Network (GCN) uses a low-pass filter to extract low-frequency signals from graph topology, which may lead to the over-smoothing problem when GCN goes deep. To this end, various methods have been proposed to…

机器学习 · 计算机科学 2024-02-13 Chen Huang , Haoyang Li , Yifan Zhang , Wenqiang Lei , Jiancheng Lv

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, on large-scale real-world graphs, GNNs face two major…

机器学习 · 计算机科学 2026-03-10 Xiang Li , Jianpeng Qi , Haobing Liu , Yuan Cao , Guoqing Chao , Zhongying Zhao , Junyu Dong , Xinwang Liu , Yanwei Yu

Graph Convolutional Networks (GCN) are Graph Neural Networks where the convolutions are applied over a graph. In contrast to Convolutional Neural Networks, GCN's are designed to perform inference on graphs, where the number of nodes can…

机器学习 · 计算机科学 2024-06-12 Adrian Moldovan , Angel Caţaron , Răzvan Andonie

Implicit Graph Neural Networks (GNNs) have achieved significant success in addressing graph learning problems recently. However, poorly designed implicit GNN layers may have limited adaptability to learn graph metrics, experience…

机器学习 · 计算机科学 2024-02-16 Guoji Fu , Mohammed Haroon Dupty , Yanfei Dong , Lee Wee Sun

Graph Convolutional Networks (GCNs) have emerged as powerful tools for learning on network structured data. Although empirically successful, GCNs exhibit certain behaviour that has no rigorous explanation -- for instance, the performance of…

机器学习 · 计算机科学 2023-11-07 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Graphs are useful for representing various realworld objects. However, graph neural networks (GNNs) tend to suffer from over-smoothing, where the representations of nodes of different classes become similar as the number of layers…

机器学习 · 计算机科学 2024-10-22 Jun Kato , Airi Mita , Keita Gobara , Akihiro Inokuchi

Modern neural networks have shown promise for solving partial differential equations over surfaces, often by discretizing the surface as a mesh and learning with a mesh-aware graph neural network. However, graph neural networks suffer from…

机器学习 · 计算机科学 2026-05-13 Edward Berman , Luisa Li , Jung Yeon Park , Robin Walters

Graph Neural Networks (GNNs) have emerged as the most powerful weapon for various graph tasks due to the message-passing mechanism's great local information aggregation ability. However, over-smoothing has always hindered GNNs from going…

机器学习 · 计算机科学 2024-03-26 Yundong Sun , Dongjie Zhu , Yansong Wang , Zhaoshuo Tian

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

机器学习 · 计算机科学 2026-03-30 Mostafa Haghir Chehreghani

Graph Convolutional Networks (GCNs) achieve an impressive performance due to the remarkable representation ability in learning the graph information. However, GCNs, when implemented on a deep network, require expensive computation power,…

机器学习 · 计算机科学 2022-08-03 Zulun Zhu , Jiaying Peng , Jintang Li , Liang Chen , Qi Yu , Siqiang Luo

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

机器学习 · 计算机科学 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

As much as Graph Convolutional Networks (GCNs) have shown tremendous success in recommender systems and collaborative filtering (CF), the mechanism of how they, especially the core components (\textit{i.e.,} neighborhood aggregation)…

信息检索 · 计算机科学 2022-04-26 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and…

机器学习 · 计算机科学 2021-07-13 Ronghang Zhu , Zhiqiang Tao , Yaliang Li , Sheng Li

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features…

机器学习 · 计算机科学 2024-07-30 Dongzhuoran Zhou , Hui Yang , Bo Xiong , Yue Ma , Evgeny Kharlamov