中文
相关论文

相关论文: TSC: A Simple Two-Sided Constraint against Over-Sm…

200 篇论文

The over-smoothing problem is an obstacle of developing deep graph neural network (GNN). Although many approaches to improve the over-smoothing problem have been proposed, there is still a lack of comprehensive understanding and conclusion…

机器学习 · 计算机科学 2023-03-02 Weichen Zhao , Chenguang Wang , Congying Han , Tiande Guo

The performance of graph neural nets (GNNs) is known to gradually decrease with increasing number of layers. This decay is partly attributed to oversmoothing, where repeated graph convolutions eventually make node embeddings…

机器学习 · 计算机科学 2020-02-14 Lingxiao Zhao , Leman Akoglu

Graph Convolution Networks (GCNs) manifest great potential in recommendation. This is attributed to their capability on learning good user and item embeddings by exploiting the collaborative signals from the high-order neighbors. Like other…

信息检索 · 计算机科学 2021-03-30 Fan Liu , Zhiyong Cheng , Lei Zhu , Zan Gao , Liqiang Nie

Contrastive learning has recently attracted plenty of attention in deep graph clustering for its promising performance. However, complicated data augmentations and time-consuming graph convolutional operation undermine the efficiency of…

机器学习 · 计算机科学 2022-06-28 Yue Liu , Xihong Yang , Sihang Zhou , Xinwang Liu

Oversmoothing has been assumed to be the major cause of performance drop in deep graph convolutional networks (GCNs). In this paper, we propose a new view that deep GCNs can actually learn to anti-oversmooth during training. This work…

机器学习 · 计算机科学 2020-06-19 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Shengzhong Liu , Tarek Abdelzaher

Graph Neural Networks (GNNs) have shown great potential in graph data analysis due to their powerful representation capabilities. However, as the network depth increases, the issue of over-smoothing becomes more severe, causing node…

机器学习 · 计算机科学 2025-07-09 Kaichen Ouyang

Graph Convolutional Networks (GCNs) have become pivotal in recommendation systems for learning user and item embeddings by leveraging the user-item interaction graph's node information and topology. However, these models often face the…

信息检索 · 计算机科学 2024-04-23 Leilei Ding , Dazhong Shen , Chao Wang , Tianfu Wang , Le Zhang , Yanyong Zhang

Recent years have witnessed remarkable success achieved by graph neural networks (GNNs) in many real-world applications such as recommendation and drug discovery. Despite the success, oversmoothing has been identified as one of the key…

机器学习 · 计算机科学 2022-06-17 Wei Jin , Xiaorui Liu , Yao Ma , Charu Aggarwal , Jiliang Tang

Graph neural networks (GNNs) manifest pathologies including over-smoothing and limited discriminating power as a result of suboptimally expressive aggregating mechanisms. We herein present a unifying framework for stochastic aggregation…

机器学习 · 统计学 2021-03-01 Yuanqing Wang , Theofanis Karaletsos

Graph Neural Network (GNN) achieves great success for node-level and graph-level tasks via encoding meaningful topological structures of networks in various domains, ranging from social to biological networks. However, repeated aggregation…

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes the representation of a node recursively from its neighbors, making the receptive field size grow exponentially with the…

机器学习 · 统计学 2018-03-02 Jianfei Chen , Jun Zhu , Le Song

Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or…

机器学习 · 计算机科学 2022-04-01 Li Zhang , Heda Song , Nikolaos Aletras , Haiping Lu

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

机器学习 · 计算机科学 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

机器学习 · 计算机科学 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

机器学习 · 计算机科学 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

机器学习 · 计算机科学 2026-03-30 Mostafa Haghir Chehreghani

The decoupled Graph Convolutional Network (GCN), a recent development of GCN that decouples the neighborhood aggregation and feature transformation in each convolutional layer, has shown promising performance for graph representation…

机器学习 · 计算机科学 2022-11-16 Jinsong Chen , Boyu Li , Kun He

Oversmoothing is a central challenge of building more powerful Graph Neural Networks (GNNs). While previous works have only demonstrated that oversmoothing is inevitable when the number of graph convolutions tends to infinity, in this…

机器学习 · 计算机科学 2023-03-02 Xinyi Wu , Zhengdao Chen , William Wang , Ali Jadbabaie

Graph Convolutional Network (GCN) is an emerging technique that performs learning and reasoning on graph data. It operates feature learning on the graph structure, through aggregating the features of the neighbor nodes to obtain the…

机器学习 · 计算机科学 2020-03-06 Fuli Feng , Xiangnan He , Hanwang Zhang , Tat-Seng Chua