English
Related papers

Related papers: Oversmoothing: A Nightmare for Graph Contrastive L…

200 papers

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Graph Convolutional Network (GCN) has exhibited remarkable potential in improving graph-based clustering. To handle the general clustering scenario without a prior graph, these models estimate an initial graph beforehand to apply GCN.…

Machine Learning · Computer Science 2024-04-04 Mulin Chen , Bocheng Wang , Xuelong Li

The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature. These methods contrast semantically similar and…

Machine Learning · Computer Science 2022-06-03 Ganqu Cui , Yufeng Du , Cheng Yang , Jie Zhou , Liang Xu , Xing Zhou , Xingyi Cheng , Zhiyuan Liu

Graph Contrastive Learning (GCL), learning the node representations by augmenting graphs, has attracted considerable attentions. Despite the proliferation of various graph augmentation strategies, some fundamental questions still remain…

Machine Learning · Computer Science 2022-10-06 Nian Liu , Xiao Wang , Deyu Bo , Chuan Shi , Jian Pei

Graph Neural Networks (GNNs) have achieved remarkable success in learning node representations and have shown strong performance in tasks such as node classification. However, recent findings indicate that the presence of noise in…

Machine Learning · Computer Science 2025-07-01 Yancheng Wang , Yingzhen Yang

Graph Contrastive Learning (GCL) seeks to learn nodal or graph representations that contain maximal consistent information from graph-structured data. While node-level contrasting modes are dominating, some efforts commence to explore…

Machine Learning · Computer Science 2024-09-13 Zhenhao Zhao , Minhong Zhu , Chen Wang , Sijia Wang , Jiqiang Zhang , Li Chen , Weiran Cai

Graph Neural Networks (GNNs) have achieved promising performance in semi-supervised node classification in recent years. However, the problem of insufficient supervision, together with representation collapse, largely limits the performance…

Machine Learning · Computer Science 2025-03-07 Xihong Yang , Yiqi Wang , Yue Liu , Yi Wen , Lingyuan Meng , Sihang Zhou , Xinwang Liu , En Zhu

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

Graph Contrastive Learning (GCL) relies on semantically consistent graph augmentations, but common local perturbations provide limited control over global structural consistency, motivating a more principled global augmentation strategy. We…

Machine Learning · Computer Science 2026-05-13 Nero Z. Li , Xuehao Zhai , Zhichao Shi , Boshen Shi , Xuhui Jiang

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Recently, motivated by real applications, a major research direction in graph neural networks (GNNs) is to explore deeper structures. For instance, the graph connectivity is not always consistent with the label distribution (e.g., the…

Machine Learning · Computer Science 2022-10-26 Lecheng Zheng , Dongqi Fu , Ross Maciejewski , Jingrui He

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this…

Information Retrieval · Computer Science 2024-10-01 Chengkai Liu , Jianling Wang , James Caverlee

Traditional Graph Neural Network (GNN), as a graph representation learning method, is constrained by label information. However, Graph Contrastive Learning (GCL) methods, which tackle the label problem effectively, mainly focus on the…

Machine Learning · Computer Science 2023-08-08 Kai Yang , Yuan Liu , Zijuan Zhao , Peijin Ding , Wenqian Zhao

Graph Convolutional Networks (GCNs) suffer from performance degradation when models go deeper. However, earlier works only attributed the performance degeneration to over-smoothing. In this paper, we conduct theoretical and experimental…

Machine Learning · Computer Science 2024-01-24 Weigang Lu , Yibing Zhan , Binbin Lin , Ziyu Guan , Liu Liu , Baosheng Yu , Wei Zhao , Yaming Yang , Dacheng Tao

Graph contrastive learning (GCL) emerges as the most representative approach for graph representation learning, which leverages the principle of maximizing mutual information (InfoMax) to learn node representations applied in downstream…

Machine Learning · Computer Science 2022-11-22 Yige Yuan , Bingbing Xu , Huawei Shen , Qi Cao , Keting Cen , Wen Zheng , Xueqi Cheng

Recommendation models utilizing Graph Convolutional Networks (GCNs) have achieved state-of-the-art performance, as they can integrate both the node information and the topological structure of the user-item interaction graph. However, these…

Information Retrieval · Computer Science 2022-11-28 Xin Zhou , Donghui Lin , Yong Liu , Chunyan Miao

Graph contrastive learning (GCL) has emerged as a representative paradigm in graph self-supervised learning, where negative samples are commonly regarded as the key to preventing model collapse and producing distinguishable representations.…

Machine Learning · Computer Science 2023-12-06 Wangbin Sun , Jintang Li , Liang Chen , Bingzhe Wu , Yatao Bian , Zibin Zheng

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

Machine Learning · Computer Science 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Numerous recent research on graph neural networks (GNNs) has focused on formulating GNN architectures as an optimization problem with the smoothness assumption. However, in node classification tasks, the smoothing effect induced by GNNs…

Machine Learning · Computer Science 2023-09-14 Jiayu Zhai , Lequan Lin , Dai Shi , Junbin Gao