English

Simple and Asymmetric Graph Contrastive Learning without Augmentations

Machine Learning 2024-02-27 v3 Machine Learning

Abstract

Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily assumptions. Thus, they fail to generalize well to heterophilic graphs where connected nodes may have different class labels and dissimilar features. In this paper, we study the problem of conducting contrastive learning on homophilic and heterophilic graphs. We find that we can achieve promising performance simply by considering an asymmetric view of the neighboring nodes. The resulting simple algorithm, Asymmetric Contrastive Learning for Graphs (GraphACL), is easy to implement and does not rely on graph augmentations and homophily assumptions. We provide theoretical and empirical evidence that GraphACL can capture one-hop local neighborhood information and two-hop monophily similarity, which are both important for modeling heterophilic graphs. Experimental results show that the simple GraphACL significantly outperforms state-of-the-art graph contrastive learning and self-supervised learning methods on homophilic and heterophilic graphs. The code of GraphACL is available at https://github.com/tengxiao1/GraphACL.

Keywords

Cite

@article{arxiv.2310.18884,
  title  = {Simple and Asymmetric Graph Contrastive Learning without Augmentations},
  author = {Teng Xiao and Huaisheng Zhu and Zhengyu Chen and Suhang Wang},
  journal= {arXiv preprint arXiv:2310.18884},
  year   = {2024}
}

Comments

NeurIPS 2023 Main Track

R2 v1 2026-06-28T13:04:54.335Z