English

Simple Graph Contrastive Learning via Fractional-order Neural Diffusion Networks

Machine Learning 2025-04-25 v2

Abstract

Graph Contrastive Learning (GCL) has recently made progress as an unsupervised graph representation learning paradigm. GCL approaches can be categorized into augmentation-based and augmentation-free methods. The former relies on complex data augmentations, while the latter depends on encoders that can generate distinct views of the same input. Both approaches may require negative samples for training. In this paper, we introduce a novel augmentation-free GCL framework based on graph neural diffusion models. Specifically, we utilize learnable encoders governed by Fractional Differential Equations (FDE). Each FDE is characterized by an order parameter of the differential operator. We demonstrate that varying these parameters allows us to produce learnable encoders that generate diverse views, capturing either local or global information, for contrastive learning. Our model does not require negative samples for training and is applicable to both homophilic and heterophilic datasets. We demonstrate its effectiveness across various datasets, achieving state-of-the-art performance.

Keywords

Cite

@article{arxiv.2504.16748,
  title  = {Simple Graph Contrastive Learning via Fractional-order Neural Diffusion Networks},
  author = {Yanan Zhao and Feng Ji and Kai Zhao and Xuhao Li and Qiyu Kang and Wenfei Liang and Yahya Alkhatib and Xingchao Jian and Wee Peng Tay},
  journal= {arXiv preprint arXiv:2504.16748},
  year   = {2025}
}

Comments

Submitted to ICML

R2 v1 2026-06-28T23:08:37.038Z