English
Related papers

Related papers: Calibrating and Improving Graph Contrastive Learni…

200 papers

Contrastive learning has recently attracted plenty of attention in deep graph clustering for its promising performance. However, complicated data augmentations and time-consuming graph convolutional operation undermine the efficiency of…

Machine Learning · Computer Science 2022-06-28 Yue Liu , Xihong Yang , Sihang Zhou , Xinwang Liu

Human beings can quickly adapt to environmental changes by leveraging learning experience. However, the poor ability of adapting to dynamic environments remains a major challenge for AI models. To better understand this issue, we study the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Peng Su , Shixiang Tang , Peng Gao , Di Qiu , Ni Zhao , Xiaogang Wang

Graph Neural Networks (GNNs) have recently gained widespread attention as a successful tool for analyzing graph-structured data. However, imperfect graph structure with noisy links lacks enough robustness and may damage graph…

Machine Learning · Computer Science 2025-03-25 Xianlin Zeng , Yufeng Wang , Yuqi Sun , Guodong Guo , Wenrui Ding , Baochang Zhang

The rise of self-supervised learning, which operates without the need for labeled data, has garnered significant interest within the graph learning community. This enthusiasm has led to the development of numerous Graph Contrastive Learning…

Machine Learning · Computer Science 2024-02-27 Qian Ma , Hongliang Chi , Hengrui Zhang , Kay Liu , Zhiwei Zhang , Lu Cheng , Suhang Wang , Philip S. Yu , Yao Ma

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

Machine Learning · Computer Science 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Graph Neural Networks (GNNs) have achieved remarkable success in learning node representations and have shown strong performance in tasks such as node classification. However, recent findings indicate that the presence of noise in…

Machine Learning · Computer Science 2025-07-01 Yancheng Wang , Yingzhen Yang

Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message…

Machine Learning · Computer Science 2025-11-12 Xiang Chen , Kun Yue , Wenjie Liu , Zhenyu Zhang , Liang Duan

Recent advances in unsupervised deep graph clustering have been significantly promoted by contrastive learning. Despite the strides, most graph contrastive learning models face challenges: 1) graph augmentation is used to improve learning…

Machine Learning · Computer Science 2024-08-23 Chusheng Zeng , Bocheng Wang , Jinghui Yuan , Rong Wang , Mulin Chen

Graph classification is a widely studied problem and has broad applications. In many real-world problems, the number of labeled graphs available for training classification models is limited, which renders these models prone to overfitting.…

Machine Learning · Computer Science 2020-09-15 Jiaqi Zeng , Pengtao Xie

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

Contrastive learning has become a key component of self-supervised learning approaches for graph-structured data. Despite their success, existing graph contrastive learning methods are incapable of uncertainty quantification for node…

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Dynamic graph data mining has gained popularity in recent years due to the rich information contained in dynamic graphs and their widespread use in the real world. Despite the advances in dynamic graph neural networks (DGNNs), the rich…

Machine Learning · Computer Science 2023-12-27 Yuanchen Bei , Hao Xu , Sheng Zhou , Huixuan Chi , Haishuai Wang , Mengdi Zhang , Zhao Li , Jiajun Bu

Self-supervised learning on graphs has made large strides in achieving great performance in various downstream tasks. However, many state-of-the-art methods suffer from a number of impediments, which prevent them from realizing their full…

Machine Learning · Computer Science 2023-08-02 William Shiao , Uday Singh Saini , Yozen Liu , Tong Zhao , Neil Shah , Evangelos E. Papalexakis

Recent advancements in contrastive learning have revolutionized self-supervised representation learning and achieved state-of-the-art performance on benchmark tasks. While most existing methods focus on applying contrastive learning to…

Machine Learning · Computer Science 2024-04-16 Lihui Liu , Jinha Kim , Vidit Bansal

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

With the rise of contrastive learning, unsupervised graph representation learning has been booming recently, even surpassing the supervised counterparts in some machine learning tasks. Most of existing contrastive models for graph…

Machine Learning · Computer Science 2021-12-16 Chunyang Zhang , Hongyu Yao , C. L. Philip Chen , Yuena Lin

Contrastive learning on graphs aims at extracting distinguishable high-level representations of nodes. In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual…

Machine Learning · Computer Science 2023-07-27 Yixuan Ma , Xiaolin Zhang , Peng Zhang , Kun Zhan

Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of…

Machine Learning · Computer Science 2023-12-21 Wenlong Ji , Zhun Deng , Ryumei Nakada , James Zou , Linjun Zhang