English
Related papers

Related papers: Overcoming Pitfalls in Graph Contrastive Learning …

200 papers

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational Bayesian neural…

Machine Learning · Computer Science 2023-12-04 Alexander Möllers , Alexander Immer , Elvin Isufi , Vincent Fortuin

The success of deep learning notoriously requires larger amounts of costly annotated data. This has led to the development of self-supervised learning (SSL) that aims to alleviate this limitation by creating domain specific pretext tasks on…

Machine Learning · Computer Science 2020-06-19 Wei Jin , Tyler Derr , Haochen Liu , Yiqi Wang , Suhang Wang , Zitao Liu , Jiliang Tang

Graph Structure Learning (GSL) has recently garnered considerable attention due to its ability to optimize both the parameters of Graph Neural Networks (GNNs) and the computation graph structure simultaneously. Despite the proliferation of…

Machine Learning · Computer Science 2023-10-10 Zhixun Li , Liang Wang , Xin Sun , Yifan Luo , Yanqiao Zhu , Dingshuo Chen , Yingtao Luo , Xiangxin Zhou , Qiang Liu , Shu Wu , Liang Wang , Jeffrey Xu Yu

The prevailing graph neural network models have achieved significant progress in graph representation learning. However, in this paper, we uncover an ever-overlooked phenomenon: the pre-trained graph representation learning model tested…

Machine Learning · Computer Science 2023-02-14 Hang Gao , Jiangmeng Li , Wenwen Qiang , Lingyu Si , Bing Xu , Changwen Zheng , Fuchun Sun

Graph contrastive learning (GCL) has emerged as a dominant technique for graph representation learning which maximizes the mutual information between paired graph augmentations that share the same semantics. Unfortunately, it is difficult…

Machine Learning · Computer Science 2023-03-21 Jun Xia , Lirong Wu , Jintao Chen , Bozhen Hu , Stan Z. Li

Nowadays, real-world data, including graph-structure data, often arrives in a streaming manner, which means that learning systems need to continuously acquire new knowledge without forgetting previously learned information. Although…

Machine Learning · Computer Science 2025-09-29 Ziyang Cheng , Zhixun Li , Yuhan Li , Yixin Song , Kangyi Zhao , Dawei Cheng , Jia Li , Hong Cheng , Jeffrey Xu Yu

This paper studies active learning (AL) on graphs, whose purpose is to discover the most informative nodes to maximize the performance of graph neural networks (GNNs). Previously, most graph AL methods focus on learning node representations…

Machine Learning · Computer Science 2021-04-19 Yanqiao Zhu , Weizhi Xu , Qiang Liu , Shu Wu

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Contrastive learning is a significant paradigm in graph self-supervised learning. However, it requires negative samples to prevent model collapse and learn discriminative representations. These negative samples inevitably lead to heavy…

Machine Learning · Computer Science 2024-08-12 Yunhui Liu , Huaisong Zhang , Tieke He , Tao Zheng , Jianhua Zhao

Graph representation learning is fundamental for analyzing graph-structured data. Exploring invariant graph representations remains a challenge for most existing graph representation learning methods. In this paper, we propose a cross-view…

Machine Learning · Computer Science 2025-04-15 Jie Chen , Hua Mao , Wai Lok Woo , Chuanbin Liu , Xi Peng

Graph Contrastive Learning (GCL) has emerged as a powerful tool for extracting consistent representations from graphs, independent of labeled information. However, existing methods predominantly focus on undirected graphs, disregarding the…

Machine Learning · Computer Science 2025-10-21 Daohan Su , Yang Zhang , Xunkai Li , Rong-Hua Li , Guoren Wang

Existing graph contrastive learning (GCL) techniques typically require two forward passes for a single instance to construct the contrastive loss, which is effective for capturing the low-frequency signals of node features. Such a dual-pass…

Machine Learning · Computer Science 2023-11-21 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang , Kenji Kawaguchi , Xiaokui Xiao

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

While Positive-Unlabeled (PU) learning is vital in many real-world scenarios, its application to graph data still remains under-explored. We unveil that a critical challenge for PU learning on graph lies on the edge heterophily, which…

Machine Learning · Computer Science 2024-06-04 Yuhao Wu , Jiangchao Yao , Bo Han , Lina Yao , Tongliang Liu

Unsupervised clustering on speakers is becoming increasingly important for its potential uses in semi-supervised learning. In reality, we are often presented with enormous amounts of unlabeled data from multi-party meetings and discussions.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Fuchuan Tong , Siqi Zheng , Min Zhang , Yafeng Chen , Hongbin Suo , Qingyang Hong , Lin Li

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

Machine Learning · Computer Science 2021-06-08 Ran Liu

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of…

Machine Learning · Computer Science 2023-12-21 Wenlong Ji , Zhun Deng , Ryumei Nakada , James Zou , Linjun Zhang

Graph Neural Networks (GNNs) are widely used in collaborative filtering to capture high-order user-item relationships. To address the data sparsity problem in recommendation systems, Graph Contrastive Learning (GCL) has emerged as a…

Information Retrieval · Computer Science 2025-07-11 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Wei Wang , Xiping Hu , Edith Ngai