English
Related papers

Related papers: Does GCL Need a Large Number of Negative Samples? …

200 papers

The effectiveness of contrastive learning methods has been widely recognized in the field of graph learning, especially in contexts where graph data often lack labels or are difficult to label. However, the application of these methods to…

Machine Learning · Computer Science 2026-01-16 Qiang Yu , Xinran Cheng , Shiqiang Xu , Chuanyi Liu

Graph convolutional networks (GCNs) have recently received wide attentions, due to their successful applications in different graph tasks and different domains. Training GCNs for a large graph, however, is still a challenge. Original…

Machine Learning · Computer Science 2019-11-19 Difan Zou , Ziniu Hu , Yewen Wang , Song Jiang , Yizhou Sun , Quanquan Gu

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

Machine Learning · Computer Science 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

How to utilize the pseudo labels has always been a research hotspot in machine learning. However, most methods use pseudo labels as supervised training, and lack of valid assessing for their accuracy. Moreover, applications of pseudo labels…

Machine Learning · Computer Science 2023-10-03 Xinjie Shen , Danyang Wu , Jitao Lu , Junjie Liang , Jin Xu , Feiping Nie

Graphs are powerful representations for relations among objects, which have attracted plenty of attention. A fundamental challenge for graph learning is how to train an effective Graph Neural Network (GNN) encoder without labels, which are…

Machine Learning · Computer Science 2022-10-19 Baoyu Jing , Shengyu Feng , Yuejia Xiang , Xi Chen , Yu Chen , Hanghang Tong

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Contrastive learning (CL) has recently been demonstrated critical in improving recommendation performance. The underlying principle of CL-based recommendation models is to ensure the consistency between representations derived from…

Information Retrieval · Computer Science 2023-06-21 Junliang Yu , Xin Xia , Tong Chen , Lizhen Cui , Nguyen Quoc Viet Hung , Hongzhi Yin

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-supervised signals from…

Information Retrieval · Computer Science 2025-04-15 Yu Zhang , Yiwen Zhang , Yi Zhang , Lei Sang , Yun Yang

Graph Neural Networks (GNNs) have achieved state-of-the-art results for semi-supervised node classification on graphs. Nevertheless, the challenge of how to effectively learn GNNs with very few labels is still under-explored. As one of the…

Machine Learning · Computer Science 2022-01-21 Yayong Li , Jie Yin , Ling Chen

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

Machine Learning · Computer Science 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by…

Machine Learning · Computer Science 2022-12-14 Peiyao Zhao , Yuangang Pan , Xin Li , Xu Chen , Ivor W. Tsang , Lejian Liao

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Graph Contrastive Learning (GCL) is a powerful self-supervised learning framework that performs data augmentation through graph perturbations, with growing applications in the analysis of biological networks such as Gene Regulatory Networks…

Machine Learning · Computer Science 2026-02-20 Sho Oshima , Yuji Okamoto , Taisei Tosaki , Ryosuke Kojima

Various graph contrastive learning models have been proposed to improve the performance of learning tasks on graph datasets in recent years. While effective and prevalent, these models are usually carefully customized. In particular,…

Machine Learning · Computer Science 2021-11-01 Dongkuan Xu , Wei Cheng , Dongsheng Luo , Haifeng Chen , Xiang Zhang

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

The pretasks are mainly built on mutual information estimation, which requires data augmentation to construct positive samples with similar semantics to learn invariant signals and negative samples with dissimilar semantics in order to…

Machine Learning · Computer Science 2023-03-07 Haifeng Li , Jun Cao , Jiawei Zhu , Qinyao Luo , Silu He , Xuyin Wang

Leveraging the diversity and quantity of data provided by various graph-structured data augmentations while preserving intrinsic semantic information is challenging. Additionally, successive layers in graph neural network (GNN) tend to…

Machine Learning · Computer Science 2026-03-19 Jie Chen , Hua Mao , Chuanbin Liu , Zhu Wang , Xi Peng

Graph convolutional networks (GCNs) have achieved great success in graph representation learning by extracting high-level features from nodes and their topology. Since GCNs generally follow a message-passing mechanism, each node aggregates…

Machine Learning · Computer Science 2023-09-07 Wei Duan , Junyu Xuan , Maoying Qiao , Jie Lu