English
Related papers

Related papers: SGCL: Unifying Self-Supervised and Supervised Lear…

200 papers

Graph representation learning (GRL) makes considerable progress recently, which encodes graphs with topological structures into low-dimensional embeddings. Meanwhile, the time-consuming and costly process of annotating graph labels manually…

Machine Learning · Computer Science 2024-02-28 Haojun Jiang , Jiawei Sun , Jie Li , Chentao Wu

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Graph-based models and contrastive learning have emerged as prominent methods in Collaborative Filtering (CF). While many existing models in CF incorporate these methods in their design, there seems to be a limited depth of analysis…

Information Retrieval · Computer Science 2024-06-24 Yihong Wu , Le Zhang , Fengran Mo , Tianyu Zhu , Weizhi Ma , Jian-Yun Nie

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

Machine Learning · Computer Science 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Self-supervised graph representation learning (SSGRL) is a representation learning paradigm used to reduce or avoid manual labeling. An essential part of SSGRL is graph data augmentation. Existing methods usually rely on heuristics commonly…

Machine Learning · Computer Science 2024-12-25 Ahmed E. Samy , Zekarias T. Kefatoa , Sarunas Girdzijauskasa

Graph contrastive learning has emerged as a powerful technique for learning graph representations that are robust and discriminative. However, traditional approaches often neglect the critical role of subgraph structures, particularly the…

Machine Learning · Computer Science 2025-03-14 Tianhao Peng , Xuhong Li , Haitao Yuan , Yuchen Li , Haoyi Xiong

Self-supervision is recently surging at its new frontier of graph learning. It facilitates graph representations beneficial to downstream tasks; but its success could hinge on domain knowledge for handcraft or the often expensive trials and…

Machine Learning · Computer Science 2022-01-06 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Graph contrastive learning (GCL) has been extensively studied and leveraged as a potent tool in recommender systems. Most existing GCL-based recommenders generate contrastive views by altering the graph structure or introducing…

Information Retrieval · Computer Science 2024-09-12 Lijun Zhang , Yuan Yao , Haibo Ye

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

In computational pathology, we often face a scarcity of annotations and a large amount of unlabeled data. One method for dealing with this is semi-supervised learning which is commonly split into a self-supervised pretext task and a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Manuel Tran , Sophia J. Wagner , Melanie Boxberg , Tingying Peng

Graph Contrastive Learning (GCL) has shown strong promise for unsupervised graph representation learning, yet its effectiveness on heterophilic graphs, where connected nodes often belong to different classes, remains limited. Most existing…

Machine Learning · Computer Science 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Wee Peng Tay

We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or…

Machine Learning · Computer Science 2020-06-11 Kaveh Hassani , Amir Hosein Khasahmadi

Graph neural network(GNN) has been a powerful approach in collaborative filtering(CF) due to its ability to model high-order user-item relationships. Recently, to alleviate the data sparsity and enhance representation learning, many efforts…

Information Retrieval · Computer Science 2024-12-10 Bowen Zheng , Junjie Zhang , Hongyu Lu , Yu Chen , Ming Chen , Wayne Xin Zhao , Ji-Rong Wen

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Recent advances in unsupervised deep graph clustering have been significantly promoted by contrastive learning. Despite the strides, most graph contrastive learning models face challenges: 1) graph augmentation is used to improve learning…

Machine Learning · Computer Science 2024-08-23 Chusheng Zeng , Bocheng Wang , Jinghui Yuan , Rong Wang , Mulin Chen

Graph Neural Networks (GNNs) are sensitive to structural noise from adversarial attacks or imperfections. Existing graph contrastive learning (GCL) methods typically rely on either random perturbations (e.g., edge dropping) for diversity or…

Machine Learning · Computer Science 2026-02-04 Hao Deng , Zhang Guo , Shuiping Gou , Bo Liu

Graph similarity learning refers to calculating the similarity score between two graphs, which is required in many realistic applications, such as visual tracking, graph classification, and collaborative filtering. As most of the existing…

Machine Learning · Computer Science 2022-07-13 Di Jin , Luzhi Wang , Yizhen Zheng , Xiang Li , Fei Jiang , Wei Lin , Shirui Pan

Graph contrastive learning (GCL) learns node and graph representations by contrasting multiple views of the same graph. Existing methods typically rely on fixed, handcrafted views-usually a local and a global perspective, which limits their…

Machine Learning · Computer Science 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Keyue Jiang , Kai Zhao , Wee Peng Tay

The burgeoning presence of multimodal content-sharing platforms propels the development of personalized recommender systems. Previous works usually suffer from data sparsity and cold-start problems, and may fail to adequately explore…

Information Retrieval · Computer Science 2025-04-24 Xu Guo , Tong Zhang , Fuyun Wang , Xudong Wang , Xiaoya Zhang , Xin Liu , Zhen Cui