English
Related papers

Related papers: MA-GCL: Model Augmentation Tricks for Graph Contra…

200 papers

Graph anomaly detection (GAD) is a vital task in graph-based machine learning and has been widely applied in many real-world applications. The primary goal of GAD is to capture anomalous nodes from graph datasets, which evidently deviate…

Machine Learning · Computer Science 2022-12-05 Jingcan Duan , Siwei Wang , Pei Zhang , En Zhu , Jingtao Hu , Hu Jin , Yue Liu , Zhibin Dong

Despite their consistent performance improvements, cross-modal retrieval models (e.g., CLIP) show degraded performances with retrieving keys composed of fused image-text modality (e.g., Wikipedia pages with both images and text). To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jungsoo Lee , Janghoon Cho , Hyojin Park , Munawar Hayat , Kyuwoong Hwang , Fatih Porikli , Sungha Choi

Graph Contrastive Learning (GCL), which fuses graph neural networks with contrastive learning, has evolved as a pivotal tool in user-item recommendations. While promising, existing GCL methods often lack explicit modeling of hierarchical…

Information Retrieval · Computer Science 2025-05-27 Jiawei Xue , Zhen Yang , Haitao Lin , Ziji Zhang , Luzhu Wang , Yikun Gu , Yao Xu , Xin Li

Graph Neural Networks (GNNs) have achieved remarkable success in learning node representations and have shown strong performance in tasks such as node classification. However, recent findings indicate that the presence of noise in…

Machine Learning · Computer Science 2025-07-01 Yancheng Wang , Yingzhen Yang

Graph Contrastive Learning (GCL) has emerged as a popular training approach for learning node embeddings from augmented graphs without labels. Despite the key principle that maximizing the similarity between positive node pairs while…

Machine Learning · Computer Science 2024-05-27 Yue Yu , Xiao Wang , Mengmei Zhang , Nian Liu , Chuan Shi

In this paper, we study the problem of unsupervised graph representation learning by harnessing the control properties of dynamical networks defined on graphs. Our approach introduces a novel framework for contrastive learning, a widely…

Machine Learning · Computer Science 2024-04-19 Obaid Ullah Ahmad , Anwar Said , Mudassir Shabbir , Waseem Abbas , Xenofon Koutsoukos

This study introduces the Multi-Scale Weight-Based Pairwise Coarsening and Contrastive Learning (MPCCL) model, a novel approach for attributed graph clustering that effectively bridges critical gaps in existing methods, including long-range…

Machine Learning · Computer Science 2025-07-29 Binxiong Li , Yuefei Wang , Binyu Zhao , Heyang Gao , Benhan Yang , Quanzhou Luo , Xue Li , Xu Xiang , Yujie Liu , Huijie Tang

Combining Graph neural networks (GNNs) with contrastive learning for anomaly detection has drawn rising attention recently. Existing graph contrastive anomaly detection (GCAD) methods have primarily focused on improving detection capability…

Machine Learning · Computer Science 2023-05-05 Zhiyuan Liu , Chunjie Cao , Fangjian Tao , Jingzhang Sun

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang

Existing graph contrastive learning (GCL) techniques typically require two forward passes for a single instance to construct the contrastive loss, which is effective for capturing the low-frequency signals of node features. Such a dual-pass…

Machine Learning · Computer Science 2023-11-21 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang , Kenji Kawaguchi , Xiaokui Xiao

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Advancements in technologies related to working with omics data require novel computation methods to fully leverage information and help develop a better understanding of human diseases. This paper studies the effects of introducing graph…

Genomics · Quantitative Biology 2023-10-17 Nishant Rajadhyaksha , Aarushi Chitkara

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

Contrastive vision-language models, such as CLIP, have garnered considerable attention for various downstream tasks, mainly due to the remarkable ability of the learned features for generalization. However, the features they learned often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Yichao Cai , Yuhang Liu , Zhen Zhang , Javen Qinfeng Shi

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising…

Machine Learning · Computer Science 2024-01-30 Wei Ju , Yiyang Gu , Zhengyang Mao , Ziyue Qiao , Yifang Qin , Xiao Luo , Hui Xiong , Ming Zhang

The effectiveness of contrastive learning methods has been widely recognized in the field of graph learning, especially in contexts where graph data often lack labels or are difficult to label. However, the application of these methods to…

Machine Learning · Computer Science 2026-01-16 Qiang Yu , Xinran Cheng , Shiqiang Xu , Chuanyi Liu

Benefiting from the effectiveness of graph neural networks (GNNs) and contrastive learning, GNN-based contrastive learning has become mainstream for knowledge-aware recommendation. However, most existing contrastive learning-based methods…

Information Retrieval · Computer Science 2025-05-14 Shengyin Sun , Chen Ma

We introduce EfficientCL, a memory-efficient continual pretraining method that applies contrastive learning with novel data augmentation and curriculum learning. For data augmentation, we stack two types of operation sequentially: cutoff…

Computation and Language · Computer Science 2021-10-19 Seonghyeon Ye , Jiseon Kim , Alice Oh

Knowledge Graphs (KGs) have been utilized as useful side information to improve recommendation quality. In those recommender systems, knowledge graph information often contains fruitful facts and inherent semantic relatedness among items.…

Information Retrieval · Computer Science 2022-08-19 Yuhao Yang , Chao Huang , Lianghao Xia , Chenliang Li