English
Related papers

Related papers: Uncovering Capabilities of Model Pruning in Graph …

200 papers

Graph contrastive learning (GCL) is an effective paradigm for node representation learning in graphs. The key components hidden behind GCL are data augmentation and positive-negative pair selection. Typical data augmentations in GCL, such…

Machine Learning · Computer Science 2024-07-25 Jiaqiang Zhang , Songcan Chen

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

Machine Learning · Computer Science 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

We propose $\textbf{MGCL}$, a model-driven graph contrastive learning (GCL) framework that leverages graphons (probabilistic generative models for graphs) to guide contrastive learning by accounting for the data's underlying generative…

Machine Learning · Computer Science 2025-06-09 Ali Azizpour , Nicolas Zilberstein , Santiago Segarra

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

Self-supervised contrastive learning heavily relies on the view variance brought by data augmentation, so that it can learn a view-invariant pre-trained representation. Beyond increasing the view variance for contrast, this work focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yong Zhang , Rui Zhu , Shifeng Zhang , Xu Zhou , Shifeng Chen , Xiaofan Chen

Graph-based models and contrastive learning have emerged as prominent methods in Collaborative Filtering (CF). While many existing models in CF incorporate these methods in their design, there seems to be a limited depth of analysis…

Information Retrieval · Computer Science 2024-06-24 Yihong Wu , Le Zhang , Fengran Mo , Tianyu Zhu , Weizhi Ma , Jian-Yun Nie

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

Machine Learning · Computer Science 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng

Unsupervised graph representation learning has emerged as a powerful tool to address real-world problems and achieves huge success in the graph learning domain. Graph contrastive learning is one of the unsupervised graph representation…

Machine Learning · Computer Science 2022-03-08 Haoran Yang , Hongxu Chen , Shirui Pan , Lin Li , Philip S. Yu , Guandong Xu

Graph-level representations are critical in various real-world applications, such as predicting the properties of molecules. But in practice, precise graph annotations are generally very expensive and time-consuming. To address this issue,…

Machine Learning · Computer Science 2022-07-26 Shuai Lin , Pan Zhou , Zi-Yuan Hu , Shuojia Wang , Ruihui Zhao , Yefeng Zheng , Liang Lin , Eric Xing , Xiaodan Liang

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Graph Contrastive Learning (GCL) establishes a new paradigm for learning graph representations without human annotations. Although remarkable progress has been witnessed recently, the success behind GCL is still left somewhat mysterious. In…

Machine Learning · Computer Science 2021-10-27 Yanqiao Zhu , Yichen Xu , Qiang Liu , Shu Wu

Graph Contrastive Learning (GCL) has recently made progress as an unsupervised graph representation learning paradigm. GCL approaches can be categorized into augmentation-based and augmentation-free methods. The former relies on complex…

Machine Learning · Computer Science 2025-04-25 Yanan Zhao , Feng Ji , Kai Zhao , Xuhao Li , Qiyu Kang , Wenfei Liang , Yahya Alkhatib , Xingchao Jian , Wee Peng Tay

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

Graph contrastive learning (GCL) improves graph representation learning, leading to SOTA on various downstream tasks. The graph augmentation step is a vital but scarcely studied step of GCL. In this paper, we show that the node embedding…

Machine Learning · Computer Science 2022-06-14 Yifei Zhang , Hao Zhu , Zixing Song , Piotr Koniusz , Irwin King

Graph-based anomaly detection has been widely used for detecting malicious activities in real-world applications. Existing attempts to address this problem have thus far focused on structural feature engineering or learning in the binary…

Machine Learning · Computer Science 2022-08-31 Bo Chen , Jing Zhang , Xiaokang Zhang , Yuxiao Dong , Jian Song , Peng Zhang , Kaibo Xu , Evgeny Kharlamov , Jie Tang

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

Machine Learning · Computer Science 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Graph contrastive learning (GCL), learning the node representation by contrasting two augmented graphs in a self-supervised way, has attracted considerable attention. GCL is usually believed to learn the invariant representation. However,…

Machine Learning · Computer Science 2024-03-08 Yanhu Mo , Xiao Wang , Shaohua Fan , Chuan Shi