English
Related papers

Related papers: Spectral Feature Augmentation for Graph Contrastiv…

200 papers

Graph contrastive learning (GCL) is the most representative and prevalent self-supervised learning approach for graph-structured data. Despite its remarkable success, existing GCL methods highly rely on an augmentation scheme to learn the…

Machine Learning · Computer Science 2022-06-07 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(GCL) techniques into…

Information Retrieval · Computer Science 2023-07-12 Yonghui Yang , Zhengwei Wu , Le Wu , Kun Zhang , Richang Hong , Zhiqiang Zhang , Jun Zhou , Meng Wang

Graph Contrastive Learning (GCL) aims to learn node representations by aligning positive pairs and separating negative ones. However, few of researchers have focused on the inner law behind specific augmentations used in graph-based…

Machine Learning · Computer Science 2024-12-25 Jingyu Liu , Huayi Tang , Yong Liu

Self-supervised contrastive learning (CL) has achieved state-of-the-art performance in representation learning by minimizing the distance between positive pairs while maximizing that of negative ones. Recently, it has been verified that the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jin-Young Kim , Soonwoo Kwon , Hyojun Go , Yunsung Lee , Seungtaek Choi , Hyun-Gyoon Kim

Graph Neural Networks have become the preferred tool to process graph data, with their efficacy being boosted through graph data augmentation techniques. Despite the evolution of augmentation methods, issues like graph property distortions…

Machine Learning · Computer Science 2025-01-30 Yutong Xia , Runpeng Yu , Yuxuan Liang , Xavier Bresson , Xinchao Wang , Roger Zimmermann

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

We introduce a randomized topological augmentor based on Schur complements for Graph Contrastive Learning (GCL). Given a graph laplacian matrix, the technique generates unbiased approximations of its Schur complements and treats the…

Machine Learning · Computer Science 2023-06-08 Vignesh Kothapalli

Graph augmentations are essential for graph contrastive learning. Most existing works use pre-defined random augmentations, which are usually unable to adapt to different input graphs and fail to consider the impact of different nodes and…

Machine Learning · Computer Science 2023-03-28 Yifu Chen , Qianqian Ren , Liu Yong

Graph augmentation has received great attention in recent years for graph contrastive learning (GCL) to learn well-generalized node/graph representations. However, mainstream GCL methods often favor randomly disrupting graphs for…

Machine Learning · Computer Science 2024-05-03 Shiyin Tan , Dongyuan Li , Renhe Jiang , Ying Zhang , Manabu Okumura

This paper focuses on learning representation on the whole graph level in an unsupervised manner. Learning graph-level representation plays an important role in a variety of real-world issues such as molecule property prediction, protein…

Machine Learning · Computer Science 2024-01-08 Ge Wang , Zelin Zang , Jiangbin Zheng , Jun Xia , Stan Z. Li

This paper targets at improving the generalizability of hypergraph neural networks in the low-label regime, through applying the contrastive learning approach from images/graphs (we refer to it as HyperGCL). We focus on the following…

Machine Learning · Computer Science 2022-10-11 Tianxin Wei , Yuning You , Tianlong Chen , Yang Shen , Jingrui He , Zhangyang Wang

Graph contrastive learning (GCL) has recently achieved substantial advancements. Existing GCL approaches compare two different ``views'' of the same graph in order to learn node/graph representations. The underlying assumption of these…

Machine Learning · Computer Science 2024-01-18 Gehang Zhang , Bowen Yu , Jiangxia Cao , Xinghua Zhang , Jiawei Sheng , Chuan Zhou , Tingwen Liu

Contrastive learning (CL) has recently been demonstrated critical in improving recommendation performance. The underlying principle of CL-based recommendation models is to ensure the consistency between representations derived from…

Information Retrieval · Computer Science 2023-06-21 Junliang Yu , Xin Xia , Tong Chen , Lizhen Cui , Nguyen Quoc Viet Hung , Hongzhi Yin

Recent works in self-supervised learning have advanced the state-of-the-art by relying on the contrastive learning paradigm, which learns representations by pushing positive pairs, or similar examples from the same class, closer together…

Machine Learning · Computer Science 2022-06-27 Jeff Z. HaoChen , Colin Wei , Adrien Gaidon , Tengyu Ma

Contrastive learning leverages data augmentation to develop feature representation without relying on large labeled datasets. However, despite its empirical success, the theoretical foundations of contrastive learning remain incomplete,…

Machine Learning · Computer Science 2025-07-08 Chenghui Li , A. Martina Neuman

Graph representation learning is fundamental for analyzing graph-structured data. Exploring invariant graph representations remains a challenge for most existing graph representation learning methods. In this paper, we propose a cross-view…

Machine Learning · Computer Science 2025-04-15 Jie Chen , Hua Mao , Wai Lok Woo , Chuanbin Liu , Xi Peng

Graph contrastive learning (GCL) aims to learn representations from unlabeled graph data in a self-supervised manner and has developed rapidly in recent years. However, edgelevel contrasts are not well explored by most existing GCL methods.…

Machine Learning · Computer Science 2024-12-17 Yujun Li , Hongyuan Zhang , Yuan Yuan

Graph-level anomaly detection (GLAD) has already gained significant importance and has become a popular field of study, attracting considerable attention across numerous downstream works. The core focus of this domain is to capture and…

Machine Learning · Computer Science 2024-07-17 Zitong Wang , Xuexiong Luo , Enfeng Song , Qiuqing Bai , Fu Lin

What matters for contrastive learning? We argue that contrastive learning heavily relies on informative features, or "hard" (positive or negative) features. Early works include more informative features by applying complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Hui Xiong