English
Related papers

Related papers: Diffusion-augmented Graph Contrastive Learning for…

200 papers

Graph contrastive learning (GCL) has become a powerful tool for learning graph data, but its scalability remains a significant challenge. In this work, we propose a simple yet effective training framework called Structural Compression…

Machine Learning · Computer Science 2024-05-10 Shengzhong Zhang , Wenjie Yang , Xinyuan Cao , Hongwei Zhang , Zengfeng Huang

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature. These methods contrast semantically similar and…

Machine Learning · Computer Science 2022-06-03 Ganqu Cui , Yufeng Du , Cheng Yang , Jie Zhou , Liang Xu , Xing Zhou , Xingyi Cheng , Zhiyuan Liu

We introduce a randomized topological augmentor based on Schur complements for Graph Contrastive Learning (GCL). Given a graph laplacian matrix, the technique generates unbiased approximations of its Schur complements and treats the…

Machine Learning · Computer Science 2023-06-08 Vignesh Kothapalli

Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the similarity-based…

Machine Learning · Computer Science 2023-03-09 Zehua Zhang , Shilin Sun , Guixiang Ma , Caiming Zhong

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

Machine Learning · Computer Science 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

Graph clustering is a crucial task in network analysis with widespread applications, focusing on partitioning nodes into distinct groups with stronger intra-group connections than inter-group ones. Recently, contrastive learning has…

Machine Learning · Computer Science 2024-08-20 Xunlian Wu , Jingqi Hu , Anqi Zhang , Yining Quan , Qiguang Miao , Peng Gang Sun

Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily assumptions. Thus,…

Machine Learning · Computer Science 2024-02-27 Teng Xiao , Huaisheng Zhu , Zhengyu Chen , Suhang Wang

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the "augmenting-contrasting" learning scheme. However, we observe that unlike CL in computer vision domain,…

Machine Learning · Computer Science 2023-06-19 Wen-Zhi Li , Chang-Dong Wang , Hui Xiong , Jian-Huang Lai

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

Information Retrieval · Computer Science 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

Session-based recommendations aim to predict the next behavior of users based on ongoing sessions. The previous works have been modeling the session as a variable-length of a sequence of items and learning the representation of both…

Information Retrieval · Computer Science 2022-09-26 Eunkyu Oh , Taehun Kim , Minsoo Kim , Yunhu Ji , Sushil Khyalia

User review data is helpful in alleviating the data sparsity problem in many recommender systems. In review-based recommendation methods, review data is considered as auxiliary information that can improve the quality of learned user/item…

Information Retrieval · Computer Science 2022-09-07 Yuyang Ren , Haonan Zhang , Qi Li , Luoyi Fu , Jiaxin Ding , Xinde Cao , Xinbing Wang , Chenghu Zhou

Deep clustering as an important branch of unsupervised representation learning focuses on embedding semantically similar samples into the identical feature space. This core demand inspires the exploration of contrastive learning and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haifeng Xia , Hai Huang , Zhengming Ding

Graph Contrastive Learning (GCL) has shown promising performance in graph representation learning (GRL) without the supervision of manual annotations. GCL can generate graph-level embeddings by maximizing the Mutual Information (MI) between…

Machine Learning · Computer Science 2022-05-25 Jiawei Sun , Ruoxin Chen , Jie Li , Chentao Wu , Yue Ding , Junchi Yan

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

Machine Learning · Computer Science 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Recent advances in unsupervised deep graph clustering have been significantly promoted by contrastive learning. Despite the strides, most graph contrastive learning models face challenges: 1) graph augmentation is used to improve learning…

Machine Learning · Computer Science 2024-08-23 Chusheng Zeng , Bocheng Wang , Jinghui Yuan , Rong Wang , Mulin Chen

Graph contrastive learning (GCL) has garnered significant attention recently since it learns complex structural information from graphs through self-supervised learning manner. However, prevalent GCL models may suffer from performance…

Machine Learning · Computer Science 2025-04-28 Xiaofan Wei , Binyan Zhang

Both generative learning and discriminative learning have recently witnessed remarkable progress using Deep Neural Networks (DNNs). For structured input synthesis and structured output prediction problems (e.g., layout-to-image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Wei Sun , Tianfu Wu