中文
相关论文

相关论文: Generative and Contrastive Paradigms Are Complemen…

200 篇论文

Graph Neural Networks (GNNs) have achieved great success in learning graph representations and thus facilitating various graph-related tasks. However, most GNN methods adopt a supervised learning setting, which is not always feasible in…

机器学习 · 计算机科学 2022-08-16 Hongliang Chi , Yao Ma

Generative self-supervised learning (SSL), especially masked autoencoders, has become one of the most exciting learning paradigms and has shown great potential in handling graph data. However, real-world graphs are always heterogeneous,…

机器学习 · 计算机科学 2023-02-13 Yijun Tian , Kaiwen Dong , Chunhui Zhang , Chuxu Zhang , Nitesh V. Chawla

Generative self-supervised learning on graphs, particularly graph masked autoencoders, has emerged as a popular learning paradigm and demonstrated its efficacy in handling non-Euclidean data. However, several remaining issues limit the…

机器学习 · 计算机科学 2024-02-14 Yijun Tian , Chuxu Zhang , Ziyi Kou , Zheyuan Liu , Xiangliang Zhang , Nitesh V. Chawla

Self-supervised learning (SSL) on graphs generates node and graph representations (i.e., embeddings) that can be used for downstream tasks such as node classification, node clustering, and link prediction. Graph SSL is particularly useful…

机器学习 · 计算机科学 2025-09-26 Jiali Chen , Avijit Mukherjee

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

机器学习 · 计算机科学 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

机器学习 · 计算机科学 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Graph contrastive learning is usually performed by first conducting Graph Data Augmentation (GDA) and then employing a contrastive learning pipeline to train GNNs. As we know that GDA is an important issue for graph contrastive learning.…

机器学习 · 计算机科学 2024-01-09 Ziyan Zhang , Bo Jiang , Jin Tang , Bin Luo

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

机器学习 · 计算机科学 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

Graph Neural Networks (GNNs) have demonstrated promising results on exploiting node representations for many downstream tasks through supervised end-to-end training. To deal with the widespread label scarcity issue in real-world…

机器学习 · 计算机科学 2023-08-02 Cheng Wu , Chaokun Wang , Jingcao Xu , Ziyang Liu , Kai Zheng , Xiaowei Wang , Yang Song , Kun Gai

The last years have witnessed the emergence of a promising self-supervised learning strategy, referred to as masked autoencoding. However, there is a lack of theoretical understanding of how masking matters on graph autoencoders (GAEs). In…

机器学习 · 计算机科学 2023-05-30 Jintang Li , Ruofan Wu , Wangbin Sun , Liang Chen , Sheng Tian , Liang Zhu , Changhua Meng , Zibin Zheng , Weiqiang Wang

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation…

信息检索 · 计算机科学 2023-06-02 Yaowen Ye , Lianghao Xia , Chao Huang

Self-supervised learning with masked autoencoders has recently gained popularity for its ability to produce effective image or textual representations, which can be applied to various downstream tasks without retraining. However, we observe…

机器学习 · 计算机科学 2023-08-21 Yucheng Shi , Yushun Dong , Qiaoyu Tan , Jundong Li , Ninghao Liu

Graph contrastive learning (GCL) aligns node representations by classifying node pairs into positives and negatives using a selection process that typically relies on establishing correspondences within two augmented graphs. The…

机器学习 · 计算机科学 2024-11-27 Maysam Behmanesh , Maks Ovsjanikov

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

机器学习 · 计算机科学 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Graph contrastive learning (GCL) aims to learn representations from unlabeled graph data in a self-supervised manner and has developed rapidly in recent years. However, edgelevel contrasts are not well explored by most existing GCL methods.…

机器学习 · 计算机科学 2024-12-17 Yujun Li , Hongyuan Zhang , Yuan Yuan

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(GCL) techniques into…

信息检索 · 计算机科学 2023-07-12 Yonghui Yang , Zhengwei Wu , Le Wu , Kun Zhang , Richang Hong , Zhiqiang Zhang , Jun Zhou , Meng Wang

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

机器学习 · 计算机科学 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Recent years have seen a rapid growth of utilizing graph neural networks (GNNs) in the biomedical domain for tackling drug-related problems. However, like any other deep architectures, GNNs are data hungry. While requiring labels in real…

生物物理 · 物理学 2022-05-03 Mengying Sun , Jing Xing , Huijun Wang , Bin Chen , Jiayu Zhou

Graphs are ubiquitous in real-world scenarios and encompass a diverse range of tasks, from node-, edge-, and graph-level tasks to transfer learning. However, designing specific tasks for each type of graph data is often costly and lacks…

机器学习 · 计算机科学 2024-03-22 Yulan Hu , Sheng Ouyang , Zhirui Yang , Ge Chen , Junchen Wan , Xiao Wang , Yong Liu

Inspired by the success of contrastive learning (CL) in computer vision and natural language processing, graph contrastive learning (GCL) has been developed to learn discriminative node representations on graph datasets. However, the…

机器学习 · 计算机科学 2023-01-03 Zehong Wang , Qi Li , Donghua Yu , Xiaolong Han , Xiao-Zhi Gao , Shigen Shen