中文
相关论文

相关论文: Rethinking Graph Masked Autoencoders through Align…

200 篇论文

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this…

信息检索 · 计算机科学 2024-10-01 Chengkai Liu , Jianling Wang , James Caverlee

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

机器学习 · 计算机科学 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

机器学习 · 计算机科学 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Masked AutoEncoder (MAE) has revolutionized the field of self-supervised learning with its simple yet effective masking and reconstruction strategies. However, despite achieving state-of-the-art performance across various downstream vision…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xiaoyu Yue , Lei Bai , Meng Wei , Jiangmiao Pang , Xihui Liu , Luping Zhou , Wanli Ouyang

Graph representation learning is a fundamental research theme and can be generalized to benefit multiple downstream tasks from the node and link levels to the higher graph level. In practice, it is desirable to develop task-agnostic general…

机器学习 · 计算机科学 2023-12-12 Hanxuan Yang , Qingchao Kong , Wenji Mao

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

机器学习 · 计算机科学 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Graph Contrastive Learning (GCL) is a widely adopted approach in self-supervised graph representation learning, applying contrastive objectives to produce effective representations. However, current GCL methods primarily focus on capturing…

机器学习 · 计算机科学 2025-07-11 Dongxiao He , Yongqi Huang , Jitao Zhao , Xiaobao Wang , Zhen Wang

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques…

机器学习 · 计算机科学 2024-03-22 Yulan Hu , Sheng Ouyang , Jingyu Liu , Ge Chen , Zhirui Yang , Junchen Wan , Fuzheng Zhang , Zhongyuan Wang , Yong Liu

Graph contrastive learning (GCL) shows great potential in unsupervised graph representation learning. Data augmentation plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. Many GCL methods with…

机器学习 · 计算机科学 2023-05-30 Xin Xiong , Furao Shen , Xiangyu Wang , Jian Zhao

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

机器学习 · 计算机科学 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

机器学习 · 计算机科学 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng

Graph contrastive learning has emerged as a powerful technique for learning graph representations that are robust and discriminative. However, traditional approaches often neglect the critical role of subgraph structures, particularly the…

机器学习 · 计算机科学 2025-03-14 Tianhao Peng , Xuhong Li , Haitao Yuan , Yuchen Li , Haoyi Xiong

Graph contrastive learning (GCL) has recently emerged as a new concept which allows for capitalizing on the strengths of graph neural networks (GNNs) to learn rich representations in a wide variety of applications which involve abundant…

机器学习 · 计算机科学 2024-06-26 Yuzhou Chen , Jose Frias , Yulia R. Gel

Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated…

机器学习 · 计算机科学 2024-02-19 Xinjian Zhao , Liang Zhang , Yang Liu , Ruocheng Guo , Xiangyu Zhao

Graph contrastive learning (GCL) is an effective paradigm for node representation learning in graphs. The key components hidden behind GCL are data augmentation and positive-negative pair selection. Typical data augmentations in GCL, such…

机器学习 · 计算机科学 2024-07-25 Jiaqiang Zhang , Songcan Chen

Trapped by the label scarcity in molecular property prediction and drug design, graph contrastive learning (GCL) came forward. Leading contrastive learning works show two kinds of view generators, that is, random or learnable data…

机器学习 · 计算机科学 2025-01-16 Xueyuan Chen , Shangzhe Li , Ruomei Liu , Bowen Shi , Jiaheng Liu , Junran Wu , Ke Xu

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

机器学习 · 计算机科学 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Recently, graph contrastive learning (GCL) has emerged as one of the optimal solutions for node-level and supervised tasks. However, for structure-related and unsupervised tasks such as graph clustering, current GCL algorithms face…

社会与信息网络 · 计算机科学 2025-09-25 Yuecheng Li , Lele Fu , Sheng Huang , Chuan Chen , Lei Yang , Zibin Zheng

Graph-structured data is integral to many applications, prompting the development of various graph representation methods. Graph autoencoders (GAEs), in particular, reconstruct graph structures from node embeddings. Current GAE models…

机器学习 · 计算机科学 2024-10-07 Shijin Duan , Ruyi Ding , Jiaxing He , Aidong Adam Ding , Yunsi Fei , Xiaolin Xu