English
Related papers

Related papers: Generative and Contrastive Graph Representation Le…

200 papers

The effectiveness of contrastive learning methods has been widely recognized in the field of graph learning, especially in contexts where graph data often lack labels or are difficult to label. However, the application of these methods to…

Machine Learning · Computer Science 2026-01-16 Qiang Yu , Xinran Cheng , Shiqiang Xu , Chuanyi Liu

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised…

Machine Learning · Computer Science 2023-12-27 Jiangmeng Li , Yifan Jin , Hang Gao , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Graph contrastive learning (GCL) has recently emerged as a new concept which allows for capitalizing on the strengths of graph neural networks (GNNs) to learn rich representations in a wide variety of applications which involve abundant…

Machine Learning · Computer Science 2024-06-26 Yuzhou Chen , Jose Frias , Yulia R. Gel

While tokenized graph Transformers have demonstrated strong performance in node classification tasks, their reliance on a limited subset of nodes with high similarity scores for constructing token sequences overlooks valuable information…

Machine Learning · Computer Science 2025-02-18 Jinsong Chen , Hanpeng Liu , John E. Hopcroft , Kun He

Self-supervised graph representation learning (SSGRL) is a representation learning paradigm used to reduce or avoid manual labeling. An essential part of SSGRL is graph data augmentation. Existing methods usually rely on heuristics commonly…

Machine Learning · Computer Science 2024-12-25 Ahmed E. Samy , Zekarias T. Kefatoa , Sarunas Girdzijauskasa

Graph contrastive learning (GCL) aims to contrast positive-negative counterparts to learn the node embeddings, whereas graph data augmentation methods are employed to generate these positive-negative samples. The variation, quantity, and…

Machine Learning · Computer Science 2025-03-05 Adnan Ali , Jinlong Li , Huanhuan Chen , Ali Kashif Bashir

Research on Graph Structure Learning (GSL) provides key insights for graph-based clustering, yet current methods like Graph Neural Networks (GNNs), Graph Attention Networks (GATs), and contrastive learning often rely heavily on the original…

Machine Learning · Computer Science 2025-05-21 Jingyun Zhang , Hao Peng , Li Sun , Guanlin Wu , Chunyang Liu , Zhengtao Yu

Graph-based models and contrastive learning have emerged as prominent methods in Collaborative Filtering (CF). While many existing models in CF incorporate these methods in their design, there seems to be a limited depth of analysis…

Information Retrieval · Computer Science 2024-06-24 Yihong Wu , Le Zhang , Fengran Mo , Tianyu Zhu , Weizhi Ma , Jian-Yun Nie

Graph contrastive learning (GCL) has recently emerged as a promising approach for graph representation learning. Some existing methods adopt the 1-vs-K scheme to construct one positive and K negative samples for each graph, but it is…

Machine Learning · Computer Science 2023-09-06 Minjie Chen , Yao Cheng , Ye Wang , Xiang Li , Ming Gao

This paper introduces a cutting-edge method for enhancing recommender systems through the integration of generative self-supervised learning (SSL) with a Residual Graph Transformer. Our approach emphasizes the importance of superior data…

Information Retrieval · Computer Science 2025-04-16 Eya Mhedhbi , Youssef Mourchid , Alice Othmani

Graph Contrastive Learning (GCL) has shown strong promise for unsupervised graph representation learning, yet its effectiveness on heterophilic graphs, where connected nodes often belong to different classes, remains limited. Most existing…

Machine Learning · Computer Science 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Wee Peng Tay

Heterogeneous graphs (HGs) are composed of multiple types of nodes and edges, making it more effective in capturing the complex relational structures inherent in the real world. However, in real-world scenarios, labeled data is often…

Machine Learning · Computer Science 2025-08-20 Ruobing Jiang , Yacong Li , Haobing Liu , Yanwei Yu

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad

Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data. In this work, we investigate Contrastive Learning (CL), a key component…

Machine Learning · Computer Science 2021-09-01 Yanqiao Zhu , Yichen Xu , Hejie Cui , Carl Yang , Qiang Liu , Shu Wu

Graph representation learning methods generate numerical vector representations for the nodes in a network, thereby enabling their use in standard machine learning models. These methods aim to preserve relational information, such that…

Machine Learning · Computer Science 2021-11-10 Janet Layne , Edoardo Serra

Deep neural networks trained on Functional Connectivity (FC) networks extracted from functional Magnetic Resonance Imaging (fMRI) data have gained popularity due to the increasing availability of data and advances in model architectures,…

Machine Learning · Computer Science 2023-12-05 Jungwon Choi , Seongho Keum , EungGu Yun , Byung-Hoon Kim , Juho Lee

Contrastive learning on graphs aims at extracting distinguishable high-level representations of nodes. In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual…

Machine Learning · Computer Science 2023-07-27 Yixuan Ma , Xiaolin Zhang , Peng Zhang , Kun Zhan

This paper studies the problem of graph-level clustering, which is a novel yet challenging task. This problem is critical in a variety of real-world applications such as protein clustering and genome analysis in bioinformatics. Recent years…

Machine Learning · Computer Science 2023-03-09 Wei Ju , Yiyang Gu , Binqi Chen , Gongbo Sun , Yifang Qin , Xingyuming Liu , Xiao Luo , Ming Zhang

In this study, we focus on the graph representation learning (a.k.a. network embedding) in attributed graphs. Different from existing embedding methods that treat the incorporation of graph structure and semantic as the simple combination…

Social and Information Networks · Computer Science 2023-05-12 Meng Qin