English
Related papers

Related papers: Polynomial Contrastive Learning for Privacy-Preser…

200 papers

Unsupervised/self-supervised pre-training methods for graph representation learning have recently attracted increasing research interests, and they are shown to be able to generalize to various downstream applications. Yet, the adversarial…

Machine Learning · Computer Science 2021-05-31 Jiarong Xu , Yang Yang , Junru Chen , Chunping Wang , Xin Jiang , Jiangang Lu , Yizhou Sun

To develop effective and efficient graph similarity learning (GSL) models, a series of data-driven neural algorithms have been proposed in recent years. Although GSL models are frequently deployed in privacy-sensitive scenarios, the user…

Machine Learning · Computer Science 2022-10-24 Yupeng Hou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus…

Social and Information Networks · Computer Science 2021-08-12 Changshu Liu , Liangjian Wen , Zhao Kang , Guangchun Luo , Ling Tian

Self-supervised facial representation has recently attracted increasing attention due to its ability to perform face understanding without relying on large-scale annotated datasets heavily. However, analytically, current contrastive-based…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuanyuan Liu , Wenbin Wang , Yibing Zhan , Shaoze Feng , Kejun Liu , Zhe Chen

Prevailing methods for training Large Language Models (LLMs) as text encoders rely on contrastive losses that treat the model as a black box function, discarding its generative and reasoning capabilities in favor of static embeddings. We…

Computation and Language · Computer Science 2025-10-07 Jiashuo Sun , Shixuan Liu , Zhaochen Su , Xianrui Zhong , Pengcheng Jiang , Bowen Jin , Peiran Li , Weijia Shi , Jiawei Han

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising…

Machine Learning · Computer Science 2024-01-30 Wei Ju , Yiyang Gu , Zhengyang Mao , Ziyue Qiao , Yifang Qin , Xiao Luo , Hui Xiong , Ming Zhang

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Graph embedding has become a powerful tool for learning latent representations of nodes in a graph. Despite its superior performance in various graph-based machine learning tasks, serious privacy concerns arise when the graph data contains…

Cryptography and Security · Computer Science 2024-08-06 Zening Li , Rong-Hua Li , Meihao Liao , Fusheng Jin , Guoren Wang

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Semi-supervised learning (SSL) addresses the critical challenge of training accurate models when labeled data is scarce but unlabeled data is abundant. Graph-based SSL (GSSL) has emerged as a popular framework that captures data structure…

Machine Learning · Statistics 2026-02-10 Nadav Katz , Ariel Jaffe

Unsupervised graph representation learning has emerged as a powerful tool to address real-world problems and achieves huge success in the graph learning domain. Graph contrastive learning is one of the unsupervised graph representation…

Machine Learning · Computer Science 2022-03-08 Haoran Yang , Hongxu Chen , Shirui Pan , Lin Li , Philip S. Yu , Guandong Xu

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way…

Machine Learning · Computer Science 2021-05-10 Chenguang Wang , Ziwen Liu

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

Machine Learning · Computer Science 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

Graph self-supervised learning (SSL), including contrastive and generative approaches, offers great potential to address the fundamental challenge of label scarcity in real-world graph data. Among both sets of graph SSL techniques, the…

Machine Learning · Computer Science 2023-04-12 Zhenyu Hou , Yufei He , Yukuo Cen , Xiao Liu , Yuxiao Dong , Evgeny Kharlamov , Jie Tang

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

Machine Learning · Computer Science 2021-06-08 Ran Liu

Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of semantics in the…

Computation and Language · Computer Science 2024-11-28 Wei Ai , Jianbin Li , Ze Wang , Yingying Wei , Tao Meng , Yuntao Shou , Keqin Lib

Graph contrastive learning (GCL) has recently emerged as a promising approach for graph representation learning. Some existing methods adopt the 1-vs-K scheme to construct one positive and K negative samples for each graph, but it is…

Machine Learning · Computer Science 2023-09-06 Minjie Chen , Yao Cheng , Ye Wang , Xiang Li , Ming Gao

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Heterogeneous graphs (HGs) are composed of multiple types of nodes and edges, making it more effective in capturing the complex relational structures inherent in the real world. However, in real-world scenarios, labeled data is often…

Machine Learning · Computer Science 2025-08-20 Ruobing Jiang , Yacong Li , Haobing Liu , Yanwei Yu

Representing a graph as a vector is a challenging task; ideally, the representation should be easily computable and conducive to efficient comparisons among graphs, tailored to the particular data and analytical task at hand. Unfortunately,…

Social and Information Networks · Computer Science 2018-11-16 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Alex Bronstein , Emmanuel Müller