English
Related papers

Related papers: Learning Robust Heterogeneous Graph Representation…

200 papers

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It…

Machine Learning · Computer Science 2024-12-20 Yiming Xu , Bin Shi , Teng Ma , Bo Dong , Haoyi Zhou , Qinghua Zheng

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

Machine Learning · Computer Science 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Wenbin Li , Meihao Kong , Xuesong Yang , Lei Wang , Jing Huo , Yang Gao , Jiebo Luo

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(GCL) techniques into…

Information Retrieval · Computer Science 2023-07-12 Yonghui Yang , Zhengwei Wu , Le Wu , Kun Zhang , Richang Hong , Zhiqiang Zhang , Jun Zhou , Meng Wang

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Swati Jindal , Roberto Manduchi

Sequential recommendation addresses the issue of preference drift by predicting the next item based on the user's previous behaviors. Recently, a promising approach using contrastive learning has emerged, demonstrating its effectiveness in…

Information Retrieval · Computer Science 2023-08-08 Dongjun Lee , Donggeun Ko , Jaekwang Kim

Graph-level representations are critical in various real-world applications, such as predicting the properties of molecules. But in practice, precise graph annotations are generally very expensive and time-consuming. To address this issue,…

Machine Learning · Computer Science 2022-07-26 Shuai Lin , Pan Zhou , Zi-Yuan Hu , Shuojia Wang , Ruihui Zhao , Yefeng Zheng , Liang Lin , Eric Xing , Xiaodan Liang

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

Computation and Language · Computer Science 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

Heterogeneous graphs are pervasive in practical scenarios, where each graph consists of multiple types of nodes and edges. Representation learning on heterogeneous graphs aims to obtain low-dimensional node representations that could…

Machine Learning · Computer Science 2021-01-01 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv , Hui Xiong

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness in various graph representation learning tasks. However, most existing GNNs focus primarily on capturing local information through explicit graph convolution, often…

Machine Learning · Computer Science 2025-01-31 Jinlu Wang , Yanfeng Sun , Jiapu Wang , Junbin Gao , Shaofan Wang , Jipeng Guo

The lack of labeled data is a major obstacle to learning high-quality sentence embeddings. Recently, self-supervised contrastive learning (SCL) is regarded as a promising way to address this problem. However, the existing works mainly rely…

Computation and Language · Computer Science 2022-03-01 Junhan Yang , Zheng Liu , Shitao Xiao , Jianxun Lian , Lijun Wu , Defu Lian , Guangzhong Sun , Xing Xie

Multimodal representation learning is commonly built on a shared-private decomposition, treating latent information as either common to all modalities or specific to one. This binary view is often inadequate: many factors are shared by only…

Machine Learning · Statistics 2026-04-08 Huichao Li , Junhan Yu , Doudou Zhou

Contrastive learning (CL) aims to preserve relational structure between samples by learning representations that reflect a similarity graph. Yet, the geometry of the resulting embeddings remains poorly understood. Here we show that weighted…

Machine Learning · Computer Science 2026-05-15 Raphael Vock , Edouard Duchesnay , Benoit Dufumier

The effectiveness of contrastive learning methods has been widely recognized in the field of graph learning, especially in contexts where graph data often lack labels or are difficult to label. However, the application of these methods to…

Machine Learning · Computer Science 2026-01-16 Qiang Yu , Xinran Cheng , Shiqiang Xu , Chuanyi Liu

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

Machine Learning · Computer Science 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Graph contrastive learning (GCL) alleviates the heavy reliance on label information for graph representation learning (GRL) via self-supervised learning schemes. The core idea is to learn by maximising mutual information for similar…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Shirui Pan , Vincent Cs Lee , Yu Zheng , Philip S. Yu

Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Ganning Zhao , Tingwei Shen , Suya You , C. -C. Jay Kuo

Graph contrastive learning (GCL) has emerged as an effective tool for learning unsupervised representations of graphs. The key idea is to maximize the agreement between two augmented views of each graph via data augmentation. Existing GCL…

Machine Learning · Computer Science 2022-09-16 Xin Zhang , Qiaoyu Tan , Xiao Huang , Bo Li