English
Related papers

Related papers: Prototypical Contrastive Learning through Alignmen…

200 papers

Graph Neural Networks (GNNs) have demonstrated promising results on exploiting node representations for many downstream tasks through supervised end-to-end training. To deal with the widespread label scarcity issue in real-world…

Machine Learning · Computer Science 2023-08-02 Cheng Wu , Chaokun Wang , Jingcao Xu , Ziyang Liu , Kai Zheng , Xiaowei Wang , Yang Song , Kun Gai

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Generalized category discovery (GCD) is a pragmatic but underexplored problem, which requires models to automatically cluster and discover novel categories by leveraging the labeled samples from old classes. The challenge is that unlabeled…

Machine Learning · Computer Science 2025-04-08 Shijie Ma , Fei Zhu , Xu-Yao Zhang , Cheng-Lin Liu

Question and answer (Q&A) platforms usually recommend question-answer pairs to meet users' knowledge acquisition needs, unlike traditional recommendations that recommend only one item. This makes user behaviors more complex, and presents…

Information Retrieval · Computer Science 2024-06-10 Changshuo Zhang , Teng Shi , Xiao Zhang , Yanping Zheng , Ruobing Xie , Qi Liu , Jun Xu , Ji-Rong Wen

In recent years, methods that combine contrastive learning with graph neural networks have emerged to address the challenges of recommendation systems, demonstrating powerful performance and playing a significant role in this domain.…

Information Retrieval · Computer Science 2025-09-08 Hao Chen , Wenming Ma , Zihao Chu , Mingqi Li

Knowledge Graphs (KGs) have been utilized as useful side information to improve recommendation quality. In those recommender systems, knowledge graph information often contains fruitful facts and inherent semantic relatedness among items.…

Information Retrieval · Computer Science 2022-08-19 Yuhao Yang , Chao Huang , Lianghao Xia , Chenliang Li

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

User-item interactions in recommendations can be naturally de-noted as a user-item bipartite graph. Given the success of graph neural networks (GNNs) in graph representation learning, GNN-based C methods have been proposed to advance…

Information Retrieval · Computer Science 2022-01-06 Yiqi Wang , Chaozhuo Li , Mingzheng Li , Wei Jin , Yuming Liu , Hao Sun , Xing Xie , Jiliang Tang

Graph-level representations (and clustering/classification based on these representations) are required in a variety of applications. Examples include identifying malicious network traffic, prediction of protein properties, and many others.…

Machine Learning · Computer Science 2024-11-20 Xiang Li , Gagan Agrawal , Rajiv Ramnath , Ruoming Jin

Graph contrastive learning (GCL) is the most representative and prevalent self-supervised learning approach for graph-structured data. Despite its remarkable success, existing GCL methods highly rely on an augmentation scheme to learn the…

Machine Learning · Computer Science 2022-06-07 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang

Although the self-supervised pre-training of transformer models has resulted in the revolutionizing of natural language processing (NLP) applications and the achievement of state-of-the-art results with regard to various benchmarks, this…

Computation and Language · Computer Science 2023-01-26 Xiang Chen , Xin Xie , Zhen Bi , Hongbin Ye , Shumin Deng , Ningyu Zhang , Huajun Chen

Tremendous breakthroughs have been developed in Semi-Supervised Semantic Segmentation (S4) through contrastive learning. However, due to limited annotations, the guidance on unlabeled images is generated by the model itself, which…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Haoyu Xie , Changqi Wang , Jian Zhao , Yang Liu , Jun Dan , Chong Fu , Baigui Sun

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

Graph Contrastive Learning (GCL) relies on semantically consistent graph augmentations, but common local perturbations provide limited control over global structural consistency, motivating a more principled global augmentation strategy. We…

Machine Learning · Computer Science 2026-05-13 Nero Z. Li , Xuehao Zhai , Zhichao Shi , Boshen Shi , Xuhui Jiang

Attributed graph clustering holds significant importance in modern data analysis. However, due to the complexity of graph data and the heterogeneity of node attributes, leveraging graph information for clustering remains challenging. To…

Machine Learning · Computer Science 2025-08-01 Binxiong Li , Xu Xiang , Xue Li , Quanzhou Lou , Binyu Zhao , Yujie Liu , Huijie Tang , Benhan Yang

Graph contrastive learning (GCL) has become a powerful tool for learning graph data, but its scalability remains a significant challenge. In this work, we propose a simple yet effective training framework called Structural Compression…

Machine Learning · Computer Science 2024-05-10 Shengzhong Zhang , Wenjie Yang , Xinyuan Cao , Hongwei Zhang , Zengfeng Huang

Due to high data demands of current methods, attention to zero-shot cross-lingual spoken language understanding (SLU) has grown, as such approaches greatly reduce human annotation effort. However, existing models solely rely on shared…

Computation and Language · Computer Science 2022-04-19 Libo Qin , Qiguang Chen , Tianbao Xie , Qixin Li , Jian-Guang Lou , Wanxiang Che , Min-Yen Kan