English
Related papers

Related papers: Bayesian Gated Non-Negative Contrastive Learning

200 papers

The enhancement of unsupervised learning of sentence representations has been significantly achieved by the utility of contrastive learning. This approach clusters the augmented positive instance with the anchor instance to create a desired…

Computation and Language · Computer Science 2023-10-11 Qingfa Xiao , Shuangyin Li , Lei Chen

Graph clustering is a crucial task in network analysis with widespread applications, focusing on partitioning nodes into distinct groups with stronger intra-group connections than inter-group ones. Recently, contrastive learning has…

Machine Learning · Computer Science 2024-08-20 Xunlian Wu , Jingqi Hu , Anqi Zhang , Yining Quan , Qiguang Miao , Peng Gang Sun

Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing…

Machine Learning · Computer Science 2026-05-14 Mohamed Mahmoud Amar , Nairouz Mrabah , Mohamed Bouguessa , Abdoulaye Baniré Diallo

Benefiting from the intrinsic supervision information exploitation capability, contrastive learning has achieved promising performance in the field of deep graph clustering recently. However, we observe that two drawbacks of the positive…

Machine Learning · Computer Science 2023-01-04 Xihong Yang , Yue Liu , Sihang Zhou , Siwei Wang , Wenxuan Tu , Qun Zheng , Xinwang Liu , Liming Fang , En Zhu

Bayesian networks are probabilistic graphical models with a wide range of application areas including gene regulatory networks inference, risk analysis and image processing. Learning the structure of a Bayesian network (BNSL) from discrete…

Artificial Intelligence · Computer Science 2021-06-24 Fulya Trösser , Simon de Givry , George Katsirelos

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

Graph Contrastive Learning (GCL) has recently emerged as a promising graph self-supervised learning framework for learning discriminative node representations without labels. The widely adopted objective function of GCL benefits from two…

Machine Learning · Computer Science 2024-11-05 Yunhui Liu , Tieke He , Tao Zheng , Jianhua Zhao

Graph Contrastive Learning (GCL) excels at managing noise and fluctuations in input data, making it popular in various fields (e.g., social networks, and knowledge graphs). Our study finds that the difference in high-frequency information…

Machine Learning · Computer Science 2024-10-15 Yuntao Shou , Xiangyong Cao , Deyu Meng

Graph contrastive learning (GCL) is a popular method for leaning graph representations by maximizing the consistency of features across augmented views. Traditional GCL methods utilize single-perspective i.e. data or model-perspective)…

Machine Learning · Computer Science 2024-06-04 Zelin Yao , Chuang Liu , Xueqi Ma , Mukun Chen , Jia Wu , Xiantao Cai , Bo Du , Wenbin Hu

Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra components such as…

Machine Learning · Computer Science 2021-03-12 Bernie Wang , Simon Xu , Kurt Keutzer , Yang Gao , Bichen Wu

We introduce a new neural network-based continual learning algorithm, dubbed as Uncertainty-regularized Continual Learning (UCL), which builds on traditional Bayesian online learning framework with variational inference. We focus on two…

Machine Learning · Computer Science 2019-11-15 Hongjoon Ahn , Sungmin Cha , Donggyu Lee , Taesup Moon

In-context learning (ICL) has emerged as a particularly remarkable characteristic of Large Language Models (LLM): given a pretrained LLM and an observed dataset, LLMs can make predictions for new data points from the same distribution…

Machine Learning · Statistics 2024-06-04 Fabian Falck , Ziyu Wang , Chris Holmes

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Jansel Herrera-Gerena , Ramakrishnan Sundareswaran , John Just , Matthew Darr , Ali Jannesari

When dealing with real-world optimization problems, decision-makers usually face high levels of uncertainty associated with partial information, unknown parameters, or complex relationships between these and the problem decision variables.…

Optimization and Control · Mathematics 2023-05-01 Antonio Alcántara , Carlos Ruiz

Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the feature space (false…

Machine Learning · Computer Science 2026-03-16 Zhihao Yao

Recently, graph contrastive learning (GCL) has emerged as one of the optimal solutions for node-level and supervised tasks. However, for structure-related and unsupervised tasks such as graph clustering, current GCL algorithms face…

Social and Information Networks · Computer Science 2025-09-25 Yuecheng Li , Lele Fu , Sheng Huang , Chuan Chen , Lei Yang , Zibin Zheng

Despite their consistent performance improvements, cross-modal retrieval models (e.g., CLIP) show degraded performances with retrieving keys composed of fused image-text modality (e.g., Wikipedia pages with both images and text). To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jungsoo Lee , Janghoon Cho , Hyojin Park , Munawar Hayat , Kyuwoong Hwang , Fatih Porikli , Sungha Choi

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques…

Machine Learning · Computer Science 2024-03-22 Yulan Hu , Sheng Ouyang , Jingyu Liu , Ge Chen , Zhirui Yang , Junchen Wan , Fuzheng Zhang , Zhongyuan Wang , Yong Liu

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

Information Retrieval · Computer Science 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Deterministic embeddings learned by contrastive learning (CL) methods such as SimCLR and SupCon achieve state-of-the-art performance but lack a principled mechanism for uncertainty quantification. We propose Variational Contrastive Learning…

Machine Learning · Computer Science 2025-10-08 Minoh Jeong , Seonho Kim , Alfred Hero