中文
相关论文

相关论文: Bayesian Self-Supervised Contrastive Learning

200 篇论文

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

计算与语言 · 计算机科学 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Conventional Bayesian Neural Networks (BNNs) are unable to leverage unlabelled data to improve their predictions. To overcome this limitation, we introduce Self-Supervised Bayesian Neural Networks, which use unlabelled data to learn models…

机器学习 · 计算机科学 2024-09-02 Mrinank Sharma , Tom Rainforth , Yee Whye Teh , Vincent Fortuin

Self-supervised learning (especially contrastive learning) has attracted great interest due to its huge potential in learning discriminative representations in an unsupervised manner. Despite the acknowledged successes, existing contrastive…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Guangrun Wang , Keze Wang , Guangcong Wang , Philip H. S. Torr , Liang Lin

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

Contrastive learning has shown outstanding performances in both supervised and unsupervised learning, and has recently been introduced to solve weakly supervised learning problems such as semi-supervised learning and noisy label learning.…

机器学习 · 计算机科学 2023-06-08 Jingyi Cui , Weiran Huang , Yifei Wang , Yisen Wang

While Contrastive Learning (CL) has revolutionized self-supervised representation learning, its latent representations remain highly entangled and opaque, limiting their interpretability in safety-critical applications. We identify that a…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Peng Cui , Jiahao Zhang , Lijie Hu

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Jiabo Huang , Shaogang Gong

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

机器学习 · 计算机科学 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Self-supervised representation learning on image-text data facilitates crucial medical applications, such as image classification, visual grounding, and cross-modal retrieval. One common approach involves contrasting semantically similar…

机器学习 · 计算机科学 2023-08-15 Peiqi Wang , Yingcheng Liu , Ching-Yun Ko , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

机器学习 · 计算机科学 2021-06-08 Ran Liu

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

机器学习 · 计算机科学 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

机器学习 · 计算机科学 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

Recently, various contrastive learning techniques have been developed to categorize time series data and exhibit promising performance. A general paradigm is to utilize appropriate augmentations and construct feasible positive samples such…

机器学习 · 计算机科学 2024-10-11 Qianying Ren , Dongsheng Luo , Dongjin Song

Contrastive Learning first extracts features from unlabeled data, followed by linear probing with labeled data. Adversarial Contrastive Learning (ACL) integrates Adversarial Training into the first phase to enhance feature robustness…

机器学习 · 计算机科学 2025-10-28 Ngoc N. Tran , Lam Tran , Hoang Phan , Anh Bui , Tung Pham , Toan Tran , Dinh Phung , Trung Le

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

机器学习 · 计算机科学 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Contrastive learning (CL) has achieved astonishing progress in computer vision, speech, and natural language processing fields recently with self-supervised learning. However, CL approach to the supervised setting is not fully explored,…

计算与语言 · 计算机科学 2022-05-23 Zhenyu Zhang , Yuming Zhao , Meng Chen , Xiaodong He