中文
相关论文

相关论文: Bayesian Self-Supervised Contrastive Learning

200 篇论文

Decentralized learning has been advocated and widely deployed to make efficient use of distributed datasets, with an extensive focus on supervised learning (SL) problems. Unfortunately, the majority of real-world data are unlabeled and can…

机器学习 · 计算机科学 2023-03-01 Lirui Wang , Kaiqing Zhang , Yunzhu Li , Yonglong Tian , Russ Tedrake

Contrastive self-supervised learning has been successfully used in many domains, such as images, texts, graphs, etc., to learn features without requiring label information. In this paper, we propose a new local contrastive feature learning…

机器学习 · 计算机科学 2022-11-22 Zhabiz Gharibshah , Xingquan Zhu

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

机器学习 · 计算机科学 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Recently, self-supervised learning has attracted great attention, since it only requires unlabeled data for model training. Contrastive learning is one popular method for self-supervised learning and has achieved promising empirical…

机器学习 · 计算机科学 2023-03-03 Weiran Huang , Mingyang Yi , Xuyang Zhao , Zihao Jiang

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Binary classification (BC) is a practical task that is ubiquitous in real-world problems, such as distinguishing healthy and unhealthy objects in biomedical diagnostics and defective and non-defective products in manufacturing inspections.…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Imam Mustafa Kamal , Hyerim Bae

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often…

机器学习 · 计算机科学 2025-05-29 Zi-Hao Zhou , Jun-Jie Wang , Tong Wei , Min-Ling Zhang

While effective in recommendation tasks, collaborative filtering (CF) techniques face the challenge of data sparsity. Researchers have begun leveraging contrastive learning to introduce additional self-supervised signals to address this.…

信息检索 · 计算机科学 2024-02-20 Peijie Sun , Le Wu , Kun Zhang , Xiangzhi Chen , Meng Wang

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

机器学习 · 计算机科学 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Supervised deep learning-based methods yield accurate results for medical image segmentation. However, they require large labeled datasets for this, and obtaining them is a laborious task that requires clinical expertise.…

计算机视觉与模式识别 · 计算机科学 2021-12-20 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

机器学习 · 计算机科学 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

机器学习 · 计算机科学 2023-09-07 Konstantinos Christopher Tsiolis

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are…

机器学习 · 计算机科学 2026-01-27 Viet Anh Khoa Tran , Emre Neftci , Willem A. M. Wybo

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

机器学习 · 计算机科学 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

计算与语言 · 计算机科学 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

Noise contrastive learning is a popular technique for unsupervised representation learning. In this approach, a representation is obtained via reduction to supervised learning, where given a notion of semantic similarity, the learner tries…

机器学习 · 计算机科学 2021-06-21 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Dipendra Misra

Contrastive self-supervised learning has become a prominent technique in representation learning. The main step in these methods is to contrast semantically similar and dissimilar pairs of samples. However, in the domain of Natural Language…

计算与语言 · 计算机科学 2022-06-07 Amrita Bhattacharjee , Mansooreh Karami , Huan Liu

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

机器学习 · 统计学 2025-12-03 Ali Alvandi , Mina Rezaei