中文
相关论文

相关论文: Adversarial Contrastive Self-Supervised Learning

200 篇论文

Thanks to the success of deep learning, cross-modal retrieval has made significant progress recently. However, there still remains a crucial bottleneck: how to bridge the modality gap to further enhance the retrieval accuracy. In this…

计算机视觉与模式识别 · 计算机科学 2018-04-05 Chao Li , Cheng Deng , Ning Li , Wei Liu , Xinbo Gao , Dacheng Tao

This paper studies learning fair encoders in a self-supervised learning (SSL) setting, in which all data are unlabeled and only a small portion of them are annotated with sensitive attribute. Adversarial fair representation learning is well…

机器学习 · 计算机科学 2024-06-11 Qi Qi , Quanqi Hu , Qihang Lin , Tianbao Yang

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

机器学习 · 统计学 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

Existing semi-supervised learning algorithms adopt pseudo-labeling and consistency regulation techniques to introduce supervision signals for unlabeled samples. To overcome the inherent limitation of threshold-based pseudo-labeling, prior…

机器学习 · 计算机科学 2024-07-10 Zhiyu Wu , Jinshi Cui

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

计算机视觉与模式识别 · 计算机科学 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

The recent promising achievements of deep learning rely on the large amount of labeled data. Considering the abundance of data on the web, most of them do not have labels at all. Therefore, it is important to improve generalization…

神经与进化计算 · 计算机科学 2016-01-20 Sheng-Yi Bai , Sebastian Agethen , Ting-Hsuan Chao , Winston Hsu

Self-supervised learning for inverse problems allows to train a reconstruction network from noise and/or incomplete data alone. These methods have the potential of enabling learning-based solutions when obtaining ground-truth references for…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Victor Sechaud , Jérémy Scanvic , Quentin Barthélemy , Patrice Abry , Julián Tachella

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

机器学习 · 计算机科学 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

For many practical problems and applications, it is not feasible to create a vast and accurately labeled dataset, which restricts the application of deep learning in many areas. Semi-supervised learning algorithms intend to improve…

计算机视觉与模式识别 · 计算机科学 2021-01-12 Mert Kayhan , Okan Köpüklü , Mhd Hasan Sarhan , Mehmet Yigitsoy , Abouzar Eslami , Gerhard Rigoll

In this work, we propose a simple yet effective semi-supervised learning approach called Augmented Distribution Alignment. We reveal that an essential sampling bias exists in semi-supervised learning due to the limited number of labeled…

计算机视觉与模式识别 · 计算机科学 2019-08-20 Qin Wang , Wen Li , Luc Van Gool

Partial Label (PL) learning refers to the task of learning from the partially labeled data, where each training instance is ambiguously equipped with a set of candidate labels but only one is valid. Advances in the recent deep PL learning…

机器学习 · 计算机科学 2022-12-01 Ximing Li , Yuanzhi Jiang , Changchun Li , Yiyuan Wang , Jihong Ouyang

This work tackles the problem of semi-supervised learning of image classifiers. Our main insight is that the field of semi-supervised learning can benefit from the quickly advancing field of self-supervised visual representation learning.…

计算机视觉与模式识别 · 计算机科学 2019-07-24 Xiaohua Zhai , Avital Oliver , Alexander Kolesnikov , Lucas Beyer

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

In this paper we consider the problem of semi-supervised learning with deep Convolutional Neural Networks (ConvNets). Semi-supervised learning is motivated on the observation that unlabeled data is cheap and can be used to improve the…

计算机视觉与模式识别 · 计算机科学 2016-06-13 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

Semi-supervised learning is a setting in which one has labeled and unlabeled data available. In this survey we explore different types of theoretical results when one uses unlabeled data in classification and regression tasks. Most methods…

机器学习 · 计算机科学 2020-07-31 Alexander Mey , Marco Loog

We study Online Continual Learning with missing labels and propose SemiCon, a new contrastive loss designed for partly labeled data. We demonstrate its efficiency by devising a memory-based method trained on an unlabeled data stream, where…

机器学习 · 计算机科学 2022-11-23 Nicolas Michel , Romain Negrel , Giovanni Chierchia , Jean-François Bercher

This work presents a novel self-supervised representation learning method to learn efficient representations without labels on images from a 3DPM sensor (3-Dimensional Particle Measurement; estimates the particle size distribution of…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Prakash Chandra Chhipa , Richa Upadhyay , Rajkumar Saini , Lars Lindqvist , Richard Nordenskjold , Seiichi Uchida , Marcus Liwicki

Self-supervision provides effective representations for downstream tasks without requiring labels. However, existing approaches lag behind fully supervised training and are often not thought beneficial beyond obviating or reducing the need…

机器学习 · 计算机科学 2019-10-30 Dan Hendrycks , Mantas Mazeika , Saurav Kadavath , Dawn Song

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

机器学习 · 计算机科学 2023-09-07 Konstantinos Christopher Tsiolis