English
Related papers

Related papers: G-SimCLR : Self-Supervised Contrastive Learning wi…

200 papers

This paper investigates the problem of image classification with limited or no annotations, but abundant unlabeled data. The setting exists in many tasks such as semi-supervised image classification, image clustering, and image retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2016-02-05 Dengxin Dai , Luc Van Gool

Since convolutional neural networks (CNNs) can easily overfit noisy labels, which are ubiquitous in visual classification tasks, it has been a great challenge to train CNNs against them robustly. Various methods have been proposed for this…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yongqi Zhang , Hui Zhang , Quanming Yao , Jun Wan

We consider the problem of complementary fashion prediction. Existing approaches focus on learning an embedding space where fashion items from different categories that are visually compatible are closer to each other. However, creating…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Ambareesh Revanur , Vijay Kumar , Deepthi Sharma

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

While deep learning, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), has significantly advanced classification performance, its typical reliance on extensive annotated datasets presents a major obstacle in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Matheus Vinícius Todescato , Joel Luís Carbonera

The pursuit of learning robust representations without human supervision is a longstanding challenge. The recent advancements in self-supervised contrastive learning approaches have demonstrated high performance across various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ozgu Goksu , Nicolas Pugeault

Although large-scale labeled data are essential for deep convolutional neural networks (ConvNets) to learn high-level semantic visual representations, it is time-consuming and impractical to collect and annotate large-scale datasets. A…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Huili Huang , M. Mahdi Roozbahani

Sentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various downstream tasks, such…

Computation and Language · Computer Science 2021-05-28 John Giorgi , Osvald Nitski , Bo Wang , Gary Bader

Recent advances in self-supervised learning have highlighted the efficacy of data augmentation in learning data representation from unlabeled data. Training a linear model atop these enhanced representations can yield an adept classifier.…

Machine Learning · Statistics 2024-05-07 Shulei Wang

Is strong supervision necessary for learning a good visual representation? Do we really need millions of semantically-labeled images to train a Convolutional Neural Network (CNN)? In this paper, we present a simple yet surprisingly powerful…

Computer Vision and Pattern Recognition · Computer Science 2015-10-07 Xiaolong Wang , Abhinav Gupta

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Neural networks have been successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are more difficult to train successfully for semi-supervised…

Machine Learning · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

The keep-growing content of Web images may be the next important data source to scale up deep neural networks, which recently obtained a great success in the ImageNet classification challenge and related tasks. This prospect, however, has…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Phong D. Vo , Alexandru Ginsca , Hervé Le Borgne , Adrian Popescu

Self-supervised learning is popular method because of its ability to learn features in images without using its labels and is able to overcome limited labeled datasets used in supervised learning. Self-supervised learning works by using a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Aristo Renaldo Ruslim , Novanto Yudistira , Budi Darma Setiawan

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.…

Information Retrieval · Computer Science 2024-03-13 Shipeng Song , Bin Liu , Fei Teng , Tianrui Li

Self-training is an effective approach to semi-supervised learning. The key idea is to let the learner itself iteratively generate "pseudo-supervision" for unlabeled instances based on its current hypothesis. In combination with consistency…

Machine Learning · Statistics 2021-11-05 Julian Lienen , Eyke Hüllermeier

Labeling data is often very time consuming and expensive, leaving us with a majority of unlabeled data. Self-supervised representation learning methods such as SimCLR (Chen et al., 2020) or BYOL (Grill et al., 2020) have been very…

Machine Learning · Computer Science 2025-04-24 Zhaohan Daniel Guo , Bernardo Avila Pires , Khimya Khetarpal , Dale Schuurmans , Bo Dai

Image recognition is an important topic in computer vision and image processing, and has been mainly addressed by supervised deep learning methods, which need a large set of labeled images to achieve promising performance. However, in most…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Haoqian Wang , Zhiwei Xu , Jun Xu , Wangpeng An , Lei Zhang , Qionghai Dai

In this paper we consider the problem of semi-supervised learning with deep Convolutional Neural Networks (ConvNets). Semi-supervised learning is motivated on the observation that unlabeled data is cheap and can be used to improve the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-13 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen