English
Related papers

Related papers: Evaluating the Label Efficiency of Contrastive Sel…

200 papers

Multi-label recognition is a fundamental, and yet is a challenging task in computer vision. Recently, deep learning models have achieved great progress towards learning discriminative features from input images. However, conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mohammed Hassanin , Ibrahim Radwan , Salman Khan , Murat Tahtali

This manuscript presents a series of my selected contributions to the topic of label-efficient learning in computer vision and remote sensing. The central focus of this research is to develop and adapt methods that can learn effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Minh-Tan Pham

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 BW Sheffield

Recently, contrastive learning has largely advanced the progress of unsupervised visual representation learning. Pre-trained on ImageNet, some self-supervised algorithms reported higher transfer learning performance compared to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Longhui Wei , Lingxi Xie , Jianzhong He , Jianlong Chang , Xiaopeng Zhang , Wengang Zhou , Houqiang Li , Qi Tian

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mrinal Anand , Aditya Garg

We use a contrastive self-supervised learning framework to estimate distances to galaxies from their photometric images. We incorporate data augmentations from computer vision as well as an application-specific augmentation accounting for…

Instrumentation and Methods for Astrophysics · Physics 2021-01-13 Md Abul Hayat , Peter Harrington , George Stein , Zarija Lukić , Mustafa Mustafa

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

Machine Learning · Computer Science 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

Machine Learning · Computer Science 2021-06-08 Ran Liu

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Statistics 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

Contrastive learning has recently demonstrated superior performance to supervised learning, despite requiring no training labels. We explore how contrastive learning can be applied to hundreds of thousands of unlabeled Mars terrain images,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Isaac Ronald Ward , Charles Moore , Kai Pak , Jingdao Chen , Edwin Goh

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Recent literature in self-supervised has demonstrated significant progress in closing the gap between supervised and unsupervised methods in the image and text domains. These methods rely on domain-specific augmentations that are not…

Machine Learning · Computer Science 2021-09-02 Sajad Darabi , Shayan Fazeli , Ali Pazoki , Sriram Sankararaman , Majid Sarrafzadeh

Semantic overlap among land-cover categories, highly imbalanced label distributions, and complex inter-class co-occurrence patterns constitute significant challenges for multi-label remote-sensing image retrieval. In this article,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Amna Amir , Erchan Aptoula

We present a novel data-efficient semi-supervised framework to improve the generalization of image captioning models. Constructing a large-scale labeled image captioning dataset is an expensive task in terms of labor, time, and cost. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Dong-Jin Kim , Tae-Hyun Oh , Jinsoo Choi , In So Kweon

In recent years Convolutional neural networks (CNN) have made significant progress in computer vision. These advancements have been applied to other areas, such as remote sensing and have shown satisfactory results. However, the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-01 Ali Ghanbarzade , Hossein Soleimani

In the application of machine learning to remote sensing, labeled data is often scarce or expensive, which impedes the training of powerful models like deep convolutional neural networks. Although unlabeled data is abundant, recent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Aidan M. Swope , Xander H. Rudelis , Kyle T. Story

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon