English
Related papers

Related papers: How Well Do Self-Supervised Methods Perform in Cro…

200 papers

Recently, deep learning has experienced rapid expansion, contributing significantly to the progress of supervised learning methodologies. However, acquiring labeled data in real-world settings can be costly, labor-intensive, and sometimes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jicheng Yuan , Anh Le-Tuan , Ali Ganbarov , Manfred Hauswirth , Danh Le-Phuoc

Cross-domain few-shot learning (CD-FSL), where there are few target samples under extreme differences between source and target domains, has recently attracted huge attention. Recent studies on CD-FSL generally focus on transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Jaehoon Oh , Sungnyun Kim , Namgyu Ho , Jin-Hwa Kim , Hwanjun Song , Se-Young Yun

Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-Shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly…

Machine Learning · Computer Science 2020-03-31 Yaqing Wang , Quanming Yao , James Kwok , Lionel M. Ni

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Guo-Jun Qi , Jiebo Luo

Cross-domain few-shot classification (CDFSC) is a challenging and tough task due to the significant distribution discrepancies across different domains. To address this challenge, many approaches aim to learn transferable representations.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Shuanghao Bai , Wanqi Zhou , Zhirong Luan , Donglin Wang , Badong Chen

Existing domain adaptation (DA) and generalization (DG) methods in object detection enforce feature alignment in the visual space but face challenges like object appearance variability and scene complexity, which make it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Sina Malakouti , Adriana Kovashka

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

Machine Learning · Computer Science 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Cross-domain few-shot learning (CD-FSL) aims to recognize novel classes with only a few labeled examples under significant domain shifts. While recent approaches leverage a limited amount of labeled target-domain data to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Siqi Hui , Sanping Zhou , Ye deng , Wenli Huang , Jinjun Wang

Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Zilong Ji , Xiaolong Zou , Tiejun Huang , Si Wu

The field of Few-Shot Learning (FSL), or learning from very few (typically $1$ or $5$) examples per novel class (unseen during training), has received a lot of attention and significant performance advances in the recent literature. While…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshe Lichtenstein , Prasanna Sattigeri , Rogerio Feris , Raja Giryes , Leonid Karlinsky

Self-supervised learning (SSL) has recently shown notable success in various visual tasks. However, in terms of discriminability, SSL is still not on par with supervised learning (SL). This paper identifies a key issue, the ``crowding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zeen Song , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Recent successes in self-supervised learning (SSL) model spatial co-occurrences of visual features either by masking portions of an image or by aggressively cropping it. Here, we propose a new way to model spatial co-occurrences by aligning…

Machine Learning · Computer Science 2025-01-07 Arthur Aubret , Céline Teulière , Jochen Triesch

Self-training is an effective approach to semi-supervised learning. The key idea is to let the learner itself iteratively generate "pseudo-supervision" for unlabeled instances based on its current hypothesis. In combination with consistency…

Machine Learning · Statistics 2021-11-05 Julian Lienen , Eyke Hüllermeier

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Florent Chiaroni , Mohamed-Cherif Rahal , Nicolas Hueber , Frederic Dufaux

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

Machine Learning · Computer Science 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Prarthana Bhattacharyya , Chenge Li , Xiaonan Zhao , István Fehérvári , Jason Sun