中文
相关论文

相关论文: Boosting Supervision with Self-Supervision for Few…

200 篇论文

Unsupervised meta-learning aims to learn generalizable knowledge across a distribution of tasks constructed from unlabeled data. Here, the main challenge is how to construct diverse tasks for meta-learning without label information; recent…

机器学习 · 计算机科学 2023-03-03 Huiwon Jang , Hankook Lee , Jinwoo Shin

Self-supervised visual representation learning has seen huge progress recently, but no large scale evaluation has compared the many models now available. We evaluate the transfer performance of 13 top self-supervised models on 40 downstream…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Zejiang Hou , Sun-Yuan Kung

A common practice in unsupervised representation learning is to use labeled data to evaluate the quality of the learned representations. This supervised evaluation is then used to guide critical aspects of the training process such as…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Colorado J Reed , Sean Metzger , Aravind Srinivas , Trevor Darrell , Kurt Keutzer

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

机器学习 · 计算机科学 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

We present a new method to learn video representations from unlabeled data. Given large-scale unlabeled video data, the objective is to benefit from such data by learning a generic and transferable representation space that can be directly…

计算机视觉与模式识别 · 计算机科学 2019-06-10 AJ Piergiovanni , Anelia Angelova , Michael S. Ryoo

Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Zilong Ji , Xiaolong Zou , Tiejun Huang , Si Wu

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

计算机视觉与模式识别 · 计算机科学 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

计算机视觉与模式识别 · 计算机科学 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

Self-training is an important technique for solving semi-supervised learning problems. It leverages unlabeled data by generating pseudo-labels and combining them with a limited labeled dataset for training. The effectiveness of…

机器学习 · 计算机科学 2023-11-06 Banghua Zhu , Mingyu Ding , Philip Jacobson , Ming Wu , Wei Zhan , Michael Jordan , Jiantao Jiao

Self-supervised representation learning methods aim to provide powerful deep feature learning without the requirement of large annotated datasets, thus alleviating the annotation bottleneck that is one of the main barriers to practical…

机器学习 · 计算机科学 2022-05-18 Linus Ericsson , Henry Gouk , Chen Change Loy , Timothy M. Hospedales

Deep neural models have achieved state of the art performance on a wide range of problems in computer science, especially in computer vision. However, deep neural networks often require large datasets of labeled samples to generalize…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Patrick Kage , Jay C. Rothenberger , Pavlos Andreadis , Dimitrios I. Diochnos

Recently, Semi-Supervised Learning (SSL) has shown much promise in leveraging unlabeled data while being provided with very few labels. In this paper, we show that ignoring the labels altogether for whole epochs intermittently during…

计算机视觉与模式识别 · 计算机科学 2020-12-02 Boaz Lerner , Guy Shiran , Daphna Weinshall

Self-supervised model pre-training has recently garnered significant interest, but relatively few efforts have explored using additional resources in fine-tuning these models. We demonstrate how universal phoneset acoustic models can…

音频与语音处理 · 电气工程与系统科学 2021-10-12 Matthew Wiesner , Desh Raj , Sanjeev Khudanpur

In robotic applications, we often face the challenge of discovering new objects while having very little or no labelled training data. In this paper we explore the use of self-supervision provided by a robot traversing an environment to…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Etienne Pot , Alexander Toshev , Jana Kosecka

Semi-supervised learning has the potential to improve the data-efficiency of training data-hungry deep neural networks, which is especially important for medical image analysis tasks where labeled data is scarce. In this work, we present a…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Boon Peng Yap , Beng Koon Ng

Self-supervised learning aims to learn good representations with unlabeled data. Recent works have shown that larger models benefit more from self-supervised learning than smaller models. As a result, the gap between supervised and…

计算机视觉与模式识别 · 计算机科学 2020-10-29 Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash