English
Related papers

Related papers: Semi-Supervised Teacher-Reference-Student Architec…

200 papers

The high capacity of deep learning models to learn complex patterns poses a significant challenge when confronted with label noise. The inability to differentiate clean and noisy labels ultimately results in poor generalization. We approach…

Machine Learning · Computer Science 2023-11-27 Eugene Kim

We study the problem of generating keyphrases that summarize the key points for a given document. While sequence-to-sequence (seq2seq) models have achieved remarkable performance on this task (Meng et al., 2017), model training often relies…

Computation and Language · Computer Science 2019-09-09 Hai Ye , Lu Wang

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim

This paper proposes a novel method of learning by predicting view assignments with support samples (PAWS). The method trains a model to minimize a consistency loss, which ensures that different views of the same unlabeled instance are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Mahmoud Assran , Mathilde Caron , Ishan Misra , Piotr Bojanowski , Armand Joulin , Nicolas Ballas , Michael Rabbat

In recent years, assessing action quality from videos has attracted growing attention in computer vision community and human computer interaction. Most existing approaches usually tackle this problem by directly migrating the model from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Shunli Wang , Dingkang Yang , Peng Zhai , Chixiao Chen , Lihua Zhang

Semi-supervised action recognition aims to improve spatio-temporal reasoning ability with a few labeled data in conjunction with a large amount of unlabeled data. Albeit recent advancements, existing powerful methods are still prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yu Wang , Sanping Zhou , Kun Xia , Le Wang

A fundamental limitation of applying semi-supervised learning in real-world settings is the assumption that unlabeled test data contains only classes previously encountered in the labeled training data. However, this assumption rarely holds…

Machine Learning · Computer Science 2022-01-27 Kaidi Cao , Maria Brbic , Jure Leskovec

Neural Architecture Search (NAS) has been used recently to achieve improved performance in various tasks and most prominently in image classification. Yet, current search strategies rely on large labeled datasets, which limit their usage in…

Machine Learning · Computer Science 2020-07-06 Sapir Kaplan , Raja Giryes

Remote sensing projects typically generate large amounts of imagery that can be used to train powerful deep neural networks. However, the amount of labeled images is often small, as remote sensing applications generally require expert…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Maximilian Bernhard , Tanveer Hannan , Niklas Strauß , Matthias Schubert

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

Machine Learning · Computer Science 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

In this paper, we apply Semi-Supervised Learning (SSL) along with Data Augmentation (DA) for improving the accuracy of End-to-End ASR. We focus on the consistency regularization principle, which has been successfully applied to image…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Felix Weninger , Franco Mana , Roberto Gemello , Jesús Andrés-Ferrer , Puming Zhan

Recent studies have shown that the benefits provided by self-supervised pre-training and self-training (pseudo-labeling) are complementary. Semi-supervised fine-tuning strategies under the pre-training framework, however, remain…

Sound · Computer Science 2022-06-28 Bowen Zhang , Songjun Cao , Xiaoming Zhang , Yike Zhang , Long Ma , Takahiro Shinozaki

Recently, pseudo label based semi-supervised learning has achieved great success in many fields. The core idea of the pseudo label based semi-supervised learning algorithm is to use the model trained on the labeled data to generate pseudo…

Machine Learning · Computer Science 2023-01-26 Zeping Min , Qian Ge , Cheng Tai

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

We consider statistical inference under a semi-supervised setting where we have access to both a labeled dataset consisting of pairs $\{X_i, Y_i \}_{i=1}^n$ and an unlabeled dataset $\{ X_i \}_{i=n+1}^{n+N}$. We ask the question: under what…

Statistics Theory · Mathematics 2025-03-20 Zichun Xu , Daniela Witten , Ali Shojaie

Training a real-time gesture recognition model heavily relies on annotated data. However, manual data annotation is costly and demands substantial human effort. In order to address this challenge, we propose a framework that can…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Junxiao Shen , Xuhai Xu , Ran Tan , Amy Karlson , Evan Strasnick

This paper tackles the problem of semi-supervised learning when the set of labeled samples is limited to a small number of images per class, typically less than 10, problem that we refer to as barely-supervised learning. We analyze in depth…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Thomas Lucas , Philippe Weinzaepfel , Gregory Rogez

Labeling datasets is a noteworthy challenge in machine learning, both in terms of cost and time. This research, however, leverages an efficient answer. By exploring label propagation in semi-supervised learning, we can significantly reduce…

Machine Learning · Computer Science 2024-10-16 Minoo Jafarlou , Mario M. Kubek

Physiological and behavioral data collected from wearable or mobile sensors have been used to estimate self-reported stress levels. Since the stress annotation usually relies on self-reports during the study, a limited amount of labeled…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Han Yu , Akane Sano

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang