English
Related papers

Related papers: Teacher-Student Asynchronous Learning with Multi-S…

200 papers

Pseudo-labeling is the most adopted method for pre-training automatic speech recognition (ASR) models. However, its performance suffers from the supervised teacher model's degrading quality in low-resource setups and under domain transfer.…

Computation and Language · Computer Science 2021-03-10 Alex Xiao , Christian Fuegen , Abdelrahman Mohamed

Existing camouflaged object detection~(COD) methods depend heavily on large-scale pixel-level annotations.However, acquiring such annotations is laborious due to the inherent camouflage characteristics of the objects.Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Xunfa Lai , Zhiyu Yang , Jie Hu , Shengchuan Zhang , Liujuan Cao , Guannan Jiang , Zhiyu Wang , Songan Zhang , Rongrong Ji

Recently, many semi-supervised object detection (SSOD) methods adopt teacher-student framework and have achieved state-of-the-art results. However, the teacher network is tightly coupled with the student network since the teacher is an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Hao Liu , Bin Chen , Bo Wang , Chunpeng Wu , Feng Dai , Peng Wu

Due to the lack of labels and the domain diversities, it is a challenge to study person re-identification in the cross-domain setting. An admirable method is to optimize the target model by assigning pseudo-labels for unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hongliang Zhang , Shoudong Han , Xiaofeng Pan , Jun Zhao

Knowledge distillation with unlabeled examples is a powerful training paradigm for generating compact and lightweight student models in applications where the amount of labeled data is limited but one has access to a large pool of unlabeled…

Machine Learning · Computer Science 2023-06-12 Vasilis Kontonis , Fotis Iliopoulos , Khoa Trinh , Cenk Baykal , Gaurav Menghani , Erik Vee

The objective of unsupervised person re-identification (Re-ID) is to learn discriminative features without labor-intensive identity annotations. State-of-the-art unsupervised Re-ID methods assign pseudo labels to unlabeled images in the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Hao Chen , Benoit Lagadec , Francois Bremond

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

Machine Learning · Computer Science 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Micro-Action Recognition (MAR) aims to classify subtle human actions in video. However, annotating MAR datasets is particularly challenging due to the subtlety of actions. To this end, we introduce the setting of Semi-Supervised MAR…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yan Zhang , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Meng Wang

Modern deep learning has achieved great success in various fields. However, it requires the labeling of huge amounts of data, which is expensive and labor-intensive. Active learning (AL), which identifies the most informative samples to be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Jae Soon Baik , In Young Yoon , Jun Won Choi

In zero-shot learning (ZSL) community, it is generally recognized that transductive learning performs better than inductive one as the unseen-class samples are also used in its training stage. How to generate pseudo labels for unseen-class…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Bo Liu , Lihua Hu , Qiulei Dong , Zhanyi Hu

Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppress the noises in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Fang Wen

Unsupervised source-free domain adaptation methods aim to train a model for the target domain utilizing a pretrained source-domain model and unlabeled target-domain data, particularly when accessibility to source data is restricted due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Ibrahim Batuhan Akkaya , Ugur Halici

Federated Semi-Supervised Learning (FSSL) aims to learn a global model from different clients in an environment with both labeled and unlabeled data. Most of the existing FSSL work generally assumes that both types of data are available on…

Machine Learning · Computer Science 2023-03-07 Xinyi Shang , Gang Huang , Yang Lu , Jian Lou , Bo Han , Yiu-ming Cheung , Hanzi Wang

Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Ding Li , Xuebing Yang , Yongqiang Tang , Chenyang Zhang , Wensheng Zhang

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Deep learning is pushing the state-of-the-art in many computer vision applications. However, it relies on large annotated data repositories, and capturing the unconstrained nature of the real-world data is yet to be solved. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Semi-supervised 3D object detection (SS3DOD) aims to reduce costly 3D annotations utilizing unlabeled data. Recent studies adopt pseudo-label-based teacher-student frameworks and demonstrate impressive performance. The main challenge of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Taehun Kong , Tae-Kyun Kim

Addressing the challenge of domain shift between datasets is vital in maintaining model performance. In the context of cross-domain object detection, the teacher-student framework, a widely-used semi-supervised model, has shown significant…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Runou Yang , Tian Tian , Jinwen Tian

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao