中文
相关论文

相关论文: Semi-supervised learning using teacher-student mod…

200 篇论文

Semi-supervised learning (SSL) constructs classifiers using both labelled and unlabelled data. It leverages information from labelled samples, whose acquisition is often costly or labour-intensive, together with unlabelled data to enhance…

机器学习 · 统计学 2025-12-29 Jinran Wu , You-Gan Wang , Geoffrey J. McLachlan

Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the confirmation bias.…

机器学习 · 计算机科学 2024-02-21 Siyuan Li , Weiyang Jin , Zedong Wang , Fang Wu , Zicheng Liu , Cheng Tan , Stan Z. Li

In the domain of semi-supervised learning (SSL), the conventional approach involves training a learner with a limited amount of labeled data alongside a substantial volume of unlabeled data, both drawn from the same underlying distribution.…

机器学习 · 计算机科学 2023-08-29 Guy Hacohen , Daphna Weinshall

Semi-supervised learning (SSL) is one of the dominant approaches to address the annotation bottleneck of supervised learning. Recent SSL methods can effectively leverage a large repository of unlabeled data to improve performance while…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi-Supervised Learning (SSL) can…

机器学习 · 计算机科学 2021-08-27 Tilman Krokotsch , Mirko Knaak , Clemens Gühmann

To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the…

计算与语言 · 计算机科学 2021-09-13 Xuming Hu , Chenwei Zhang , Fukun Ma , Chenyao Liu , Lijie Wen , Philip S. Yu

Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused on offline…

音频与语音处理 · 电气工程与系统科学 2022-11-11 Zili Huang , Zhuo Chen , Naoyuki Kanda , Jian Wu , Yiming Wang , Jinyu Li , Takuya Yoshioka , Xiaofei Wang , Peidong Wang

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Semi-supervised learning (SSL) can improve model performance by leveraging unlabeled images, which can be collected from public image sources with low costs. In recent years, synthetic images have become increasingly common in public image…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Zerun Wang , Jiafeng Mao , Liuyu Xiang , Toshihiko Yamasaki

Semi-Supervised Learning (SSL) can leverage abundant unlabeled data to boost model performance. However, the class-imbalanced data distribution in real-world scenarios poses great challenges to SSL, resulting in performance degradation.…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Yin Wang , Zixuan Wang , Hao Lu , Zhen Qin , Hailiang Zhao , Guanjie Cheng , Ge Su , Li Kuang , Mengchu Zhou , Shuiguang Deng

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech recognition (ASR). An ASR model with decent performance can be realized by fine-tuning an SSL model with…

音频与语音处理 · 电气工程与系统科学 2023-08-30 Zhisheng Zheng , Ziyang Ma , Yu Wang , Xie Chen

Recently proposed consistency-based Semi-Supervised Learning (SSL) methods such as the $\Pi$-model, temporal ensembling, the mean teacher, or the virtual adversarial training, have advanced the state of the art in several SSL tasks. These…

机器学习 · 统计学 2021-01-19 Atin Ghosh , Alexandre H. Thiery

Self-supervised learning (SSL) is a long-standing goal for speech processing, since it utilizes large-scale unlabeled data and avoids extensive human labeling. Recent years witness great successes in applying self-supervised learning in…

计算与语言 · 计算机科学 2021-10-13 Sanyuan Chen , Yu Wu , Chengyi Wang , Zhengyang Chen , Zhuo Chen , Shujie Liu , Jian Wu , Yao Qian , Furu Wei , Jinyu Li , Xiangzhan Yu

Most existing distance metric learning approaches use fully labeled data to learn the sample similarities in an embedding space. We present a self-training framework, SLADE, to improve retrieval performance by leveraging additional…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Jiali Duan , Yen-Liang Lin , Son Tran , Larry S. Davis , C. -C. Jay Kuo

Semi-supervised learning (SSL) has shown its effectiveness in learning effective 3D representation from a small amount of labelled data while utilizing large unlabelled data. Traditional semi-supervised approaches rely on the fundamental…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Sneha Paul , Zachary Patterson , Nizar Bouguila

Semi-Supervised Learning (SSL) has shown its strong ability in utilizing unlabeled data when labeled data is scarce. However, most SSL algorithms work under the assumption that the class distributions are balanced in both training and test…

计算机视觉与模式识别 · 计算机科学 2021-12-14 Ju He , Adam Kortylewski , Shaokang Yang , Shuai Liu , Cheng Yang , Changhu Wang , Alan Yuille

The recently proposed Mean Teacher method, which exploits large-scale unlabeled data in a self-ensembling manner, has achieved state-of-the-art results in several semi-supervised learning benchmarks. Spurred by current achievements, this…

机器学习 · 计算机科学 2022-02-25 Rui Tao , Long Yan , Kazushige Ouchi , Xiangdong Wang

Semi-supervised object detection (SSOD) aims to boost detection performance by leveraging extra unlabeled data. The teacher-student framework has been shown to be promising for SSOD, in which a teacher network generates pseudo-labels for…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Honggyu Choi , Zhixiang Chen , Xuepeng Shi , Tae-Kyun Kim

Federated Learning allows the training of machine learning models by using the computation and private data resources of many distributed clients. Most existing results on Federated Learning (FL) assume the clients have ground-truth labels.…

机器学习 · 计算机科学 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao