中文
相关论文

相关论文: Adaptive Consistency Regularization for Semi-Super…

200 篇论文

Self-training is a standard approach to semi-supervised learning where the learner's own predictions on unlabeled data are used as supervision during training. In this paper, we reinterpret this label assignment process as an optimal…

机器学习 · 计算机科学 2021-06-15 Kai Sheng Tai , Peter Bailis , Gregory Valiant

Semi-supervised domain adaptation (SSDA) has been widely studied due to its ability to utilize a few labeled target data to improve the generalization ability of the model. However, existing methods only consider designing certain…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Xinyang Huang , Chuang Zhu , Bowen Zhang , Shanghang Zhang

In this paper we revisit the idea of pseudo-labeling in the context of semi-supervised learning where a learning algorithm has access to a small set of labeled samples and a large set of unlabeled samples. Pseudo-labeling works by applying…

机器学习 · 计算机科学 2020-12-11 Paola Cascante-Bonilla , Fuwen Tan , Yanjun Qi , Vicente Ordonez

Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. However, existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error…

计算与语言 · 计算机科学 2023-10-24 Henry Peng Zou , Cornelia Caragea

Federated learning enables multiple clients, such as mobile phones and organizations, to collaboratively learn a shared model for prediction while protecting local data privacy. However, most recent research and applications of federated…

机器学习 · 计算机科学 2021-08-24 Haowen Lin , Jian Lou , Li Xiong , Cyrus Shahabi

Semi-supervised domain adaptation (SSDA) aims to apply knowledge learned from a fully labeled source domain to a scarcely labeled target domain. In this paper, we propose a Multi-level Consistency Learning (MCL) framework for SSDA.…

计算机视觉与模式识别 · 计算机科学 2022-06-29 Zizheng Yan , Yushuang Wu , Guanbin Li , Yipeng Qin , Xiaoguang Han , Shuguang Cui

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Semi-Supervised Domain Adaptation (SSDA) leverages knowledge from a fully labeled source domain to classify data in a partially labeled target domain. Due to the limited number of labeled samples in the target domain, there can be intrinsic…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Yuting Hong , Li Dong , Xiaojie Qiu , Hui Xiao , Baochen Yao , Siming Zheng , Chengbin Peng

Recently, a variety of regularization techniques have been widely applied in deep neural networks, such as dropout, batch normalization, data augmentation, and so on. These methods mainly focus on the regularization of weight parameters to…

机器学习 · 计算机科学 2019-08-16 Qianggang Ding , Sifan Wu , Hao Sun , Jiadong Guo , Shu-Tao Xia

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

机器学习 · 计算机科学 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

Recent advances in contrastive learning have enlightened diverse applications across various semi-supervised fields. Jointly training supervised learning and unsupervised learning with a shared feature encoder becomes a common scheme.…

机器学习 · 计算机科学 2022-06-03 Cheng Tan , Zhangyang Gao , Lirong Wu , Siyuan Li , Stan Z. Li

Recent studies have shown that the benefits provided by self-supervised pre-training and self-training (pseudo-labeling) are complementary. Semi-supervised fine-tuning strategies under the pre-training framework, however, remain…

声音 · 计算机科学 2022-06-28 Bowen Zhang , Songjun Cao , Xiaoming Zhang , Yike Zhang , Long Ma , Takahiro Shinozaki

Supervised Dictionary Learning has gained much interest in the recent decade and has shown significant performance improvements in image classification. However, in general, supervised learning needs a large number of labelled samples per…

计算机视觉与模式识别 · 计算机科学 2020-09-15 Khanh-Hung Tran , Fred-Maurice Ngole-Mboula , Jean-Luc Starck , Vincent Prost

Semi-supervised learning (SSL) is a key approach toward more data-efficient machine learning by jointly leverage both labeled and unlabeled data. We propose AlphaMatch, an efficient SSL method that leverages data augmentations, by…

机器学习 · 计算机科学 2020-11-25 Chengyue Gong , Dilin Wang , Qiang Liu

We propose Regularized Learning under Label shifts (RLLS), a principled and a practical domain-adaptation algorithm to correct for shifts in the label distribution between a source and a target domain. We first estimate importance weights…

机器学习 · 计算机科学 2020-08-10 Kamyar Azizzadenesheli , Anqi Liu , Fanny Yang , Animashree Anandkumar

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization. However, its training procedure suffers from confirmation bias due to the noise contained in self-generated artificial labels. Moreover,…

计算机视觉与模式识别 · 计算机科学 2022-09-12 Fan Yang , Kai Wu , Shuyi Zhang , Guannan Jiang , Yong Liu , Feng Zheng , Wei Zhang , Chengjie Wang , Long Zeng

Consistency regularization (CR) improves the robustness and accuracy of Connectionist Temporal Classification (CTC) by ensuring predictions remain stable across input perturbations. In this work, we propose Align-Consistency, an extension…

音频与语音处理 · 电气工程与系统科学 2026-02-27 Wanting Huang , Weiran Wang

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

机器学习 · 计算机科学 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang