中文
相关论文

相关论文: Advancing Momentum Pseudo-Labeling with Conformer …

200 篇论文

RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi-Supervised Learning (SSL) can…

机器学习 · 计算机科学 2021-08-27 Tilman Krokotsch , Mirko Knaak , Clemens Gühmann

Automatic speech recognition (ASR) has shown rapid advances in recent years but still degrades significantly in far-field and noisy environments. The recent development of self-supervised learning (SSL) technology can improve the ASR…

声音 · 计算机科学 2022-05-05 Changfeng Gao , Gaofeng Cheng , Pengyuan Zhang

Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to…

In this paper, we delve into two key techniques in Semi-Supervised Object Detection (SSOD), namely pseudo labeling and consistency training. We observe that these two techniques currently neglect some important properties of object…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Gang Li , Xiang Li , Yujie Wang , Yichao Wu , Ding Liang , Shanshan Zhang

Utilizing the pseudo-labeling algorithm with large-scale unlabeled data becomes crucial for semi-supervised domain adaptation in speaker verification tasks. In this paper, we propose a novel pseudo-labeling method named Multi-objective…

音频与语音处理 · 电气工程与系统科学 2023-10-10 Ze Li , Yuke Lin , Ning Jiang , Xiaoyi Qin , Guoqing Zhao , Haiying Wu , Ming Li

Self-supervised learning (SSL) is the latest breakthrough in speech processing, especially for label-scarce downstream tasks by leveraging massive unlabeled audio data. The noise robustness of the SSL is one of the important challenges to…

While the pseudo-label method has demonstrated considerable success in semi-supervised object detection tasks, this paper uncovers notable limitations within this approach. Specifically, the pseudo-label method tends to amplify the inherent…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Zeming Chen , Wenwei Zhang , Xinjiang Wang , Kai Chen , Zhi Wang

Recent progress in semi- and self-supervised learning has caused a rift in the long-held belief about the need for an enormous amount of labeled data for machine learning and the irrelevancy of unlabeled data. Although it has been…

机器学习 · 计算机科学 2023-03-14 Minwook Kim , Juseong Kim , Giltae Song

Test-Time Reinforcement Learning (TTRL) enables Large Language Models (LLMs) to enhance reasoning capabilities on unlabeled test streams by deriving pseudo-rewards from majority voting consensus. However, existing TTRL methods rely…

机器学习 · 计算机科学 2026-04-21 Dong Yan , Jian Liang , Yanbo Wang , Shuo Lu , Ran He , Tieniu Tan

Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the confirmation bias.…

机器学习 · 计算机科学 2024-02-21 Siyuan Li , Weiyang Jin , Zedong Wang , Fang Wu , Zicheng Liu , Cheng Tan , Stan Z. Li

Machine learning (ML) enables accurate and fast molecular property predictions, which are of interest in drug discovery and material design. Their success is based on the principle of similarity at its heart, assuming that similar molecules…

计算工程、金融与科学 · 计算机科学 2026-01-09 Fang Wu

Semi-supervised learning by self-training heavily relies on pseudo-label selection (PLS). The selection often depends on the initial model fit on labeled data. Early overfitting might thus be propagated to the final model by selecting…

机器学习 · 统计学 2023-06-27 Julian Rodemann , Jann Goschenhofer , Emilio Dorigatti , Thomas Nagler , Thomas Augustin

In this paper, we apply Semi-Supervised Learning (SSL) along with Data Augmentation (DA) for improving the accuracy of End-to-End ASR. We focus on the consistency regularization principle, which has been successfully applied to image…

音频与语音处理 · 电气工程与系统科学 2020-07-29 Felix Weninger , Franco Mana , Roberto Gemello , Jesús Andrés-Ferrer , Puming Zhan

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

信号处理 · 电气工程与系统科学 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate them into spoken language. One of the main challenges in SLR is…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Hasan Algafri , Hamzah Luqman , Sarah Alyami , Issam Laradji

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

机器学习 · 计算机科学 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

This study proposes a multi-task pseudo-label learning (MPL)-based non-intrusive speech quality assessment model called MTQ-Net. MPL consists of two stages: obtaining pseudo-label scores from a pretrained model and performing multi-task…

音频与语音处理 · 电气工程与系统科学 2024-03-14 Ryandhimas E. Zezario , Bo-Ren Brian Bai , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

We present Meta Pseudo Labels, a semi-supervised learning method that achieves a new state-of-the-art top-1 accuracy of 90.2% on ImageNet, which is 1.6% better than the existing state-of-the-art. Like Pseudo Labels, Meta Pseudo Labels has a…

机器学习 · 计算机科学 2021-03-03 Hieu Pham , Zihang Dai , Qizhe Xie , Minh-Thang Luong , Quoc V. Le

Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is specially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Awet Haileslassie Gebrehiwot , Patrik Vacek , David Hurych , Karel Zimmermann , Patrick Perez , Tomáš Svoboda

In recent years, exploring effective sound separation (SSep) techniques to improve overlapping sound event detection (SED) attracts more and more attention. Creating accurate separation signals to avoid the catastrophic error accumulation…

音频与语音处理 · 电气工程与系统科学 2022-03-07 Yunhao Liang , Yanhua Long , Yijie Li , Jiaen Liang