中文
相关论文

相关论文: Improved Noisy Student Training for Automatic Spee…

200 篇论文

Most recent self-supervised learning methods learn visual representation by contrasting different augmented views of images. Compared with supervised learning, more aggressive augmentations have been introduced to further improve the…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Yingbin Bai , Erkun Yang , Zhaoqing Wang , Yuxuan Du , Bo Han , Cheng Deng , Dadong Wang , Tongliang Liu

Annotating the dataset with high-quality labels is crucial for performance of deep network, but in real world scenarios, the labels are often contaminated by noise. To address this, some methods were proposed to automatically split clean…

机器学习 · 计算机科学 2022-12-20 Daehwan Kim , Kwangrok Ryoo , Hansang Cho , Seungryong Kim

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

计算与语言 · 计算机科学 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow

In this study, we investigate whether noise-augmented training can concurrently improve adversarial robustness in automatic speech recognition (ASR) systems. We conduct a comparative analysis of the adversarial robustness of four different…

音频与语音处理 · 电气工程与系统科学 2025-11-10 Karla Pizzi , Matías Pizarro , Asja Fischer

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

机器学习 · 计算机科学 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Manually labeled corpora are expensive to create and often not available for low-resource languages or domains. Automatic labeling approaches are an alternative way to obtain labeled data in a quicker and cheaper way. However, these labels…

机器学习 · 计算机科学 2018-07-24 Michael A. Hedderich , Dietrich Klakow

ConvNets achieve good results when training from clean data, but learning from noisy labels significantly degrades performances and remains challenging. Unlike previous works constrained by many conditions, making them infeasible to real…

计算机视觉与模式识别 · 计算机科学 2019-08-21 Jiangfan Han , Ping Luo , Xiaogang Wang

Data augmentation methods usually apply the same augmentation (or a mix of them) to all the training samples. For example, to perturb data with noise, the noise is sampled from a Normal distribution with a fixed standard deviation, for all…

Fine tuning self supervised pretrained models using pseudo labels can effectively improve speech recognition performance. But, low quality pseudo labels can misguide decision boundaries and degrade performance. We propose a simple yet…

声音 · 计算机科学 2022-11-01 Zezhong Jin , Dading Zhong , Xiao Song , Zhaoyi Liu , Naipeng Ye , Qingcheng Zeng

Data augmentation is vital to the generalization ability and robustness of deep neural networks (DNNs) models. Existing augmentation methods for speaker verification manipulate the raw signal, which are time-consuming and the augmented…

音频与语音处理 · 电气工程与系统科学 2023-10-19 Yuanyuan Wang , Yang Zhang , Zhiyong Wu , Zhihan Yang , Tao Wei , Kun Zou , Helen Meng

Whisper's robust performance in automatic speech recognition (ASR) is often attributed to its massive 680k-hour training set, an impractical scale for most researchers. In this work, we examine how linguistic and acoustic diversity in…

计算与语言 · 计算机科学 2025-05-28 Dancheng Liu , Amir Nassereldine , Chenhui Xu , Jinjun Xiong

Intent classification is a fundamental task in the spoken language understanding field that has recently gained the attention of the scientific community, mainly because of the feasibility of approaching it with end-to-end neural models. In…

计算与语言 · 计算机科学 2023-03-14 Mohamed Nabih Ali , Alessio Brutti , Daniele Falavigna

The performance of automatic speech recognition systems under noisy environments still leaves room for improvement. Speech enhancement or feature enhancement techniques for increasing noise robustness of these systems usually add components…

计算与语言 · 计算机科学 2016-09-19 Stefan Braun , Daniel Neil , Shih-Chii Liu

Cross-modal retrieval relies on well-matched large-scale datasets that are laborious in practice. Recently, to alleviate expensive data collection, co-occurring pairs from the Internet are automatically harvested for training. However, it…

机器学习 · 计算机科学 2023-12-29 Zhuohang Dang , Minnan Luo , Chengyou Jia , Guang Dai , Xiaojun Chang , Jingdong Wang

Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could…

机器学习 · 计算机科学 2023-01-09 Mingcai Chen , Hao Cheng , Yuntao Du , Ming Xu , Wenyu Jiang , Chongjun Wang

Machine learning techniques are an active area of research for speech enhancement for hearing aids, with one particular focus on improving the intelligibility of a noisy speech signal. Recent work has shown that feature encodings from…

声音 · 计算机科学 2024-07-19 Robert Sutherland , George Close , Thomas Hain , Stefan Goetze , Jon Barker

Acquiring accurate labels on large-scale datasets is both time consuming and expensive. To reduce the dependency of deep learning models on learning from clean labeled data, several recent research efforts are focused on learning with noisy…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Arushi Goel , Yunlong Jiao , Jordan Massiah

Background noise reduces speech intelligibility and quality, making speaker verification (SV) in noisy environments a challenging task. To improve the noise robustness of SV systems, additive noise data augmentation method has been commonly…

音频与语音处理 · 电气工程与系统科学 2023-07-21 Wonbin Kim , Hyun-seo Shin , Ju-ho Kim , Jungwoo Heo , Chan-yeong Lim , Ha-Jin Yu