中文
相关论文

相关论文: Consistency Based Unsupervised Self-training For A…

200 篇论文

Automatic speech recognition (ASR) systems often degrade on accented speech because acoustic-phonetic and prosodic shifts induce a mismatch to training data, making labeled accent adaptation costly. However, common pseudo-label selection…

计算与语言 · 计算机科学 2026-02-17 Ligong Lei , Wenwen Lu , Xudong Pang , Zaokere Kadeer , Aishan Wumaier

In this work, we develop new self-learning techniques with an attention-based sequence-to-sequence (seq2seq) model for automatic speech recognition (ASR). For untranscribed speech data, the hypothesis from an ASR system must be used as a…

计算与语言 · 计算机科学 2021-12-23 Kenichi Kumatani , Dimitrios Dimitriadis , Yashesh Gaur , Robert Gmyr , Sefik Emre Eskimez , Jinyu Li , Michael Zeng

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

计算与语言 · 计算机科学 2025-08-21 Shaoshi Ling , Guoli Ye

Self-supervised learning of speech representations has achieved impressive results in improving automatic speech recognition (ASR). In this paper, we show that data selection is important for self-supervised learning. We propose a simple…

音频与语音处理 · 电气工程与系统科学 2022-04-06 Zhiyun Lu , Yongqiang Wang , Yu Zhang , Wei Han , Zhehuai Chen , Parisa Haghani

Semi-supervised learning lately has shown much promise in improving deep learning models when labeled data is scarce. Common among recent approaches is the use of consistency training on a large amount of unlabeled data to constrain model…

机器学习 · 计算机科学 2020-11-06 Qizhe Xie , Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le

Automatic speech recognition (ASR) models rely on high-quality transcribed data for effective training. Generating pseudo-labels for large unlabeled audio datasets often relies on complex pipelines that combine multiple ASR outputs through…

音频与语音处理 · 电气工程与系统科学 2025-10-06 Jeena Prakash , Blessingh Kumar , Kadri Hacioglu , Bidisha Sharma , Sindhuja Gopalan , Malolan Chetlur , Shankar Venkatesan , Andreas Stolcke

Automatic speech recognition (ASR) models with low-footprint are increasingly being deployed on edge devices for conversational agents, which enhances privacy. We study the problem of federated continual incremental learning for recurrent…

音频与语音处理 · 电气工程与系统科学 2023-06-22 Milind Rao , Gopinath Chennupati , Gautam Tiwari , Anit Kumar Sahu , Anirudh Raju , Ariya Rastrow , Jasha Droppo

Self-training (ST) and self-supervised learning (SSL) methods have demonstrated strong improvements in automatic speech recognition (ASR). In spite of these advances, to the best of our knowledge, there is no analysis of how the composition…

机器学习 · 计算机科学 2023-03-03 Dan Berrebbi , Ronan Collobert , Navdeep Jaitly , Tatiana Likhomanenko

Data augmentation (DA) is ubiquitously used in training of Automatic Speech Recognition (ASR) models. DA offers increased data variability, robustness and generalization against different acoustic distortions. Recently, personalization of…

音频与语音处理 · 电气工程与系统科学 2025-01-20 Pablo Peso Parada , Spyros Fontalis , Md Asif Jalal , Karthikeyan Saravanan , Anastasios Drosou , Mete Ozay , Gil Ho Lee , Jungin Lee , Seokyeong Jung

Despite recent advancements in deep learning technologies, Child Speech Recognition remains a challenging task. Current Automatic Speech Recognition (ASR) models require substantial amounts of annotated data for training, which is scarce.…

音频与语音处理 · 电气工程与系统科学 2023-02-14 Rishabh Jain , Andrei Barcovschi , Mariam Yiwere , Dan Bigioi , Peter Corcoran , Horia Cucu

Semi-supervised training (SST) is a common approach to leverage untranscribed/unlabeled speech data to improve automatic speech recognition performance in low-resource languages. However, if the available unlabeled speech is mismatched to…

计算与语言 · 计算机科学 2021-06-03 Jayadev Billa

Personalizing dysarthric ASR is hindered by demanding enrollment collection and per-user training. We propose a hybrid meta-training method for a single model, enabling zero-shot and few-shot on-the-fly personalization via in-context…

音频与语音处理 · 电气工程与系统科学 2026-02-24 Dhruuv Agarwal , Harry Zhang , Yang Yu , Quan Wang

Self-supervised Transformer based models, such as wav2vec 2.0 and HuBERT, have produced significant improvements over existing approaches to automatic speech recognition (ASR). This is evident in the performance of the wav2vec 2.0 based…

计算与语言 · 计算机科学 2022-07-05 Mitchell DeHaven , Jayadev Billa

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

声音 · 计算机科学 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

Automatic speech recognition (ASR) has been widely researched with supervised approaches, while many low-resourced languages lack audio-text aligned data, and supervised methods cannot be applied on them. In this work, we propose a…

计算与语言 · 计算机科学 2018-08-14 Yi-Chen Chen , Chia-Hao Shen , Sung-Feng Huang , Hung-yi Lee

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

We propose an unsupervised adaptation framework, Self-TAught Recognizer (STAR), which leverages unlabeled data to enhance the robustness of automatic speech recognition (ASR) systems in diverse target domains, such as noise and accents.…

计算与语言 · 计算机科学 2024-05-24 Yuchen Hu , Chen Chen , Chao-Han Huck Yang , Chengwei Qin , Pin-Yu Chen , Eng Siong Chng , Chao Zhang

Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool.…

计算与语言 · 计算机科学 2022-12-21 Mozhdeh Gheini , Tatiana Likhomanenko , Matthias Sperber , Hendra Setiawan

Recently, there has been a vast interest in self-supervised learning (SSL) where the model is pre-trained on large scale unlabeled data and then fine-tuned on a small labeled dataset. The common wisdom is that SSL helps resource-limited…

音频与语音处理 · 电气工程与系统科学 2021-07-13 Chengyi Wang , Yu Wu , Shujie Liu , Jinyu Li , Yao Qian , Kenichi Kumatani , Furu Wei

Semi-supervised learning (SSL) is an active area of research which aims to utilize unlabelled data in order to improve the accuracy of speech recognition systems. The current study proposes a methodology for integration of two key ideas: 1)…

计算与语言 · 计算机科学 2020-08-11 Prakhar Swarup , Debmalya Chakrabarty , Ashtosh Sapru , Hitesh Tulsiani , Harish Arsikere , Sri Garimella