English
Related papers

Related papers: A Comparison of Speech Data Augmentation Methods U…

200 papers

Inspired by SpecAugment -- a data augmentation method for end-to-end ASR systems, we propose a frame-level SpecAugment method (f-SpecAugment) to improve the performance of deep convolutional neural networks (CNN) for hybrid HMM based ASR…

Computation and Language · Computer Science 2020-12-09 Xinwei Li , Yuanyuan Zhang , Xiaodan Zhuang , Daben Liu

Self-supervised pre-trained speech models were shown effective for various downstream speech processing tasks. Since they are mainly pre-trained to map input speech to pseudo-labels, the resulting representations are only effective for the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-09 Jingru Lin , Meng Ge , Wupeng Wang , Haizhou Li , Mengling Feng

Detection of some types of toxic language is hampered by extreme scarcity of labeled training data. Data augmentation - generating new synthetic data from a labeled seed dataset - can help. The efficacy of data augmentation on toxic…

Computation and Language · Computer Science 2020-10-27 Mika Juuti , Tommi Gröndahl , Adrian Flanagan , N. Asokan

Automatic Speech Recognition (ASR) is a key element in new services that helps users to interact with an automated system. Deep learning methods have made it possible to deploy systems with word error rates below 5% for ASR of English.…

Sound · Computer Science 2022-07-15 Rodolfo Zevallos , Nuria Bel , Guillermo Cámbara , Mireia Farrús , Jordi Luque

Recently, fine-tuning large pre-trained Transformer models using downstream datasets has received a rising interest. Despite their success, it is still challenging to disentangle the benefits of large-scale datasets and Transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Junyi Peng , Oldřich Plchot , Themos Stafylakis , Ladislav Mošner , Lukáš Burget , Jan Černocký

Regularization is important for end-to-end speech models, since the models are highly flexible and easy to overfit. Data augmentation and dropout has been important for improving end-to-end models in other domains. However, they are…

Computation and Language · Computer Science 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

We employ a combination of recent developments in semi-supervised learning for automatic speech recognition to obtain state-of-the-art results on LibriSpeech utilizing the unlabeled audio of the Libri-Light dataset. More precisely, we carry…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Yu Zhang , James Qin , Daniel S. Park , Wei Han , Chung-Cheng Chiu , Ruoming Pang , Quoc V. Le , Yonghui Wu

Multilingual speech recognition with supervised learning has achieved great results as reflected in recent research. With the development of pretraining methods on audio and text data, it is imperative to transfer the knowledge from…

Computation and Language · Computer Science 2022-05-26 Ngoc-Quan Pham , Alex Waibel , Jan Niehues

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Sebastian Braun , Ivan Tashev

End-to-end (E2E) multi-channel ASR systems show state-of-the-art performance in far-field ASR tasks by joint training of a multi-channel front-end along with the ASR model. The main limitation of such systems is that they are usually…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-24 Marco Gaudesi , Felix Weninger , Dushyant Sharma , Puming Zhan

Background noise reduces speech intelligibility and quality, making speaker verification (SV) in noisy environments a challenging task. To improve the noise robustness of SV systems, additive noise data augmentation method has been commonly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-21 Wonbin Kim , Hyun-seo Shin , Ju-ho Kim , Jungwoo Heo , Chan-yeong Lim , Ha-Jin Yu

This paper introduces three self-contained data augmentation methods for low-resource Automatic Speech Recognition (ASR). Our techniques first generate novel text--using gloss-based replacement, random replacement, or an LLM-based…

Computation and Language · Computer Science 2026-01-21 Katsumi Ibaraki , David Chiang

Data augmentation is vital to the generalization ability and robustness of deep neural networks (DNNs) models. Existing augmentation methods for speaker verification manipulate the raw signal, which are time-consuming and the augmented…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-19 Yuanyuan Wang , Yang Zhang , Zhiyong Wu , Zhihan Yang , Tao Wei , Kun Zou , Helen Meng

The effects of speaking-style variability on automatic speaker verification were investigated using the UCLA Speaker Variability database which comprises multiple speaking styles per speaker. An x-vector/PLDA (probabilistic linear…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Amber Afshan , Jinxi Guo , Soo Jin Park , Vijay Ravi , Alan McCree , Abeer Alwan

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve…

Computation and Language · Computer Science 2022-04-04 Rodolfo Zevallos

In recent years, neural models trained on large multilingual text and speech datasets have shown great potential for supporting low-resource languages. This study investigates the performances of two state-of-the-art Automatic Speech…

Computation and Language · Computer Science 2025-07-03 Md Sazzadul Islam Ridoy , Sumi Akter , Md. Aminur Rahman

Most speech enhancement algorithms make use of the short-time Fourier transform (STFT), which is a simple and flexible time-frequency decomposition that estimates the short-time spectrum of a signal. However, the duration of short STFT…

Sound · Computer Science 2015-09-03 Scott Wisdom , Thomas Powers , Les Atlas , James Pitton

In this paper, we aim to unveil the impact of data augmentation in audio-language multi-modal learning, which has not been explored despite its importance. We explore various augmentation methods at not only train-time but also test-time…

Sound · Computer Science 2023-05-24 Eungbeom Kim , Jinhee Kim , Yoori Oh , Kyungsu Kim , Minju Park , Jaeheon Sim , Jinwoo Lee , Kyogu Lee

Speech Recognition (ASR) due to phoneme distortions and high variability. While self-supervised ASR models like Wav2Vec, HuBERT, and Whisper have shown promise, their effectiveness in dysarthric speech remains unclear. This study…

Sound · Computer Science 2025-08-12 Ahmed Aboeitta , Ahmed Sharshar , Youssef Nafea , Shady Shehata

Pretrained neural models such as BERT, when fine-tuned to perform natural language inference (NLI), often show high accuracy on standard datasets, but display a surprising lack of sensitivity to word order on controlled challenge sets. We…

Computation and Language · Computer Science 2020-04-28 Junghyun Min , R. Thomas McCoy , Dipanjan Das , Emily Pitler , Tal Linzen