English
Related papers

Related papers: Reduce, Reuse, Recycle: Is Perturbed Data better t…

200 papers

Unsupervised cross-lingual speech representation learning (XLSR) has recently shown promising results in speech recognition by leveraging vast amounts of unlabeled data across multiple languages. However, standard XLSR model suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-10 Yizhou Lu , Mingkun Huang , Xinghua Qu , Pengfei Wei , Zejun Ma

Self-supervised pre-training using unlabeled data is widely used in automatic speech recognition. In this paper, we propose a new self-supervised pre-training approach to dealing with heterogeneous data. Instead of mixing all the data and…

Machine Learning · Computer Science 2025-09-10 Xiaodong Cui , A F M Saif , Brian Kingsbury , Tianyi Chen

In this paper, we analyzed how audio-visual speech enhancement can help to perform the ASR task in a cocktail party scenario. Therefore we considered two simple end-to-end LSTM-based models that perform single-channel audio-visual speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-28 Luca Pasa , Giovanni Morrone , Leonardo Badino

This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model. We trained a neural network,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Shuo Liu , Leda Sarı , Chunyang Wu , Gil Keren , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli

Speech Emotion Recognition (SER) has seen significant progress with deep learning, yet remains challenging for Low-Resource Languages (LRLs) due to the scarcity of annotated data. In this work, we explore unsupervised learning to improve…

Sound · Computer Science 2025-06-04 Ziwei Gong , Pengyuan Shi , Kaan Donbekci , Lin Ai , Run Chen , David Sasu , Zehui Wu , Julia Hirschberg

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Sebastian Braun , Ivan Tashev

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin

Labeled audio data is insufficient to build satisfying speech recognition systems for most of the languages in the world. There have been some zero-resource methods trying to perform phoneme or word-level speech recognition without labeled…

Computation and Language · Computer Science 2025-01-14 Haoyu Wang , Wei-Qiang Zhang , Hongbin Suo , Yulong Wan

This study investigates the efficacy of data augmentation techniques for low-resource automatic speech recognition (ASR), focusing on two endangered Austronesian languages, Amis and Seediq. Recognizing the potential of self-supervised…

Computation and Language · Computer Science 2025-10-01 Yao-Fei Cheng , Li-Wei Chen , Hung-Shin Lee , Hsin-Min Wang

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

Recognition of accented speech is a long-standing challenge for automatic speech recognition (ASR) systems, given the increasing worldwide population of bi-lingual speakers with English as their second language. If we consider…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-22 Shahram Ghorbani , John H. L. Hansen

Automatic Speech Recognition (ASR) models demonstrate outstanding performance on high-resource languages but face significant challenges when applied to low-resource languages due to limited training data and insufficient cross-lingual…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Ming-Hao Hsu , Hung-yi Lee

Aiming at reducing the reliance on expensive human annotations, data synthesis for Automatic Speech Recognition (ASR) has remained an active area of research. While prior work mainly focuses on synthetic speech generation for ASR data…

Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effective self-supervised learning framework and a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-03 Mufan Sang , Haoqi Li , Fang Liu , Andrew O. Arnold , Li Wan

This paper proposes a novel linear prediction coding-based data aug-mentation method for children's low and zero resource dialect ASR. The data augmentation procedure consists of perturbing the formant peaks of the LPC spectrum during LPC…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Alexander Johnson , Ruchao Fan , Robin Morris , Abeer Alwan

Despite the recent success on image classification, self-training has only achieved limited gains on structured prediction tasks such as neural machine translation (NMT). This is mainly due to the compositionality of the target space, where…

Computation and Language · Computer Science 2020-12-08 Minkai Xu , Mingxuan Wang , Zhouhan Lin , Hao Zhou , Weinan Zhang , Lei Li

We explore training attention-based encoder-decoder ASR in low-resource settings. These models perform poorly when trained on small amounts of transcribed speech, in part because they depend on having sufficient target-side text to train…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-06 Matthew Wiesner , Adithya Renduchintala , Shinji Watanabe , Chunxi Liu , Najim Dehak , Sanjeev Khudanpur

Speech enhancement (SE) is usually required as a front end to improve the speech quality in noisy environments, while the enhanced speech might not be optimal for automatic speech recognition (ASR) systems due to speech distortion. On the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-27 Qiu-Shi Zhu , Jie Zhang , Zi-Qiang Zhang , Li-Rong Dai

Self-supervised Transformer based models, such as wav2vec 2.0 and HuBERT, have produced significant improvements over existing approaches to automatic speech recognition (ASR). This is evident in the performance of the wav2vec 2.0 based…

Computation and Language · Computer Science 2022-07-05 Mitchell DeHaven , Jayadev Billa

Single-channel speech enhancement is utilized in various tasks to mitigate the effect of interfering signals. Conventionally, to ensure the speech enhancement performs optimally, the speech enhancement has needed to be tuned for each task.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-11 Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Takafumi Moriya , Takanori Ashihara , Ryo Masumura