English
Related papers

Related papers: PhasePerturbation: Speech Data Augmentation via Ph…

200 papers

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe

Whispering is a distinct form of speech known for its soft, breathy, and hushed characteristics, often used for private communication. The acoustic characteristics of whispered speech differ substantially from normally phonated speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Zhaofeng Lin , Tanvina Patel , Odette Scharenborg

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

The automatic recognition of pathological speech, particularly from children with any articulatory impairment, is a challenging task due to various reasons. The lack of available domain specific data is one such obstacle that hinders its…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Protima Nomo Sudro , Rohan Kumar Das , Rohit Sinha , S. R. Mahadeva Prasanna

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create…

Sound · Computer Science 2024-06-12 Zhenyu Zhou , Shibiao Xu , Shi Yin , Lantian Li , Dong Wang

A two-step enhancement method based on spectral subtraction and phase spectrum compensation is presented in this paper for noisy speeches in adverse environments involving non-stationary noise and medium to low levels of SNR. The magnitude…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-02 Md Tauhidul Islam , Asaduzzaman , Celia Shahnaz , Wei-Ping Zhu , M. Omair Ahmad

Acoustic environments affect acoustic characteristics of sound to be recognized by physically interacting with sound wave propagation. Thus, training acoustic models for audio and speech tasks requires regularization on various acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Hyeonuk Nam , Seong-Hu Kim , Yong-Hwa Park

Inspired by SpecAugment -- a data augmentation method for end-to-end ASR systems, we propose a frame-level SpecAugment method (f-SpecAugment) to improve the performance of deep convolutional neural networks (CNN) for hybrid HMM based ASR…

Computation and Language · Computer Science 2020-12-09 Xinwei Li , Yuanyuan Zhang , Xiaodan Zhuang , Daben Liu

Recently, SpecAugment, an augmentation scheme for automatic speech recognition that acts directly on the spectrogram of input utterances, has shown to be highly effective in enhancing the performance of end-to-end networks on public…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-12 Daniel S. Park , Yu Zhang , Chung-Cheng Chiu , Youzheng Chen , Bo Li , William Chan , Quoc V. Le , Yonghui Wu

Multimodal speech recognition aims to improve the performance of automatic speech recognition (ASR) systems by leveraging additional visual information that is usually associated to the audio input. While previous approaches make crucial…

Sound · Computer Science 2022-04-29 Dan Oneata , Horia Cucu

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

End-to-end models have achieved significant improvement on automatic speech recognition. One common method to improve performance of these models is expanding the data-space through data augmentation. Meanwhile, human auditory inspired…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-12 Zehai Tu , Jack Deadman , Ning Ma , Jon Barker

Aiming at reducing the reliance on expensive human annotations, data synthesis for Automatic Speech Recognition (ASR) has remained an active area of research. While prior work mainly focuses on synthetic speech generation for ASR data…

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve…

Computation and Language · Computer Science 2022-04-04 Rodolfo Zevallos

We examine the effect of data augmentation for training of language models for speech recognition. We compare augmentation based on global error statistics with one based on per-word unigram statistics of ASR errors and observe that it is…

Computation and Language · Computer Science 2020-11-13 Karel Beneš , Lukáš Burget

Automatic lyrics transcription (ALT), which can be regarded as automatic speech recognition (ASR) on singing voice, is an interesting and practical topic in academia and industry. ALT has not been well developed mainly due to the dearth of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-20 Chen Zhang , Jiaxing Yu , LuChin Chang , Xu Tan , Jiawei Chen , Tao Qin , Kejun Zhang

In this paper, a speech enhancement method based on noise compensation performed on short time magnitude as well phase spectra is presented. Unlike the conventional geometric approach (GA) to spectral subtraction (SS), here the noise…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-09 Md Tauhidul Islam , Udoy Saha , K. T. Shahid , Ahmed Bin Hussain , Celia Shahnaz

Speech processing systems rely on robust feature extraction to handle phonetic and semantic variations found in natural language. While techniques exist for desensitizing features to common noise patterns produced by Speech-to-Text (STT)…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-14 Chris Larson , Tarek Lahlou , Diana Mingels , Zachary Kulis , Erik Mueller

Data augmentation has proven to be a promising prospect in improving the performance of deep learning models by adding variability to training data. In previous work with developing a noise robust acoustic-to-articulatory speech inversion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Yashish M. Siriwardena , Ahmed Adel Attia , Ganesh Sivaraman , Carol Espy-Wilson