English
Related papers

Related papers: Auditory-Based Data Augmentation for End-to-End Au…

200 papers

Recently, SpecAugment, an augmentation scheme for automatic speech recognition that acts directly on the spectrogram of input utterances, has shown to be highly effective in enhancing the performance of end-to-end networks on public…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-12 Daniel S. Park , Yu Zhang , Chung-Cheng Chiu , Youzheng Chen , Bo Li , William Chan , Quoc V. Le , Yonghui Wu

This work investigates a simple data augmentation technique, SpecAugment, for end-to-end speech translation. SpecAugment is a low-cost implementation method applied directly to the audio input features and it consists of masking blocks of…

Computation and Language · Computer Science 2019-11-21 Parnia Bahar , Albert Zeyer , Ralf Schlüter , Hermann Ney

Regularization is important for end-to-end speech models, since the models are highly flexible and easy to overfit. Data augmentation and dropout has been important for improving end-to-end models in other domains. However, they are…

Computation and Language · Computer Science 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Training a code-switching end-to-end automatic speech recognition (ASR) model normally requires a large amount of data, while code-switching data is often limited. In this paper, three novel approaches are proposed for code-switching data…

Computation and Language · Computer Science 2024-11-05 Chenpeng Du , Hao Li , Yizhou Lu , Lan Wang , Yanmin Qian

Recent advancements in AI have democratized its deployment as a healthcare assistant. While pretrained models from large-scale visual and audio datasets have demonstrably generalized to this task, surprisingly, no studies have explored…

Sound · Computer Science 2024-05-07 June-Woo Kim , Miika Toikkanen , Sangmin Bae , Minseok Kim , Ho-Young Jung

We present our experiments in training robust to noise an end-to-end automatic speech recognition (ASR) model using intensive data augmentation. We explore the efficacy of fine-tuning a pre-trained model to improve noise robustness, and we…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Jagadeesh Balam , Jocelyn Huang , Vitaly Lavrukhin , Slyne Deng , Somshubra Majumdar , Boris Ginsburg

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

Computation and Language · Computer Science 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

We present SpecAugment, a simple data augmentation method for speech recognition. SpecAugment is applied directly to the feature inputs of a neural network (i.e., filter bank coefficients). The augmentation policy consists of warping the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-04 Daniel S. Park , William Chan , Yu Zhang , Chung-Cheng Chiu , Barret Zoph , Ekin D. Cubuk , Quoc V. Le

In this paper, we perform an in-depth study of how data augmentation techniques improve synthetic or spoofed audio detection. Specifically, we propose methods to deal with channel variability, different audio compressions, different…

Sound · Computer Science 2021-10-22 Ariel Cohen , Inbal Rimon , Eran Aflalo , Haim Permuter

End-to-end speech translation relies on data that pair source-language speech inputs with corresponding translations into a target language. Such data are notoriously scarce, making synthetic data augmentation by back-translation or…

Computation and Language · Computer Science 2023-06-12 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li

We propose autoencoding speaker conversion for training data augmentation in automatic speech translation. This technique directly transforms an audio sequence, resulting in audio synthesized to resemble another speaker's voice. Our method…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-28 Arya D. McCarthy , Liezl Puzon , Juan Pino

Recently, end-to-end (E2E) automatic speech recognition (ASR) models have made great strides and exhibit excellent performance in general speech recognition. However, there remain several challenging scenarios that E2E models are not…

Computation and Language · Computer Science 2023-06-16 Zheng Liang , Zheshu Song , Ziyang Ma , Chenpeng Du , Kai Yu , Xie Chen

Data augmentation has proven to be a promising prospect in improving the performance of deep learning models by adding variability to training data. In previous work with developing a noise robust acoustic-to-articulatory speech inversion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Yashish M. Siriwardena , Ahmed Adel Attia , Ganesh Sivaraman , Carol Espy-Wilson

While efficient architectures and a plethora of augmentations for end-to-end image classification tasks have been suggested and heavily investigated, state-of-the-art techniques for audio classifications still rely on numerous…

Sound · Computer Science 2022-07-06 Avi Gazneli , Gadi Zimerman , Tal Ridnik , Gilad Sharir , Asaf Noy

Recent advances in text-to-speech (TTS) led to the development of flexible multi-speaker end-to-end TTS systems. We extend state-of-the-art attention-based automatic speech recognition (ASR) systems with synthetic audio generated by a TTS…

Computation and Language · Computer Science 2020-02-18 Nick Rossenbach , Albert Zeyer , Ralf Schlüter , Hermann Ney

Previous work on speaker adaptation for end-to-end speech synthesis still falls short in speaker similarity. We investigate an orthogonal approach to the current speaker adaptation paradigms, speaker augmentation, by creating artificial…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Erica Cooper , Cheng-I Lai , Yusuke Yasuda , Junichi Yamagishi
‹ Prev 1 2 3 10 Next ›