English
Related papers

Related papers: Semantic Data Augmentation for End-to-End Mandarin…

200 papers

Recently Convolution-augmented Transformer (Conformer) has shown promising results in Automatic Speech Recognition (ASR), outperforming the previous best published Transformer Transducer. In this work, we believe that the output information…

Computation and Language · Computer Science 2022-12-02 Xiaoming Ren , Huifeng Zhu , Liuwei Wei , Minghui Wu , Jie Hao

Data augmentation is a widely adopted technique utilized to improve the robustness of automatic speech recognition (ASR). Employing a fixed data augmentation strategy for all training data is a common practice. However, it is important to…

Sound · Computer Science 2024-12-03 Hongxuan Lu , Biao Li

Automatic recognition of dysarthric speech remains a highly challenging task to date. Neuro-motor conditions and co-occurring physical disabilities create difficulty in large-scale data collection for ASR system development. Adapting SSL…

Sound · Computer Science 2024-01-02 Huimeng Wang , Zengrui Jin , Mengzhe Geng , Shujie Hu , Guinan Li , Tianzi Wang , Haoning Xu , Xunying Liu

In this paper, we demonstrate the efficacy of transfer learning and continuous learning for various automatic speech recognition (ASR) tasks. We start with a pre-trained English ASR model and show that transfer learning can be effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-12 Jocelyn Huang , Oleksii Kuchaiev , Patrick O'Neill , Vitaly Lavrukhin , Jason Li , Adriana Flores , Georg Kucsko , Boris Ginsburg

Building an accurate automatic speech recognition (ASR) system requires a large dataset that contains many hours of labeled speech samples produced by a diverse set of speakers. The lack of such open free datasets is one of the main issues…

Computation and Language · Computer Science 2018-11-05 Jason Li , Ravi Gadde , Boris Ginsburg , Vitaly Lavrukhin

Modeling code-switched speech is an important problem in automatic speech recognition (ASR). Labeled code-switched data are rare, so monolingual data are often used to model code-switched speech. These monolingual data may be more closely…

Computation and Language · Computer Science 2021-06-16 Andrew Slottje , Shannon Wotherspoon , William Hartmann , Matthew Snover , Owen Kimball

This paper presents a method to train end-to-end automatic speech recognition (ASR) models using unpaired data. Although the end-to-end approach can eliminate the need for expert knowledge such as pronunciation dictionaries to build ASR…

Computation and Language · Computer Science 2019-05-24 Takaaki Hori , Ramon Astudillo , Tomoki Hayashi , Yu Zhang , Shinji Watanabe , Jonathan Le Roux

Automatic lyrics transcription (ALT), which can be regarded as automatic speech recognition (ASR) on singing voice, is an interesting and practical topic in academia and industry. ALT has not been well developed mainly due to the dearth of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-20 Chen Zhang , Jiaxing Yu , LuChin Chang , Xu Tan , Jiawei Chen , Tao Qin , Kejun Zhang

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

Training deep neural networks for automatic speech recognition (ASR) requires large amounts of transcribed speech. This becomes a bottleneck for training robust models for accented speech which typically contains high variability in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-11 Nilaksh Das , Sravan Bodapati , Monica Sunkara , Sundararajan Srinivasan , Duen Horng Chau

Automatic speech recognition (ASR) systems are typically optimized for verbatim transcription, which preserves disfluencies, filler words, and informal spoken structures that are often unsuitable for downstream writing-oriented…

Computation and Language · Computer Science 2026-05-20 Wanyi Ning , Yinshang Guo , Haitao Qian , Jiyuan Cheng , Weiyuan Feng , Yufei Zhang

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jenthe Thienpondt , Kris Demuynck

The performance of automatic speech recognition (ASR) systems has advanced substantially in recent years, particularly for languages for which a large amount of transcribed speech is available. Unfortunately, for low-resource languages,…

Computation and Language · Computer Science 2023-05-22 Martijn Bartelds , Nay San , Bradley McDonnell , Dan Jurafsky , Martijn Wieling

The awareness for biased ASR datasets or models has increased notably in recent years. Even for English, despite a vast amount of available training data, systems perform worse for non-native speakers. In this work, we improve an…

Computation and Language · Computer Science 2023-03-03 Philipp Klumpp , Pooja Chitkara , Leda Sarı , Prashant Serai , Jilong Wu , Irina-Elena Veliche , Rongqing Huang , Qing He

Form about four decades human beings have been dreaming of an intelligent machine which can master the natural speech. In its simplest form, this machine should consist of two subsystems, namely automatic speech recognition (ASR) and speech…

Sound · Computer Science 2013-05-08 Urmila Shrawankar , V. M. Thakare

End-to-end neural automatic speech recognition systems achieved recently state-of-the-art results, but they require large datasets and extensive computing resources. Transfer learning has been proposed to overcome these difficulties even…

Computation and Language · Computer Science 2021-09-03 Peter Polák , Ondřej Bojar

End-to-end approaches have drawn much attention recently for significantly simplifying the construction of an automatic speech recognition (ASR) system. RNN transducer (RNN-T) is one of the popular end-to-end methods. Previous studies have…

Computation and Language · Computer Science 2019-04-24 Senmao Wang , Pan Zhou , Wei Chen , Jia Jia , Lei Xie

Subword units are commonly used for end-to-end automatic speech recognition (ASR), while a fully acoustic-oriented subword modeling approach is somewhat missing. We propose an acoustic data-driven subword modeling (ADSM) approach that…

Computation and Language · Computer Science 2023-10-24 Wei Zhou , Mohammad Zeineldeen , Zuoyun Zheng , Ralf Schlüter , Hermann Ney

Data augmentation is a ubiquitous technique used to provide robustness to automatic speech recognition (ASR) training. However, even as so much of the ASR training process has become automated and more "end-to-end", the data augmentation…

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

Computation and Language · Computer Science 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze