English
Related papers

Related papers: Automatic Speech Recognition of Low-Resource Langu…

200 papers

This paper is an extension of our previous conference paper. In recent years, there has been a growing interest among researchers in developing and improving speech recognition systems to facilitate and enhance human-computer interaction.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-08 Jawid Ahmad Baktash , Mursal Dawodi

Recent years have witnessed significant progress in multilingual automatic speech recognition (ASR), driven by the emergence of end-to-end (E2E) models and the scaling of multilingual datasets. Despite that, two main challenges persist in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Zheshu Song , Jianheng Zhuo , Yifan Yang , Ziyang Ma , Shixiong Zhang , Xie Chen

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

We propose new, data-efficient training tasks for BERT models that improve performance of automatic speech recognition (ASR) systems on conversational speech. We include past conversational context and fine-tune BERT on transcript…

Computation and Language · Computer Science 2022-01-26 Pablo Ortiz , Simen Burud

Many automatic speech recognition (ASR) data sets include a single pre-defined test set consisting of one or more speakers whose speech never appears in the training set. This "hold-speaker(s)-out" data partitioning strategy, however, may…

Computation and Language · Computer Science 2022-08-30 Zoey Liu , Justin Spence , Emily Prud'hommeaux

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

Computation and Language · Computer Science 2022-05-26 Akshat Gupta

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

End-to-end automatic speech recognition systems represent the state of the art, but they rely on thousands of hours of manually annotated speech for training, as well as heavyweight computation for inference. Of course, this impedes…

Computation and Language · Computer Science 2022-11-22 Raphael Tang , Karun Kumar , Gefei Yang , Akshat Pandey , Yajie Mao , Vladislav Belyaev , Madhuri Emmadi , Craig Murray , Ferhan Ture , Jimmy Lin

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

Sound · Computer Science 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

We consider hate speech detection through keyword spotting on radio broadcasts. One approach is to build an automatic speech recognition (ASR) system for the target low-resource language. We compare this to using acoustic word embedding…

Computation and Language · Computer Science 2023-06-02 Christiaan Jacobs , Nathanaël Carraz Rakotonirina , Everlyn Asiko Chimoto , Bruce A. Bassett , Herman Kamper

In this paper we address the challenge of improving Automatic Speech Recognition (ASR) for a low-resource language, Hawaiian, by incorporating large amounts of independent text data into an ASR foundation model, Whisper. To do this, we…

Computation and Language · Computer Science 2024-04-05 Kaavya Chaparala , Guido Zarrella , Bruce Torres Fischer , Larry Kimura , Oiwi Parker Jones

We propose a general framework to compute the word error rate (WER) of ASR systems that process recordings containing multiple speakers at their input and that produce multiple output word sequences (MIMO). Such ASR systems are typically…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-24 Thilo von Neumann , Christoph Boeddeker , Keisuke Kinoshita , Marc Delcroix , Reinhold Haeb-Umbach

Developing automatic speech recognition (ASR) systems for low-resource languages is hindered by the scarcity of transcribed corpora. This proof-of-concept study explores songs as an unconventional yet promising data source for Kazakh ASR.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Rustem Yeshpanov

Automatic Speech Recognition (ASR) transcription errors are commonly assessed using metrics that compare them with a reference transcription, such as Word Error Rate (WER), which measures spelling deviations from the reference, or semantic…

Computation and Language · Computer Science 2025-01-22 Antoine Tholly , Jane Wottawa , Mickael Rouvier , Richard Dufour

Automatic speech recognition (ASR) has the potential to substantially reduce manual annotation effort in child speech research by generating automatic transcriptions. However, obtaining reliably high-quality ASR transcriptions for child…

Computation and Language · Computer Science 2026-05-29 Gus Lathouwers , Lingyun Gao , Catia Cucchiarini , Helmer Strik

Traditional ASR metrics like WER and CER fail to capture intelligibility, especially for dysarthric and dysphonic speech, where semantic alignment matters more than exact word matches. ASR systems struggle with these speech types, often…

Machine Learning · Computer Science 2025-12-12 Bornali Phukon , Xiuwen Zheng , Mark Hasegawa-Johnson

We study the problem of evaluating automatic speech recognition (ASR) systems that target dialectal speech input. A major challenge in this case is that the orthography of dialects is typically not standardized. From an ASR evaluation…

Computation and Language · Computer Science 2017-09-25 Ahmed Ali , Preslav Nakov , Peter Bell , Steve Renals

We describe our end-to-end system for Bengali long-form speech recognition (ASR) and speaker diarization submitted to the DL Sprint 4.0 competition on Kaggle. Bengali presents substantial challenges for both tasks: a large phoneme…

Computation and Language · Computer Science 2026-02-26 MD. Sagor Chowdhury , Adiba Fairooz Chowdhury

Pre-trained transformer-based models have significantly advanced automatic speech recognition (ASR), yet they remain sensitive to accent and dialectal variations, resulting in elevated word error rates (WER) in linguistically diverse…

Computation and Language · Computer Science 2025-10-13 Mohammad Hossein Sameti , Sepehr Harfi Moridani , Ali Zarean , Hossein Sameti

We present a method for cross-lingual training an ASR system using absolutely no transcribed training data from the target language, and with no phonetic knowledge of the language in question. Our approach uses a novel application of a…

Computation and Language · Computer Science 2022-06-07 Ondrej Klejch , Electra Wallington , Peter Bell