English
Related papers

Related papers: Dialect Matters: Cross-Lingual ASR Transfer for Lo…

200 papers

Code-switching-where multilingual speakers alternately switch between languages during conversations-still poses significant challenges to end-to-end (E2E) automatic speech recognition (ASR) systems due to phenomena of both acoustic and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-13 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Berlin Chen

This paper explores the pitfalls in evaluating multilingual automatic speech recognition (ASR) models, with a particular focus on Indic language scripts. We investigate the text normalization routine employed by leading ASR models,…

Computation and Language · Computer Science 2024-11-12 Kavya Manohar , Leena G Pillai , Elizabeth Sherly

Building an automatic speech recognition (ASR) system from scratch requires a large amount of annotated speech data, which is difficult to collect in many languages. However, there are cases where the low-resource language shares a common…

Computation and Language · Computer Science 2021-09-17 Anoop C S , Prathosh A P , A G Ramakrishnan

Despite the growing advancements in Automatic Speech Recognition (ASR) models, the development of robust models for underrepresented languages, such as Nepali, remains a challenge. This research focuses on making an exhaustive and…

Computation and Language · Computer Science 2024-11-20 Sanjay Rijal , Shital Adhikari , Manish Dahal , Manish Awale , Vaghawan Ojha

Automatic Speech Recognition (ASR) for Bengali, the world's fifth most spoken language, remains a significant challenge, critically hindering technological accessibility for its over 270 million speakers. This challenge is compounded by two…

Sound · Computer Science 2025-09-03 Swadhin Biswas , Imran , Tuhin Sheikh

Pre-trained transformer-based models have significantly advanced automatic speech recognition (ASR), yet they remain sensitive to accent and dialectal variations, resulting in elevated word error rates (WER) in linguistically diverse…

Computation and Language · Computer Science 2025-10-13 Mohammad Hossein Sameti , Sepehr Harfi Moridani , Ali Zarean , Hossein Sameti

Automatic speech recognition (ASR) for African languages remains constrained by limited labeled data and the lack of systematic guidance on model selection, data scaling, and decoding strategies. Large pre-trained systems such as Whisper,…

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

Cross-lingual and multi-lingual training of Automatic Speech Recognition (ASR) has been extensively investigated in the supervised setting. This assumes the existence of a parallel corpus of speech and orthographic transcriptions. Recently,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-10 Morgane Rivière , Armand Joulin , Pierre-Emmanuel Mazaré , Emmanuel Dupoux

Despite the impressive performance recently achieved by automatic speech recognition (ASR), we observe two primary challenges that hinder its broader applications: (1) The difficulty of introducing scalability into the model to support more…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Zhongzhi Yu , Yang Zhang , Kaizhi Qian , Yonggan Fu , Yingyan Lin

An effective approach to the development of ASR systems for low-resource languages is to fine-tune an existing multilingual end-to-end model. When the original model has been trained on large quantities of data from many languages,…

Computation and Language · Computer Science 2025-06-06 Ondřej Klejch , William Lamb , Peter Bell

Building a multilingual Automated Speech Recognition (ASR) system in a linguistically diverse country like India can be a challenging task due to the differences in scripts and the limited availability of speech data. This problem can be…

Computation and Language · Computer Science 2023-06-01 Kaousheik Jayakumar , Vrunda N. Sukhadia , A Arunkumar , S. Umesh

Cross-lingual transfer, where a high-resource transfer language is used to improve the accuracy of a low-resource task language, is now an invaluable tool for improving performance of natural language processing (NLP) on low-resource…

This work explores better adaptation methods to low-resource languages using an external language model (LM) under the framework of transfer learning. We first build a language-independent ASR system in a unified sequence-to-sequence (S2S)…

Computation and Language · Computer Science 2019-05-08 Hirofumi Inaguma , Jaejin Cho , Murali Karthick Baskar , Tatsuya Kawahara , Shinji Watanabe

This paper describes the systems developed by SPRING Lab, Indian Institute of Technology Madras, for the ASRU MADASR 2.0 challenge. The systems developed focuses on adapting ASR systems to improve in predicting the language and dialect of…

Computation and Language · Computer Science 2025-11-20 Arjun Gangwar , Kaousheik Jayakumar , S. Umesh

Low-resource languages, by its very definition, tend to be under represented in the pre-training corpora of Large Language Models. In this work, we investigate three low-resource cross-lingual approaches that enable an LLM adapt to tasks in…

Computation and Language · Computer Science 2024-06-26 Vaibhav Singh , Amrith Krishna , Karthika NJ , Ganesh Ramakrishnan

We explore training attention-based encoder-decoder ASR in low-resource settings. These models perform poorly when trained on small amounts of transcribed speech, in part because they depend on having sufficient target-side text to train…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-06 Matthew Wiesner , Adithya Renduchintala , Shinji Watanabe , Chunxi Liu , Najim Dehak , Sanjeev Khudanpur

Automatic speech recognition (ASR) for low-resource languages remains a challenge due to the scarcity of labeled training data. Parameter-efficient fine-tuning and text-only adaptation are two popular methods that have been used to address…

Computation and Language · Computer Science 2024-10-18 Abhishek Gupta , Amruta Parulekar , Sameep Chattopadhyay , Preethi Jyothi

If today some African languages like Swahili have enough resources to develop high-performing Natural Language Processing (NLP) systems, many other languages spoken on the continent are still lacking such support. For these languages, still…

Computation and Language · Computer Science 2024-12-19 Naira Abdou Mohamed , Zakarya Erraji , Abdessalam Bahafid , Imade Benelallam

Automatic Speech Recognition (ASR) systems exhibit the best performance on speech that is similar to that on which it was trained. As such, underrepresented varieties including regional dialects, minority-speakers, and low-resource…

Computation and Language · Computer Science 2023-05-15 Emma O'Neill , Julie Carson-Berndsen