English
Related papers

Related papers: Towards Pretraining Robust ASR Foundation Model wi…

200 papers

This paper proposes AS-ASR, a lightweight aphasia-specific speech recognition framework based on Whisper-tiny, tailored for low-resource deployment on edge devices. Our approach introduces a hybrid training strategy that systematically…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-03 Chen Bao , Chuanbing Huo , Qinyu Chen , Chang Gao

Although many Automatic Speech Recognition (ASR) systems have been developed for Modern Standard Arabic (MSA) and Dialectal Arabic (DA), few studies have focused on dialect-specific implementations, particularly for low-resource Arabic…

Computation and Language · Computer Science 2026-01-13 Ayman Mansour

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

The development of resource-constrained approaches to automatic speech recognition (ASR) is of great interest due to its broad applicability to many low-resource languages for which there is scant usable data. Existing approaches to many…

Computation and Language · Computer Science 2026-03-17 Emma Rafkin , Dan DeGenaro , Xiulin Yang

While automatic speech recognition (ASR) greatly benefits from data augmentation, the augmentation recipes themselves tend to be heuristic. In this paper, we address one of the heuristic approach associated with balancing the right amount…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-17 Vishwanath Pratap Singh , Federico Malato , Ville Hautamaki , Md. Sahidullah , Tomi Kinnunen

Rare word recognition can be improved by adapting ASR models to synthetic data that includes these words. Further improvements can be achieved through contextual biasing, which trains and adds a biasing module into the model architecture to…

Computation and Language · Computer Science 2025-09-12 Chin Yuen Kwok , Jia Qi Yip , Eng Siong Chng

Training a robust Automatic Speech Recognition (ASR) system for children's speech recognition is a challenging task due to inherent differences in acoustic attributes of adult and child speech and scarcity of publicly available children's…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-15 Vishwanath Pratap Singh , Hardik Sailor , Supratik Bhattacharya , Abhishek Pandey

Despite recent progress in automatic speech recognition (ASR), elderly ASR (EASR) remains challenging due to limited training data and the distinct acoustic and linguistic characteristics of elderly speech. In this work, we address data…

Computation and Language · Computer Science 2026-04-29 Minsik Lee , Seoi Hong , Chongmin Lee , Sieun Choi , Jian Kim , Jua Han , Jihie Kim

State-of-the-art automatic speech recognition (ASR) models like Whisper, perform poorly on atypical speech, such as that produced by individuals with dysarthria. Past works for atypical speech have mostly investigated fully personalized (or…

Sound · Computer Science 2025-09-23 Vishnu Raja , Adithya V Ganesan , Anand Syamkumar , Ritwik Banerjee , H Andrew Schwartz

In this study, we investigate whether noise-augmented training can concurrently improve adversarial robustness in automatic speech recognition (ASR) systems. We conduct a comparative analysis of the adversarial robustness of four different…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-10 Karla Pizzi , Matías Pizarro , Asja Fischer

We propose an on-the-fly data augmentation method for automatic speech recognition (ASR) that uses alignment information to generate effective training samples. Our method, called Aligned Data Augmentation (ADA) for ASR, replaces…

Computation and Language · Computer Science 2023-06-13 Tsz Kin Lam , Mayumi Ohta , Shigehiko Schamoni , Stefan Riezler

We present our experiments in training robust to noise an end-to-end automatic speech recognition (ASR) model using intensive data augmentation. We explore the efficacy of fine-tuning a pre-trained model to improve noise robustness, and we…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Jagadeesh Balam , Jocelyn Huang , Vitaly Lavrukhin , Slyne Deng , Somshubra Majumdar , Boris Ginsburg

Whisper, despite being trained on 680K hours of web-scaled audio data, faces difficulty in recognising rare words like domain-specific terms, with a solution being contextual biasing through prompting. To improve upon this method, in this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-19 Yash Jogi , Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Aayush Kubba

We study training a single acoustic model for multiple languages with the aim of improving automatic speech recognition (ASR) performance on low-resource languages, and over-all simplifying deployment of ASR systems that support diverse…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-09 Vineel Pratap , Anuroop Sriram , Paden Tomasello , Awni Hannun , Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

Augmenting the training data of automatic speech recognition (ASR) systems with synthetic data generated by text-to-speech (TTS) or voice conversion (VC) has gained popularity in recent years. Several works have demonstrated improvements in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-13 Sewade Ogun , Vincent Colotte , Emmanuel Vincent

Automatic Speech Recognition (ASR) systems are used in the financial domain to enhance the caller experience by enabling natural language understanding and facilitating efficient and intuitive interactions. Increasing use of ASR systems…

Machine Learning · Computer Science 2024-02-08 Chirag Chhablani , Nikhita Sharma , Jordan Hosier , Vijay K. Gurbani

Automatic speech recognition (ASR) has the potential to substantially reduce manual annotation effort in child speech research by generating automatic transcriptions. However, obtaining reliably high-quality ASR transcriptions for child…

Computation and Language · Computer Science 2026-05-29 Gus Lathouwers , Lingyun Gao , Catia Cucchiarini , Helmer Strik

Dysarthric speech recognition (DSR) enhances the accessibility of smart devices for dysarthric speakers with limited mobility. Previously, DSR research was constrained by the fact that existing datasets typically consisted of isolated…

Sound · Computer Science 2025-07-01 Shiyao Wang , Jiaming Zhou , Shiwan Zhao , Yong Qin

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin