English
Related papers

Related papers: Latent Phrase Matching for Dysarthric Speech

200 papers

Personalizing automatic speech recognition (ASR) systems for non-normative speech, such as dysarthric and aphasic speech, is challenging. While speaker-specific fine-tuning (SS-FT) is widely used, it is typically initialized directly from a…

Sound · Computer Science 2026-03-17 Shan Jiang , Jiawen Qi , Chuanbing Huo , Yingqiang Gao , Qinyu Chen

Consumer speech recognition systems do not work as well for many people with speech diferences, such as stuttering, relative to the rest of the general population. However, what is not clear is the degree to which these systems do not work,…

Human-Computer Interaction · Computer Science 2023-02-28 Colin Lea , Zifang Huang , Lauren Tooley , Jaya Narain , Dianna Yee , Panayiotis Georgiou , Tien Dung Tran , Jeffrey P. Bigham , Leah Findlater

We study the effectiveness of several techniques to personalize end-to-end speech models and improve the recognition of proper names relevant to the user. These techniques differ in the amounts of user effort required to provide…

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

Dysarthric speech exhibits abnormal prosody and significant speaker variability, presenting persistent challenges for automatic speech recognition (ASR). While text-to-speech (TTS)-based data augmentation has shown potential, existing…

Sound · Computer Science 2026-03-03 Minghui Wu , Xueling Liu , Jiahuan Fan , Haitao Tang , Yanyong Zhang , Yue Zhang

Dysarthric speech reconstruction (DSR) typically employs a cascaded system that combines automatic speech recognition (ASR) and sentence-level text-to-speech (TTS) to convert dysarthric speech into normally-prosodied speech. However,…

Sound · Computer Science 2026-03-03 Minghui Wu , Haitao Tang , Jiahuan Fan , Ruizhi Liao , Yanyong Zhang

Nowadays, speech is becoming a more common, if not standard, interface to technology. This can be seen in the trend of technology changes over the years. Increasingly, voice is used to control programs, appliances and personal devices…

Human-Computer Interaction · Computer Science 2019-09-10 Abraham Glasser

Dysarthria is a motor speech impairment affecting millions of people. Dysarthric speech can be far less intelligible than those of non-dysarthric speakers, causing significant communication difficulties. The goal of our work is to develop a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-14 Seung Hee Yang , Minhwa Chung

Automatic speech recognition (ASR) has been an essential component of computer assisted language learning (CALL) and computer assisted language testing (CALT) for many years. As this technology continues to develop rapidly, it is important…

Computation and Language · Computer Science 2025-04-01 Michael McGuire

Despite the rapid progress of automatic speech recognition (ASR) technologies in the past few decades, recognition of disordered speech remains a highly challenging task to date. Disordered speech presents a wide spectrum of challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Shansong Liu , Mengzhe Geng , Shoukang Hu , Xurong Xie , Mingyu Cui , Jianwei Yu , Xunying Liu , Helen Meng

Despite the remarkable progress in end-to-end Automatic Speech Recognition (ASR) engines, accurately transcribing dysarthric speech remains a major challenge. In this work, we proposed a two-stage framework for the Speech Accessibility…

Computation and Language · Computer Science 2025-05-27 Moreno La Quatra , Alkis Koudounas , Valerio Mario Salerno , Sabato Marco Siniscalchi

In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded…

Dysarthria is a motor speech disorder caused by neurological damage that affects the muscles used for speech production, leading to slurred, slow, or difficult-to-understand speech. It affects millions of individuals worldwide, including…

Computation and Language · Computer Science 2024-10-18 Kaushal Attaluri , Anirudh CHVS , Sireesha Chittepu

Automatic speech recognition (ASR) systems are well known to perform poorly on dysarthric speech. Previous works have addressed this by speaking rate modification to reduce the mismatch with typical speech. Unfortunately, these approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-20 Karl El Hajal , Enno Hermann , Ajinkya Kulkarni , Mathew Magimai. -Doss

Automatic recognition of disordered and elderly speech remains highly challenging tasks to date due to data scarcity. Parameter fine-tuning is often used to exploit the large quantities of non-aged and healthy speech pre-trained models,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Tianzi Wang , Shoukang Hu , Jiajun Deng , Zengrui Jin , Mengzhe Geng , Yi Wang , Helen Meng , Xunying Liu

Dysarthric speech reconstruction is challenging due to its pathological sound patterns. Preserving speaker identity, especially without access to normal speech, is a key challenge. Our proposed approach uses contrastive learning to extract…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Keshvari Fatemeh , Mahdian Toroghi Rahil , Zareian Hassan

Automatic speech recognition (ASR) systems struggle with dysarthric speech due to high inter-speaker variability and slow speaking rates. To address this, we explore dysarthric-to-healthy speech conversion for improved ASR performance. Our…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Karl El Hajal , Enno Hermann , Sevada Hovsepyan , Mathew Magimai. -Doss

Personalization of automatic speech recognition (ASR) models is a widely studied topic because of its many practical applications. Most recently, attention-based contextual biasing techniques are used to improve the recognition of rare…

Computation and Language · Computer Science 2023-11-15 Sai Muralidhar Jayanthi , Devang Kulshreshtha , Saket Dingliwal , Srikanth Ronanki , Sravan Bodapati

Speech Recognition (ASR) due to phoneme distortions and high variability. While self-supervised ASR models like Wav2Vec, HuBERT, and Whisper have shown promise, their effectiveness in dysarthric speech remains unclear. This study…

Sound · Computer Science 2025-08-12 Ahmed Aboeitta , Ahmed Sharshar , Youssef Nafea , Shady Shehata

Building a high quality automatic speech recognition (ASR) system with limited training data has been a challenging task particularly for a narrow target population. Open-sourced ASR systems, trained on sufficient data from adults, are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-18 Liu Chen , Meysam Asgari