English
Related papers

Related papers: Cross-Learning Fine-Tuning Strategy for Dysarthric…

200 papers

State-of-the-art automatic speech recognition (ASR) models like Whisper, perform poorly on atypical speech, such as that produced by individuals with dysarthria. Past works for atypical speech have mostly investigated fully personalized (or…

Sound · Computer Science 2025-09-23 Vishnu Raja , Adithya V Ganesan , Anand Syamkumar , Ritwik Banerjee , H Andrew Schwartz

State-of-the-art automatic speech recognition (ASR) systems perform well on healthy speech. However, the performance on impaired speech still remains an issue. The current study explores the usefulness of using Wav2Vec self-supervised…

Computation and Language · Computer Science 2022-04-05 Abner Hernandez , Paula Andrea Pérez-Toro , Elmar Nöth , Juan Rafael Orozco-Arroyave , Andreas Maier , Seung Hee Yang

Automatic speech recognition (ASR) systems have dramatically improved over the last few years. ASR systems are most often trained from 'typical' speech, which means that underrepresented groups don't experience the same level of…

This paper enhances dysarthric and dysphonic speech recognition by fine-tuning pretrained automatic speech recognition (ASR) models on the 2023-10-05 data package of the Speech Accessibility Project (SAP), which contains the speech of 253…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-01 Xiuwen Zheng , Bornali Phukon , Mark Hasegawa-Johnson

Dysarthric speech recognition (DSR) presents a formidable challenge due to inherent inter-speaker variability, leading to severe performance degradation when applying DSR models to new dysarthric speakers. Traditional speaker adaptation…

Sound · Computer Science 2024-09-25 Shiyao Wang , Shiwan Zhao , Jiaming Zhou , Aobo Kong , Yong Qin

Many consumer speech recognition systems are not tuned for people with speech disabilities, resulting in poor recognition and user experience, especially for severe speech differences. Recent studies have emphasized interest in personalized…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Colin Lea , Dianna Yee , Jaya Narain , Zifang Huang , Lauren Tooley , Jeffrey P. Bigham , Leah Findlater

Dysarthric speech recognition is a challenging task as dysarthric data is limited and its acoustics deviate significantly from normal speech. Model-based speaker adaptation is a promising method by using the limited dysarthric speech to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-04 Disong Wang , Jianwei Yu , Xixin Wu , Lifa Sun , Xunying Liu , Helen Meng

Dysarthria is a motor speech disorder often characterized by reduced speech intelligibility through slow, uncoordinated control of speech production muscles. Automatic Speech recognition (ASR) systems may help dysarthric talkers communicate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-28 Mohammad Soleymanpour , Michael T. Johnson , Rahim Soleymanpour , Jeffrey Berry

Dysarthric speech recognition (DSR) enhances the accessibility of smart devices for dysarthric speakers with limited mobility. Previously, DSR research was constrained by the fact that existing datasets typically consisted of isolated…

Sound · Computer Science 2025-07-01 Shiyao Wang , Jiaming Zhou , Shiwan Zhao , Yong Qin

Automatic recognition of dysarthric speech remains a highly challenging task to date. Neuro-motor conditions and co-occurring physical disabilities create difficulty in large-scale data collection for ASR system development. Adapting SSL…

Sound · Computer Science 2024-01-02 Huimeng Wang , Zengrui Jin , Mengzhe Geng , Shujie Hu , Guinan Li , Tianzi Wang , Haoning Xu , Xunying Liu

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

Dysarthric speech reconstruction (DSR), which aims to improve the quality of dysarthric speech, remains a challenge, not only because we need to restore the speech to be normal, but also must preserve the speaker's identity. The speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-21 Disong Wang , Songxiang Liu , Xixin Wu , Hui Lu , Lifa Sun , Xunying Liu , Helen Meng

Automatic speech recognition (ASR) research has achieved impressive performance in recent years and has significant potential for enabling access for people with dysarthria (PwD) in augmentative and alternative communication (AAC) and home…

Sound · Computer Science 2024-06-14 Wing-Zin Leung , Mattias Cross , Anton Ragni , Stefan Goetze

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Alexandre Ducorroy , Rachid Riad

Despite the rapid progress of automatic speech recognition (ASR) technologies in the past few decades, recognition of disordered speech remains a highly challenging task to date. Disordered speech presents a wide spectrum of challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Shansong Liu , Mengzhe Geng , Shoukang Hu , Xurong Xie , Mingyu Cui , Jianwei Yu , Xunying Liu , Helen Meng

Dysarthric speech reconstruction is challenging due to its pathological sound patterns. Preserving speaker identity, especially without access to normal speech, is a key challenge. Our proposed approach uses contrastive learning to extract…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Keshvari Fatemeh , Mahdian Toroghi Rahil , Zareian Hassan

A key challenge in dysarthric speech recognition is the speaker-level diversity attributed to both speaker-identity associated factors such as gender, and speech impairment severity. Most prior researches on addressing this issue focused on…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Mengzhe Geng , Zengrui Jin , Tianzi Wang , Shujie Hu , Jiajun Deng , Mingyu Cui , Guinan Li , Jianwei Yu , Xurong Xie , Xunying Liu

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

In this work, we present our submission to the Speech Accessibility Project challenge for dysarthric speech recognition. We integrate parameter-efficient fine-tuning with latent audio representations to improve an encoder-decoder ASR…

The rapid population aging has stimulated the development of assistive devices that provide personalized medical support to the needies suffering from various etiologies. One prominent clinical application is a computer-assisted speech…

Computation and Language · Computer Science 2019-05-22 Emre Yılmaz , Vikramjit Mitra , Ganesh Sivaraman , Horacio Franco
‹ Prev 1 2 3 10 Next ›