English
Related papers

Related papers: Speaker adaptation for Wav2vec2 based dysarthric A…

200 papers

State-of-the-art automatic speech recognition (ASR) systems perform well on healthy speech. However, the performance on impaired speech still remains an issue. The current study explores the usefulness of using Wav2Vec self-supervised…

Computation and Language · Computer Science 2022-04-05 Abner Hernandez , Paula Andrea Pérez-Toro , Elmar Nöth , Juan Rafael Orozco-Arroyave , Andreas Maier , Seung Hee Yang

A key challenge in dysarthric speech recognition is the speaker-level diversity attributed to both speaker-identity associated factors such as gender, and speech impairment severity. Most prior researches on addressing this issue focused on…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Mengzhe Geng , Zengrui Jin , Tianzi Wang , Shujie Hu , Jiajun Deng , Mingyu Cui , Guinan Li , Jianwei Yu , Xurong Xie , Xunying Liu

In this work, we present our submission to the Speech Accessibility Project challenge for dysarthric speech recognition. We integrate parameter-efficient fine-tuning with latent audio representations to improve an encoder-decoder ASR…

Automatic recognition of disordered and elderly speech remains a highly challenging task to date due to the difficulty in collecting such data in large quantities. This paper explores a series of approaches to integrate domain adapted SSL…

Sound · Computer Science 2023-06-23 Shujie Hu , Xurong Xie , Zengrui Jin , Mengzhe Geng , Yi Wang , Mingyu Cui , Jiajun Deng , Xunying Liu , Helen Meng

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

Automatic recognition of dysarthric speech remains a highly challenging task to date. Neuro-motor conditions and co-occurring physical disabilities create difficulty in large-scale data collection for ASR system development. Adapting SSL…

Sound · Computer Science 2024-01-02 Huimeng Wang , Zengrui Jin , Mengzhe Geng , Shujie Hu , Guinan Li , Tianzi Wang , Haoning Xu , Xunying Liu

Automatic detection and severity level classification of dysarthria directly from acoustic speech signals can be used as a tool in medical diagnosis. In this work, the pre-trained wav2vec 2.0 model is studied as a feature extractor to build…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-18 Farhad Javanmardi , Saska Tirronen , Manila Kodali , Sudarsana Reddy Kadiri , Paavo Alku

The application of data-intensive automatic speech recognition (ASR) technologies to dysarthric and elderly adult speech is confronted by their mismatch against healthy and nonaged voices, data scarcity and large speaker-level variability.…

This paper explores applying the wav2vec2 framework to speaker recognition instead of speech recognition. We study the effectiveness of the pre-trained weights on the speaker recognition task, and how to pool the wav2vec2 output sequence…

Sound · Computer Science 2022-05-09 Nik Vaessen , David A. van Leeuwen

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

Accurate recognition of dysarthric and elderly speech remain challenging tasks to date. Speaker-level heterogeneity attributed to accent or gender, when aggregated with age and speech impairment, create large diversity among these speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Mengzhe Geng , Xurong Xie , Rongfeng Su , Jianwei Yu , Zengrui Jin , Tianzi Wang , Shujie Hu , Zi Ye , Helen Meng , Xunying Liu

Automatic speech recognition (ASR) systems struggle with dysarthric speech due to high inter-speaker variability and slow speaking rates. To address this, we explore dysarthric-to-healthy speech conversion for improved ASR performance. Our…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Karl El Hajal , Enno Hermann , Sevada Hovsepyan , Mathew Magimai. -Doss

Speech Recognition (ASR) due to phoneme distortions and high variability. While self-supervised ASR models like Wav2Vec, HuBERT, and Whisper have shown promise, their effectiveness in dysarthric speech remains unclear. This study…

Sound · Computer Science 2025-08-12 Ahmed Aboeitta , Ahmed Sharshar , Youssef Nafea , Shady Shehata

Automatic speech recognition (ASR) systems have dramatically improved over the last few years. ASR systems are most often trained from 'typical' speech, which means that underrepresented groups don't experience the same level of…

Wav2vec 2.0 (W2V2) has shown strong performance in pathological speech analysis by effectively capturing the characteristics of atypical speech. Despite its success, it remains unclear which components of its learned representations are…

Sound · Computer Science 2026-04-24 Natalie Engert , Dominik Wagner , Korbinian Riedhammer , Tobias Bocklet

Despite the rapid progress of automatic speech recognition (ASR) technologies in the past few decades, recognition of disordered speech remains a highly challenging task to date. Disordered speech presents a wide spectrum of challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Shansong Liu , Mengzhe Geng , Shoukang Hu , Xurong Xie , Mingyu Cui , Jianwei Yu , Xunying Liu , Helen Meng

Automatic assessment of dysarthric speech is essential for sustained treatments and rehabilitation. However, obtaining atypical speech is challenging, often leading to data scarcity issues. To tackle the problem, we propose a novel…

Computation and Language · Computer Science 2023-05-01 Eun Jung Yeo , Kwanghee Choi , Sunhee Kim , Minhwa Chung

Dysarthric speech recognition faces challenges from severity variations and disparities relative to normal speech. Conventional approaches individually fine-tune ASR models pre-trained on normal speech per patient to prevent feature…

Sound · Computer Science 2025-08-27 Qing Xiao , Yingshan Peng , PeiPei Zhang

Approaching Speech-to-Text and Automatic Speech Recognition problems in low-resource languages is notoriously challenging due to the scarcity of validated datasets and the diversity of dialects. Arabic, Russian, and Portuguese exemplify…

Computation and Language · Computer Science 2025-01-03 Or Haim Anidjar , Revital Marbel , Roi Yozevitch

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

Computation and Language · Computer Science 2023-09-28 Yanan Jia
‹ Prev 1 2 3 10 Next ›