中文
相关论文

相关论文: Cross-Learning Fine-Tuning Strategy for Dysarthric…

200 篇论文

Dysarthria is a motor speech disorder often characterized by reduced speech intelligibility through slow, uncoordinated control of speech production muscles. Automatic Speech recognition (ASR) systems can help dysarthric talkers communicate…

声音 · 计算机科学 2023-08-17 Mohammad Soleymanpour , Michael T. Johnson , Rahim Soleymanpour , Jeffrey Berry

Dysarthric speech poses significant challenges for automatic speech recognition (ASR) systems due to its high variability and reduced intelligibility. In this work we explore the use of diffusion models for dysarthric speech enhancement,…

音频与语音处理 · 电气工程与系统科学 2025-08-26 Dimme de Groot , Tanvina Patel , Devendra Kayande , Odette Scharenborg , Zhengjun Yue

Dysarthric speech exhibits abnormal prosody and significant speaker variability, presenting persistent challenges for automatic speech recognition (ASR). While text-to-speech (TTS)-based data augmentation has shown potential, existing…

声音 · 计算机科学 2026-03-03 Minghui Wu , Xueling Liu , Jiahuan Fan , Haitao Tang , Yanyong Zhang , Yue Zhang

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1,000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system. Contrary to what one might expect, despite the data being…

音频与语音处理 · 电气工程与系统科学 2025-12-22 Jimmy Tobin , Katrin Tomanek , Subhashini Venugopalan

Personalizing dysarthric ASR is hindered by demanding enrollment collection and per-user training. We propose a hybrid meta-training method for a single model, enabling zero-shot and few-shot on-the-fly personalization via in-context…

音频与语音处理 · 电气工程与系统科学 2026-02-24 Dhruuv Agarwal , Harry Zhang , Yang Yu , Quan Wang

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

音频与语音处理 · 电气工程与系统科学 2021-08-03 Zengrui Jin , Mengzhe Geng , Xurong Xie , Jianwei Yu , Shansong Liu , Xunying Liu , Helen Meng

Disordered speech recognition profound implications for improving the quality of life for individuals afflicted with, for example, dysarthria. Dysarthric speech recognition encounters challenges including limited data, substantial…

音频与语音处理 · 电气工程与系统科学 2024-06-17 Yicong Jiang , Tianzi Wang , Xurong Xie , Juan Liu , Wei Sun , Nan Yan , Hui Chen , Lan Wang , Xunying Liu , Feng Tian

In dysarthric speech recognition, data scarcity and the vast diversity between dysarthric speakers pose significant challenges. While finetuning has been a popular solution, it can lead to overfitting and low parameter efficiency. Adapter…

音频与语音处理 · 电气工程与系统科学 2023-06-13 Jinzi Qi , Hugo Van hamme

Dysarthria is a speech disorder that hinders communication due to difficulties in articulating words. Detection of dysarthria is important for several reasons as it can be used to develop a treatment plan and help improve a person's quality…

Automatic speech recognition (ASR) systems struggle with dysarthric speech due to high inter-speaker variability and slow speaking rates. To address this, we explore dysarthric-to-healthy speech conversion for improved ASR performance. Our…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Karl El Hajal , Enno Hermann , Sevada Hovsepyan , Mathew Magimai. -Doss

Dysarthric speech poses significant challenges for individuals with dysarthria, impacting their ability to communicate socially. Despite the widespread use of Automatic Speech Recognition (ASR), accurately recognizing dysarthric speech…

声音 · 计算机科学 2025-02-14 Yan Wang , Mengyi Sun , Xinchen Kang , Jingting Li , Pengfei Guo , Ming Gao , Su-Jing Wang

Although personalized automatic speech recognition (ASR) models have recently been designed to recognize even severely impaired speech, model performance may degrade over time for persons with degenerating speech. The aims of this study…

音频与语音处理 · 电气工程与系统科学 2022-11-02 Katrin Tomanek , Katie Seaver , Pan-Pan Jiang , Richard Cave , Lauren Harrel , Jordan R. Green

Transformer models have been used in automatic speech recognition (ASR) successfully and yields state-of-the-art results. However, its performance is still affected by speaker mismatch between training and test data. Further finetuning a…

音频与语音处理 · 电气工程与系统科学 2021-10-19 Yingzhu Zhao , Chongjia Ni , Cheung-Chi Leung , Shafiq Joty , Eng Siong Chng , Bin Ma

Automatic assessment of dysarthric speech is essential for sustained treatments and rehabilitation. However, obtaining atypical speech is challenging, often leading to data scarcity issues. To tackle the problem, we propose a novel…

计算与语言 · 计算机科学 2023-05-01 Eun Jung Yeo , Kwanghee Choi , Sunhee Kim , Minhwa Chung

Dysarthric speech recognition (DSR) research has witnessed remarkable progress in recent years, evolving from the basic understanding of individual words to the intricate comprehension of sentence-level expressions, all driven by the…

声音 · 计算机科学 2025-10-21 Shiyao Wang , Shiwan Zhao , Jiaming Zhou , Yong Qin

Automatic speech recognition systems based on deep learning are mainly trained under empirical risk minimization (ERM). Since ERM utilizes the averaged performance on the data samples regardless of a group such as healthy or dysarthric…

音频与语音处理 · 电气工程与系统科学 2023-06-28 Eungbeom Kim , Yunkee Chae , Jaeheon Sim , Kyogu Lee

Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of…

声音 · 计算机科学 2021-12-14 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

Stuttering -- characterized by involuntary disfluencies such as blocks, prolongations, and repetitions -- is often misinterpreted by automatic speech recognition (ASR) systems, resulting in elevated word error rates and making voice-driven…

声音 · 计算机科学 2025-08-22 Dena Mujtaba , Nihar Mahapatra

Dysarthria is a neurological disorder that significantly impairs speech intelligibility, often rendering affected individuals unable to communicate effectively. This necessitates the development of robust dysarthric-to-regular speech…

声音 · 计算机科学 2025-06-23 Shoutrik Das , Nishant Singh , Arjun Gangwar , S Umesh

Dysarthria, a motor speech disorder, affects intelligibility and requires targeted interventions for effective communication. In this work, we investigate automated mispronunciation feedback by collecting a dysarthric speech dataset from…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Seohyun Park , Chitralekha Gupta , Michelle Kah Yian Kwan , Xinhui Fung , Alexander Wenjun Yip , Suranga Nanayakkara