English
Related papers

Related papers: A Multi-modal Approach to Dysarthria Detection and…

200 papers

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

Dysarthric speech recognition (DSR) enhances the accessibility of smart devices for dysarthric speakers with limited mobility. Previously, DSR research was constrained by the fact that existing datasets typically consisted of isolated…

Sound · Computer Science 2025-07-01 Shiyao Wang , Jiaming Zhou , Shiwan Zhao , Yong Qin

This review paper explores recent advances in deep learning approaches for non-invasive cognitive impairment detection. We examine various non-invasive indicators of cognitive decline, including speech and language, facial, and motoric…

Machine Learning · Computer Science 2025-04-16 Muath Alsuhaibani , Ali Pourramezan Fard , Jian Sun , Farida Far Poor , Peter S. Pressman , Mohammad H. Mahoor

This paper proposed a novel approach for the detection and reconstruction of dysarthric speech. The encoder-decoder model factorizes speech into a low-dimensional latent space and encoding of the input text. We showed that the latent space…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-11 Daniel Korzekwa , Roberto Barra-Chicote , Bozena Kostek , Thomas Drugman , Mateusz Lajszczak

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

The growing prevalence of neurological disorders associated with dysarthria motivates the need for automated intelligibility assessment methods that are applicalbe across languages. However, most existing approaches are either limited to a…

Computation and Language · Computer Science 2026-02-12 Eunjung Yeo , Julie M. Liss , Visar Berisha , David R. Mortensen

In many real-world applications, the mismatch between distributions of training data (source) and test data (target) significantly degrades the performance of machine learning algorithms. In speech data, causes of this mismatch include…

Sound · Computer Science 2022-03-15 Rosanna Turrisi , Leonardo Badino

Aphasia is a language disorder that affects the speaking ability of millions of patients. This paper presents a new benchmark for Aphasia speech recognition and detection tasks using state-of-the-art speech recognition techniques with the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Jiyang Tang , William Chen , Xuankai Chang , Shinji Watanabe , Brian MacWhinney

Background: An early diagnosis together with an accurate disease progression monitoring of multiple sclerosis is an important component of successful disease management. Prior studies have established that multiple sclerosis is correlated…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-28 Emil Svoboda , Tomáš Bořil , Jan Rusz , Tereza Tykalová , Dana Horáková , Charles R. G. Guttman , Krastan B. Blagoev , Hiroto Hatabu , Vlad I. Valtchinov

Training machine learning algorithms for speech applications requires large, labeled training data sets. This is problematic for clinical applications where obtaining such data is prohibitively expensive because of privacy concerns or lack…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-30 Yishan Jiao , Ming Tu , Visar Berisha , Julie Liss

Aphasia, a language disorder primarily caused by a stroke, is traditionally diagnosed using behavioral language tests. However, these tests are time-consuming, require manual interpretation by trained clinicians, suffer from low ecological…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Pieter De Clercq , Corentin Puffay , Jill Kries , Hugo Van Hamme , Maaike Vandermosten , Tom Francart , Jonas Vanthornhout

We developed dysarthric speech intelligibility classifiers on 551,176 disordered speech samples contributed by a diverse set of 468 speakers, with a range of self-reported speaking disorders and rated for their overall intelligibility on a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-17 Subhashini Venugopalan , Jimmy Tobin , Samuel J. Yang , Katie Seaver , Richard J. N. Cave , Pan-Pan Jiang , Neil Zeghidour , Rus Heywood , Jordan Green , Michael P. Brenner

Dysarthria is a neurological disorder that significantly impairs speech intelligibility, often rendering affected individuals unable to communicate effectively. This necessitates the development of robust dysarthric-to-regular speech…

Sound · Computer Science 2025-06-23 Shoutrik Das , Nishant Singh , Arjun Gangwar , S Umesh

Despite the rapid progress of automatic speech recognition (ASR) technologies in the past few decades, recognition of disordered speech remains a highly challenging task to date. Disordered speech presents a wide spectrum of challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Shansong Liu , Mengzhe Geng , Shoukang Hu , Xurong Xie , Mingyu Cui , Jianwei Yu , Xunying Liu , Helen Meng

Speech classifiers of paralinguistic traits traditionally learn from diverse hand-crafted low-level features, by selecting the relevant information for the task at hand. We explore an alternative to this selection, by learning jointly the…

Computation and Language · Computer Science 2019-01-09 Juliette Millet , Neil Zeghidour

Speech intelligibility assessment plays an important role in the therapy of patients suffering from pathological speech disorders. Automatic and objective measures are desirable to assist therapists in their traditionally subjective and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Tobias Weise , Philipp Klumpp , Kubilay Can Demir , Andreas Maier , Elmar Noeth , Bjoern Heismann , Maria Schuster , Seung Hee Yang

Automatic speech recognition systems based on deep learning are mainly trained under empirical risk minimization (ERM). Since ERM utilizes the averaged performance on the data samples regardless of a group such as healthy or dysarthric…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Eungbeom Kim , Yunkee Chae , Jaeheon Sim , Kyogu Lee

Dysarthric speech recognition (DSR) presents a formidable challenge due to inherent inter-speaker variability, leading to severe performance degradation when applying DSR models to new dysarthric speakers. Traditional speaker adaptation…

Sound · Computer Science 2024-09-25 Shiyao Wang , Shiwan Zhao , Jiaming Zhou , Aobo Kong , Yong Qin

The lack of an available emotion pathology database is one of the key obstacles in studying the emotion expression status of patients with dysarthria. The first Chinese multimodal emotional pathological speech database containing…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Ting Zhu , Shufei Duan , Huizhi Liang , Wei Zhang

This study explores voice cloning to generate synthetic speech replicating the unique patterns of individuals with dysarthria. Using the TORGO dataset, we address data scarcity and privacy challenges in speech-language pathology. Our…

Sound · Computer Science 2025-03-04 Birger Moell , Fredrik Sand Aronsson