Applications of Artificial Intelligence for Cross-language Intelligibility Assessment of Dysarthric Speech
Abstract
Purpose: Speech intelligibility is a critical outcome in the assessment and management of dysarthria, yet most research and clinical practices have focused on English, limiting their applicability across languages. This commentary introduces a conceptual framework--and a demonstration of how it can be implemented--leveraging artificial intelligence (AI) to advance cross-language intelligibility assessment of dysarthric speech. Method: We propose a two-tiered conceptual framework consisting of a universal speech model that encodes dysarthric speech into acoustic-phonetic representations, followed by a language-specific intelligibility assessment model that interprets these representations within the phonological or prosodic structures of the target language. We further identify barriers to cross-language intelligibility assessment of dysarthric speech, including data scarcity, annotation complexity, and limited linguistic insights into dysarthric speech, and outline potential AI-driven solutions to overcome these challenges. Conclusion: Advancing cross-language intelligibility assessment of dysarthric speech necessitates models that are both efficient and scalable, yet constrained by linguistic rules to ensure accurate and language-sensitive assessment. Recent advances in AI provide the foundational tools to support this integration, shaping future directions toward generalizable and linguistically informed assessment frameworks.
Keywords
Cite
@article{arxiv.2501.15858,
title = {Applications of Artificial Intelligence for Cross-language Intelligibility Assessment of Dysarthric Speech},
author = {Eunjung Yeo and Julie Liss and Visar Berisha and David Mortensen},
journal= {arXiv preprint arXiv:2501.15858},
year = {2025}
}
Comments
14 pages, 2 figure, 2 tables