English
Related papers

Related papers: Weak-Supervised Dysarthria-invariant Features for …

200 papers

Dysarthric speech reconstruction is challenging due to its pathological sound patterns. Preserving speaker identity, especially without access to normal speech, is a key challenge. Our proposed approach uses contrastive learning to extract…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Keshvari Fatemeh , Mahdian Toroghi Rahil , Zareian Hassan

Purpose: Speech intelligibility is a critical outcome in the assessment and management of dysarthria, yet most research and clinical practices have focused on English, limiting their applicability across languages. This commentary…

Computation and Language · Computer Science 2025-05-09 Eunjung Yeo , Julie Liss , Visar Berisha , David Mortensen

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Zengrui Jin , Mengzhe Geng , Xurong Xie , Jianwei Yu , Shansong Liu , Xunying Liu , Helen Meng

Automatic speech recognition (ASR) research has achieved impressive performance in recent years and has significant potential for enabling access for people with dysarthria (PwD) in augmentative and alternative communication (AAC) and home…

Sound · Computer Science 2024-06-14 Wing-Zin Leung , Mattias Cross , Anton Ragni , Stefan Goetze

Previous work has encouraged domain-invariance in deep speaker embedding by adversarially classifying the dataset or labelled environment to which the generated features belong. We propose a training strategy which aims to produce features…

Sound · Computer Science 2020-04-17 Chau Luu , Peter Bell , Steve Renals

Accurate recognition of dysarthric and elderly speech remain challenging tasks to date. Speaker-level heterogeneity attributed to accent or gender, when aggregated with age and speech impairment, create large diversity among these speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Mengzhe Geng , Xurong Xie , Rongfeng Su , Jianwei Yu , Zengrui Jin , Tianzi Wang , Shujie Hu , Zi Ye , Helen Meng , Xunying Liu

Disordered speech recognition profound implications for improving the quality of life for individuals afflicted with, for example, dysarthria. Dysarthric speech recognition encounters challenges including limited data, substantial…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-17 Yicong Jiang , Tianzi Wang , Xurong Xie , Juan Liu , Wei Sun , Nan Yan , Hui Chen , Lan Wang , Xunying Liu , Feng Tian

Acoustic-to-articulatory inversion (AAI) involves mapping from the acoustic to the articulatory space. Signal-processing features like the MFCCs, have been widely used for the AAI task. For subjects with dysarthric speech, AAI is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-13 Sarthak Kumar Maharana , Krishna Kamal Adidam , Shoumik Nandi , Ajitesh Srivastava

Automatic dysarthric speech detection can provide reliable and cost-effective computer-aided tools to assist the clinical diagnosis and management of dysarthria. In this paper we propose a novel automatic dysarthric speech detection…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-01 P. Janbakhshi , I. Kodrasi , H. Bourlard

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

Sound · Computer Science 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

State-of-the-art automatic speech recognition (ASR) models like Whisper, perform poorly on atypical speech, such as that produced by individuals with dysarthria. Past works for atypical speech have mostly investigated fully personalized (or…

Sound · Computer Science 2025-09-23 Vishnu Raja , Adithya V Ganesan , Anand Syamkumar , Ritwik Banerjee , H Andrew Schwartz

Existing speaker verification (SV) systems often suffer from performance degradation if there is any language mismatch between model training, speaker enrollment, and test. A major cause of this degradation is that most existing SV methods…

Sound · Computer Science 2017-06-27 Lantian Li , Dong Wang , Askar Rozi , Thomas Fang Zheng

Factorizing speech as disentangled speech representations is vital to achieve highly controllable style transfer in voice conversion (VC). Conventional speech representation learning methods in VC only factorize speech as speaker and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-06 Jie Wang , Jingbei Li , Xintao Zhao , Zhiyong Wu , Shiyin Kang , Helen Meng

We present a new approach to disentangle speaker voice and phone content by introducing new components to the VQ-VAE architecture for speech synthesis. The original VQ-VAE does not generalize well to unseen speakers or content. To alleviate…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Jennifer Williams , Yi Zhao , Erica Cooper , Junichi Yamagishi

Dynamical variational autoencoders (DVAEs) are a class of deep generative models with latent variables, dedicated to model time series of high-dimensional data. DVAEs can be considered as extensions of the variational autoencoder (VAE) that…

Sound · Computer Science 2022-10-04 Xiaoyu Bie , Simon Leglaive , Xavier Alameda-Pineda , Laurent Girin

Dysarthric speakers experience substantial communication challenges due to impaired motor control of the speech apparatus, which leads to reduced speech intelligibility. This creates significant obstacles in dataset curation since actual…

Sound · Computer Science 2025-09-26 Yejin Jeon , Solee Im , Youngjae Kim , Gary Geunbae Lee

This work addresses the mismatch problem between the distribution of training data (source) and testing data (target), in the challenging context of dysarthric speech recognition. We focus on Speaker Adaptation (SA) in command speech…

Computation and Language · Computer Science 2023-09-13 Rosanna Turrisi , Leonardo Badino

Content mismatch usually occurs when data from one modality is translated to another, e.g. language learners producing mispronunciations (errors in speech) when reading a sentence (target text) aloud. However, most existing alignment…

Machine Learning · Computer Science 2023-01-10 Wei Wei , Huang Hengguan , Gu Xiangming , Wang Hao , Wang Ye

The limited availability of dysarthric speech data makes cross-lingual detection an important but challenging problem. A key difficulty is that speech representations often encode language-dependent structure that can confound dysarthria…

We present a Lipreading system, i.e. a speech recognition system using only visual features, which uses domain-adversarial training for speaker independence. Domain-adversarial training is integrated into the optimization of a lipreader…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Michael Wand , Juergen Schmidhuber