English
Related papers

Related papers: A study on the impact of Self-Supervised Learning …

200 papers

State-of-the-art automatic speech recognition (ASR) models like Whisper, perform poorly on atypical speech, such as that produced by individuals with dysarthria. Past works for atypical speech have mostly investigated fully personalized (or…

Sound · Computer Science 2025-09-23 Vishnu Raja , Adithya V Ganesan , Anand Syamkumar , Ritwik Banerjee , H Andrew Schwartz

Linguistic anomalies detectable in spontaneous speech have shown promise for various clinical applications including screening for dementia and other forms of cognitive impairment. The feasibility of deploying automated tools that can…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Changye Li , Trevor Cohen , Serguei Pakhomov

The speech representations learned from large-scale unlabeled data have shown better generalizability than those from supervised learning and thus attract a lot of interest to be applied for various downstream tasks. In this paper, we…

Sound · Computer Science 2022-01-25 Zhengyang Chen , Sanyuan Chen , Yu Wu , Yao Qian , Chengyi Wang , Shujie Liu , Yanmin Qian , Michael Zeng

Many consumer speech recognition systems are not tuned for people with speech disabilities, resulting in poor recognition and user experience, especially for severe speech differences. Recent studies have emphasized interest in personalized…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Colin Lea , Dianna Yee , Jaya Narain , Zifang Huang , Lauren Tooley , Jeffrey P. Bigham , Leah Findlater

Self-supervised learning (SSL) models have become crucial in speech processing, with recent advancements concentrating on developing architectures that capture representations across multiple timescales. The primary goal of these…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-01 Theo Clark , Benedetta Cevoli , Eloy de Jong , Timofey Abramski , Jamie Dougherty

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

Sound · Computer Science 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

Dysarthria is a neurological speech disorder that can significantly impact affected individuals' communication abilities and overall quality of life. The accurate and objective classification of dysarthria and the determination of its…

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

Dysarthria is a motor speech disorder often characterized by reduced speech intelligibility through slow, uncoordinated control of speech production muscles. Automatic Speech recognition (ASR) systems may help dysarthric talkers communicate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-28 Mohammad Soleymanpour , Michael T. Johnson , Rahim Soleymanpour , Jeffrey Berry

Dysarthria, a motor speech disorder, severely impacts voice quality, pronunciation, and prosody, leading to diminished speech intelligibility and reduced quality of life. Accurate assessment is crucial for effective treatment, but…

Sound · Computer Science 2024-12-18 Eunjung Yeo

Automatic dysarthric speech detection can provide reliable and cost-effective computer-aided tools to assist the clinical diagnosis and management of dysarthria. In this paper we propose a novel automatic dysarthric speech detection…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-01 P. Janbakhshi , I. Kodrasi , H. Bourlard

Self-supervised learning has shown great success in Speech Recognition. However, it has been observed that finetuning all layers of the learned model leads to lower performance compared to resetting top layers. This phenomenon is attributed…

Computation and Language · Computer Science 2024-05-15 Valentin Vielzeuf

Individuals with cerebral palsy (CP) and amyotrophic lateral sclerosis (ALS) frequently face challenges with articulation, leading to dysarthria and resulting in atypical speech patterns. In healthcare settings, communication breakdowns…

Computation and Language · Computer Science 2024-11-11 Macarious Hui , Jinda Zhang , Aanchan Mohan

Voice-based human-machine interaction is a primary modality for accessing intelligent systems, yet individuals with dysarthria face systematic exclusion due to recognition performance gaps. Whilst automatic speech recognition (ASR) achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-22 Ali Alsayegh , Tariq Masood

Research on speech processing has traditionally considered the task of designing hand-engineered acoustic features (feature engineering) as a separate distinct problem from the task of designing efficient machine learning (ML) models to…

Sound · Computer Science 2021-09-27 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Junaid Qadir , Björn W. Schuller

Deaf or hard-of-hearing (DHH) speakers typically have atypical speech caused by deafness. With the growing support of speech-based devices and software applications, more work needs to be done to make these devices inclusive to everyone. To…

Sound · Computer Science 2023-06-27 Lester Phillip Violeta , Tomoki Toda

While Automatic Speech Recognition (ASR) is typically benchmarked by word error rate (WER), real-world applications ultimately hinge on semantic fidelity. This mismatch is particularly problematic for dysarthric speech, where articulatory…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-30 Xiuwen Zheng , Sixun Dong , Bornali Phukon , Mark Hasegawa-Johnson , Chang D. Yoo

This paper introduces MauBERT, a multilingual extension of HuBERT that leverages articulatory features for robust cross-lingual phonetic representation learning. We continue HuBERT pre-training with supervision based on a…

Computation and Language · Computer Science 2025-12-23 Angelo Ortiz Tandazo , Manel Khentout , Youssef Benchekroun , Thomas Hueber , Emmanuel Dupoux

An accurate objective speech intelligibility prediction algorithms is of great interest for many applications such as speech enhancement for hearing aids. Most algorithms measures the signal-to-noise ratios or correlations between the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehai Tu , Ning Ma , Jon Barker

Dysarthria is a motor speech disorder that results in slow and often incomprehensible speech. Speech intelligibility significantly impacts communication, leading to barriers in social interactions. Dysarthria is often a characteristic of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-07 Ananya Raghu , Anisha Raghu , Nithika Vivek , Sofie Budman , Omar Mansour