中文
相关论文

相关论文: Exploring Self-supervised Pre-trained ASR Models F…

200 篇论文

We investigate the performance of self-supervised pretraining frameworks on pathological speech datasets used for automatic speech recognition (ASR). Modern end-to-end models require thousands of hours of data to train well, but only a…

声音 · 计算机科学 2022-06-30 Lester Phillip Violeta , Wen-Chin Huang , Tomoki Toda

Recently, self-supervised learning (SSL) from unlabelled speech data has gained increased attention in the automatic speech recognition (ASR) community. Typical SSL methods include autoregressive predictive coding (APC), Wav2vec2.0, and…

音频与语音处理 · 电气工程与系统科学 2023-05-02 Ruchao Fan , Yunzheng Zhu , Jinhan Wang , Abeer Alwan

In this work, we present our submission to the Speech Accessibility Project challenge for dysarthric speech recognition. We integrate parameter-efficient fine-tuning with latent audio representations to improve an encoder-decoder ASR…

Accurate recognition of dysarthric and elderly speech remain challenging tasks to date. Speaker-level heterogeneity attributed to accent or gender, when aggregated with age and speech impairment, create large diversity among these speakers.…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Mengzhe Geng , Xurong Xie , Rongfeng Su , Jianwei Yu , Zengrui Jin , Tianzi Wang , Shujie Hu , Zi Ye , Helen Meng , Xunying Liu

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

音频与语音处理 · 电气工程与系统科学 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

In general, the performance of automatic speech recognition (ASR) systems is significantly degraded due to the mismatch between training and test environments. Recently, a deep-learning-based image-to-image translation technique to…

音频与语音处理 · 电气工程与系统科学 2019-04-15 Jong-Hyeon Park , Myungwoo Oh , Hyung-Min Park

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

Automatic speech recognition (ASR) research has achieved impressive performance in recent years and has significant potential for enabling access for people with dysarthria (PwD) in augmentative and alternative communication (AAC) and home…

声音 · 计算机科学 2024-06-14 Wing-Zin Leung , Mattias Cross , Anton Ragni , Stefan Goetze

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Jenthe Thienpondt , Kris Demuynck

Automatic assessment of dysarthric speech is essential for sustained treatments and rehabilitation. However, obtaining atypical speech is challenging, often leading to data scarcity issues. To tackle the problem, we propose a novel…

计算与语言 · 计算机科学 2023-05-01 Eun Jung Yeo , Kwanghee Choi , Sunhee Kim , Minhwa Chung

Dysarthric speech exhibits high variability and limited labeled data, posing major challenges for both automatic speech recognition (ASR) and assistive speech technologies. Existing approaches rely on synthetic data augmentation or speech…

ASR systems designed for native English (L1) usually underperform on non-native English (L2). To address this performance gap, \textbf{(i)} we extend our previous work to investigate fine-tuning of a pre-trained wav2vec 2.0 model…

计算与语言 · 计算机科学 2022-02-11 Peter Sullivan , Toshiko Shibano , Muhammad Abdul-Mageed

Dysarthria is a motor speech disorder often characterized by reduced speech intelligibility through slow, uncoordinated control of speech production muscles. Automatic Speech recognition (ASR) systems may help dysarthric talkers communicate…

音频与语音处理 · 电气工程与系统科学 2022-01-28 Mohammad Soleymanpour , Michael T. Johnson , Rahim Soleymanpour , Jeffrey Berry

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

音频与语音处理 · 电气工程与系统科学 2021-08-03 Zengrui Jin , Mengzhe Geng , Xurong Xie , Jianwei Yu , Shansong Liu , Xunying Liu , Helen Meng

The rapid population aging has stimulated the development of assistive devices that provide personalized medical support to the needies suffering from various etiologies. One prominent clinical application is a computer-assisted speech…

计算与语言 · 计算机科学 2019-05-22 Emre Yılmaz , Vikramjit Mitra , Ganesh Sivaraman , Horacio Franco

Recent work on self-supervised pre-training focus on leveraging large-scale unlabeled speech data to build robust end-to-end (E2E) acoustic models (AM) that can be later fine-tuned on downstream tasks e.g., automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2022-10-18 Juan Zuluaga-Gomez , Amrutha Prasad , Iuliia Nigmatulina , Saeed Sarfjoo , Petr Motlicek , Matthias Kleinert , Hartmut Helmke , Oliver Ohneiser , Qingran Zhan

Acoustic-to-articulatory inversion (AAI) involves mapping from the acoustic to the articulatory space. Signal-processing features like the MFCCs, have been widely used for the AAI task. For subjects with dysarthric speech, AAI is…

音频与语音处理 · 电气工程与系统科学 2024-02-13 Sarthak Kumar Maharana , Krishna Kamal Adidam , Shoumik Nandi , Ajitesh Srivastava

In this work, we investigate the joint use of articulatory and acoustic features for automatic speech recognition (ASR) of pathological speech. Despite long-lasting efforts to build speaker- and text-independent ASR systems for people with…

计算与语言 · 计算机科学 2018-07-31 Emre Yılmaz , Vikramjit Mitra , Chris Bartels , Horacio Franco

Dysarthric speech reconstruction (DSR), which aims to improve the quality of dysarthric speech, remains a challenge, not only because we need to restore the speech to be normal, but also must preserve the speaker's identity. The speaker…

音频与语音处理 · 电气工程与系统科学 2022-02-21 Disong Wang , Songxiang Liu , Xixin Wu , Hui Lu , Lifa Sun , Xunying Liu , Helen Meng

Unsupervised speech recognition (unsupervised ASR) aims to learn the ASR system with non-parallel speech and text corpus only. Wav2vec-U has shown promising results in unsupervised ASR by self-supervised speech representations coupled with…

音频与语音处理 · 电气工程与系统科学 2022-04-27 Guan-Ting Lin , Chan-Jan Hsu , Da-Rong Liu , Hung-Yi Lee , Yu Tsao