中文
相关论文

相关论文: A study on the impact of Self-Supervised Learning …

200 篇论文

Textless self-supervised speech models have grown in capabilities in recent years, but the nature of the linguistic information they encode has not yet been thoroughly examined. We evaluate the extent to which these models' learned…

计算与语言 · 计算机科学 2023-06-13 Kinan Martin , Jon Gauthier , Canaan Breiss , Roger Levy

Self-supervised Transformer based models, such as wav2vec 2.0 and HuBERT, have produced significant improvements over existing approaches to automatic speech recognition (ASR). This is evident in the performance of the wav2vec 2.0 based…

计算与语言 · 计算机科学 2022-07-05 Mitchell DeHaven , Jayadev Billa

Self-supervised speech recognition models require considerable labeled training data for learning high-fidelity representations for Automatic Speech Recognition (ASR) which is computationally demanding and time-consuming. We consider the…

机器学习 · 计算机科学 2023-04-13 Abdul Hameed Azeemi , Ihsan Ayyub Qazi , Agha Ali Raza

\textbf{Objectives}: We aimed to investigate how errors from automatic speech recognition (ASR) systems affect dementia classification accuracy, specifically in the ``Cookie Theft'' picture description task. We aimed to assess whether…

计算与语言 · 计算机科学 2024-01-12 Changye Li , Weizhe Xu , Trevor Cohen , Serguei Pakhomov

Compared with automatic speech recognition (ASR), the human auditory system is more adept at handling noise-adverse situations, including environmental noise and channel distortion. To mimic this adeptness, auditory models have been widely…

计算与语言 · 计算机科学 2016-09-16 Peng Dai , Xue Teng , Frank Rudzicz , Ing Yann Soon

Automatic techniques in the context of motor speech disorders (MSDs) are typically two-class techniques aiming to discriminate between dysarthria and neurotypical speech or between dysarthria and apraxia of speech (AoS). Further, although…

声音 · 计算机科学 2021-06-03 I. Kodrasi , M. Pernon , M. Laganaro , H. Bourlard

The potential of deep learning in clinical speech processing is immense, yet the hurdles of limited and imbalanced clinical data samples loom large. This article addresses these challenges by showcasing the utilization of automatic speech…

Dysarthric speech poses significant challenges for individuals with dysarthria, impacting their ability to communicate socially. Despite the widespread use of Automatic Speech Recognition (ASR), accurately recognizing dysarthric speech…

声音 · 计算机科学 2025-02-14 Yan Wang , Mengyi Sun , Xinchen Kang , Jingting Li , Pengfei Guo , Ming Gao , Su-Jing Wang

Dysarthric speech reconstruction is challenging due to its pathological sound patterns. Preserving speaker identity, especially without access to normal speech, is a key challenge. Our proposed approach uses contrastive learning to extract…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Keshvari Fatemeh , Mahdian Toroghi Rahil , Zareian Hassan

Speech impairments caused by conditions such as cerebral palsy or genetic disorders pose significant challenges for automatic speech recognition (ASR) systems. Despite recent advances, ASR models like Whisper struggle with non-normative…

计算与语言 · 计算机科学 2025-06-30 Niclas Pokel , Pehuén Moure , Roman Boehringer , Yingqiang Gao

Self-supervised learning in speech involves training a speech representation network on a large-scale unannotated speech corpus, and then applying the learned representations to downstream tasks. Since the majority of the downstream tasks…

Background: An early diagnosis together with an accurate disease progression monitoring of multiple sclerosis is an important component of successful disease management. Prior studies have established that multiple sclerosis is correlated…

音频与语音处理 · 电气工程与系统科学 2021-09-28 Emil Svoboda , Tomáš Bořil , Jan Rusz , Tereza Tykalová , Dana Horáková , Charles R. G. Guttman , Krastan B. Blagoev , Hiroto Hatabu , Vlad I. Valtchinov

This paper presents a speech intelligibility model based on automatic speech recognition (ASR), combining phoneme probabilities from deep neural networks (DNN) and a performance measure that estimates the word error rate from these…

Speech pre-training has shown great success in learning useful and general latent representations from large-scale unlabeled data. Based on a well-designed self-supervised learning pattern, pre-trained models can be used to serve lots of…

音频与语音处理 · 电气工程与系统科学 2022-12-08 Pengcheng Li , Genshun Wan , Fenglin Ding , Hang Chen , Jianqing Gao , Jia Pan , Cong Liu

Self-supervised speech models have demonstrated impressive performance in speech processing, but their effectiveness on non-speech data remains underexplored. We study the transfer learning capabilities of such models on bioacoustic…

机器学习 · 计算机科学 2025-12-10 Jules Cauzinille , Marius Miron , Olivier Pietquin , Masato Hagiwara , Ricard Marxer , Arnaud Rey , Benoit Favre

Dysarthric speech recognition is a challenging task as dysarthric data is limited and its acoustics deviate significantly from normal speech. Model-based speaker adaptation is a promising method by using the limited dysarthric speech to…

音频与语音处理 · 电气工程与系统科学 2020-11-04 Disong Wang , Jianwei Yu , Xixin Wu , Lifa Sun , Xunying Liu , Helen Meng

Large-scale end-to-end models such as Whisper have shown strong performance on diverse speech tasks, but their internal behavior on pathological speech remains poorly understood. Understanding how dysarthric speech is represented across…

音频与语音处理 · 电气工程与系统科学 2025-10-07 Zhengjun Yue , Devendra Kayande , Zoran Cvetkovic , Erfan Loweimi

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech recognition (ASR). An ASR model with decent performance can be realized by fine-tuning an SSL model with…

音频与语音处理 · 电气工程与系统科学 2023-08-30 Zhisheng Zheng , Ziyang Ma , Yu Wang , Xie Chen

Despite recent progress in multilingual speech processing, African languages remain under-represented in both research and deployed systems, particularly when it comes to strong, open-weight encoders that transfer well under low-resource…

计算与语言 · 计算机科学 2025-12-01 Antoine Caubrière , Elodie Gauthier

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

计算与语言 · 计算机科学 2023-09-28 Yanan Jia