中文
相关论文

相关论文: Accent-Robust Automatic Speech Recognition Using S…

200 篇论文

Self-supervised-learning-based pre-trained models for speech data, such as Wav2Vec 2.0 (W2V2), have become the backbone of many speech tasks. In this paper, to achieve speaker diarisation and speech recognition using a single model, a…

音频与语音处理 · 电气工程与系统科学 2022-07-11 Xianrui Zheng , Chao Zhang , Philip C. Woodland

Speech to text models tend to be trained and evaluated against a single target accent. This is especially true for English for which native speakers from the United States became the main benchmark. In this work, we are going to show how…

计算与语言 · 计算机科学 2022-12-26 Pooja Chitkara , Morgane Riviere , Jade Copet , Frank Zhang , Yatharth Saraf

As automatic speech recognition (ASR) systems are now being widely deployed in the wild, the increasing threat of adversarial attacks raises serious questions about the security and reliability of using such systems. On the other hand,…

音频与语音处理 · 电气工程与系统科学 2022-04-06 Nilaksh Das , Duen Horng Chau

Accents play a pivotal role in shaping human communication, enhancing our ability to convey and comprehend messages with clarity and cultural nuance. While there has been significant progress in Automatic Speech Recognition (ASR),…

计算与语言 · 计算机科学 2025-06-24 Bonaventure F. P. Dossou

To address the performance gap of English ASR models on L2 English speakers, we evaluate fine-tuning of pretrained wav2vec 2.0 models (Baevski et al., 2020; Xu et al., 2021) on L2-ARCTIC, a non-native English speech corpus (Zhao et al.,…

音频与语音处理 · 电气工程与系统科学 2021-10-18 Toshiko Shibano , Xinyi Zhang , Mia Taige Li , Haejin Cho , Peter Sullivan , Muhammad Abdul-Mageed

Wav2vec2.0 is a popular self-supervised pre-training framework for learning speech representations in the context of automatic speech recognition (ASR). It was shown that wav2vec2.0 has a good robustness against the domain shift, while the…

音频与语音处理 · 电气工程与系统科学 2022-05-10 Qiu-Shi Zhu , Jie Zhang , Zi-Qiang Zhang , Ming-Hui Wu , Xin Fang , Li-Rong Dai

Despite recent advancements in deep learning technologies, Child Speech Recognition remains a challenging task. Current Automatic Speech Recognition (ASR) models require substantial amounts of annotated data for training, which is scarce.…

音频与语音处理 · 电气工程与系统科学 2023-02-14 Rishabh Jain , Andrei Barcovschi , Mariam Yiwere , Dan Bigioi , Peter Corcoran , Horia Cucu

Producing a large amount of annotated speech data for training ASR systems remains difficult for more than 95% of languages all over the world which are low-resourced. However, we note human babies start to learn the language by the sounds…

计算与语言 · 计算机科学 2019-04-11 Yi-Chen Chen , Sung-Feng Huang , Hung-yi Lee , Lin-shan Lee

Modern ASR systems are typically trained on large-scale pseudo-labeled, in-the-wild data spanning multiple domains. While such heterogeneous data benefit generalist models designed for broad deployment, they pose challenges for specialist…

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

声音 · 计算机科学 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

Automatic speech recognition (ASR) has been widely researched with supervised approaches, while many low-resourced languages lack audio-text aligned data, and supervised methods cannot be applied on them. In this work, we propose a…

计算与语言 · 计算机科学 2018-08-14 Yi-Chen Chen , Chia-Hao Shen , Sung-Feng Huang , Hung-yi Lee

Speech distortions are a long-standing problem that degrades the performance of supervisely trained speech processing models. It is high time that we enhance the robustness of speech processing models to obtain good performance when…

声音 · 计算机科学 2022-07-26 Kuan Po Huang , Yu-Kuan Fu , Yu Zhang , Hung-yi Lee

Speech accents present a serious challenge to the performance of state-of-the-art end-to-end Automatic Speech Recognition (ASR) systems. Even with self-supervised learning and pre-training of ASR models, accent invariance is seldom…

计算与语言 · 计算机科学 2024-07-08 Darshan Prabhu , Abhishek Gupta , Omkar Nitsure , Preethi Jyothi , Sriram Ganapathy

Speaker verification systems often degrade significantly when there is a language mismatch between training and testing data. Being able to improve cross-lingual speaker verification system using unlabeled data can greatly increase the…

音频与语音处理 · 电气工程与系统科学 2020-09-03 Wei Xia , Jing Huang , John H. L. Hansen

Recent work on self-supervised pre-training focus on leveraging large-scale unlabeled speech data to build robust end-to-end (E2E) acoustic models (AM) that can be later fine-tuned on downstream tasks e.g., automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2022-10-18 Juan Zuluaga-Gomez , Amrutha Prasad , Iuliia Nigmatulina , Saeed Sarfjoo , Petr Motlicek , Matthias Kleinert , Hartmut Helmke , Oliver Ohneiser , Qingran Zhan

Automatic speech recognition (ASR) is crucial for human-machine interaction in diverse applications like conversational agents, industrial robotics, call center automation, and automated subtitling. However, developing high-performance ASR…

Self-supervised pre-training could effectively improve the performance of low-resource automatic speech recognition (ASR). However, existing self-supervised pre-training are task-agnostic, i.e., could be applied to various downstream tasks.…

音频与语音处理 · 电气工程与系统科学 2022-06-20 Han Zhu , Li Wang , Jindong Wang , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

Local dialects influence people to pronounce words of the same language differently from each other. The great variability and complex characteristics of accents creates a major challenge for training a robust and accent-agnostic automatic…

音频与语音处理 · 电气工程与系统科学 2020-03-05 Genta Indra Winata , Samuel Cahyawijaya , Zihan Liu , Zhaojiang Lin , Andrea Madotto , Peng Xu , Pascale Fung

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

声音 · 计算机科学 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Creating Automatic Speech Recognition (ASR) systems that are robust and resilient to classroom conditions is paramount to the development of AI tools to aid teachers and students. In this work, we study the efficacy of continued pretraining…

计算与语言 · 计算机科学 2024-05-24 Ahmed Adel Attia , Dorottya Demszky , Tolulope Ogunremi , Jing Liu , Carol Espy-Wilson