中文
相关论文

相关论文: Overcoming Domain Mismatch in Low Resource Sequenc…

200 篇论文

Mismatched transcriptions have been proposed as a mean to acquire probabilistic transcriptions from non-native speakers of a language.Prior work has demonstrated the value of these transcriptions by successfully adapting cross-lingual ASR…

计算与语言 · 计算机科学 2017-01-16 Xiang Kong , Preethi Jyothi , Mark Hasegawa-Johnson

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

In Automatic Speech Recognition (ASR), teacher-student (T/S) training has shown to perform well for domain adaptation with small amount of training data. However, adaption without ground-truth labels is still challenging. A previous study…

音频与语音处理 · 电气工程与系统科学 2024-02-08 Rehan Ahmad , Muhammad Umar Farooq , Thomas Hain

The cross-domain performance of automatic speech recognition (ASR) could be severely hampered due to the mismatch between training and testing distributions. Since the target domain usually lacks labeled data, and domain shifts exist at…

音频与语音处理 · 电气工程与系统科学 2023-08-01 Han Zhu , Gaofeng Cheng , Jindong Wang , Wenxin Hou , Pengyuan Zhang , Yonghong Yan

Text to speech (TTS) and automatic speech recognition (ASR) are two dual tasks in speech processing and both achieve impressive performance thanks to the recent advance in deep learning and large amount of aligned speech and text data.…

音频与语音处理 · 电气工程与系统科学 2020-07-28 Yi Ren , Xu Tan , Tao Qin , Sheng Zhao , Zhou Zhao , Tie-Yan Liu

Automatic speech recognition (ASR) performance has improved drastically in recent years, mainly enabled by self-supervised learning (SSL) based acoustic models such as wav2vec2 and large-scale multi-lingual training like Whisper. A huge…

We introduce DAS (Domain Adaptation with Synthetic data), a novel domain adaptation framework for pre-trained ASR model, designed to efficiently adapt to various language-defined domains without requiring any real data. In particular, DAS…

音频与语音处理 · 电气工程与系统科学 2025-01-23 Minh Tran , Yutong Pang , Debjyoti Paul , Laxmi Pandey , Kevin Jiang , Jinxi Guo , Ke Li , Shun Zhang , Xuedong Zhang , Xin Lei

Despite the impressive performance recently achieved by automatic speech recognition (ASR), we observe two primary challenges that hinder its broader applications: (1) The difficulty of introducing scalability into the model to support more…

音频与语音处理 · 电气工程与系统科学 2023-06-29 Zhongzhi Yu , Yang Zhang , Kaizhi Qian , Yonggan Fu , Yingyan Lin

Automatic Speech Recognition (ASR) traditionally assumes known domains, but adding data from a new domain raises concerns about computational inefficiencies linked to retraining models on both existing and new domains. Fine-tuning solely on…

计算与语言 · 计算机科学 2024-09-25 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Nikolaos Pappas , Srikanth Ronanki

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

计算与语言 · 计算机科学 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

In this paper, we investigate domain adaptation for low-resource Automatic Speech Recognition (ASR) of target-domain data, when a well-trained ASR model trained with a large dataset is available. We argue that in the encoder-decoder…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Vrunda N. Sukhadia , S. Umesh

This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model. We trained a neural network,…

音频与语音处理 · 电气工程与系统科学 2023-06-05 Shuo Liu , Leda Sarı , Chunyang Wu , Gil Keren , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli

While many speakers of low-resource languages regularly code-switch between their languages and other regional languages or English, datasets of codeswitched speech are too small to train bespoke acoustic models from scratch or do language…

计算与语言 · 计算机科学 2023-11-28 Tolúlopé Ògúnrèmí , Christopher D. Manning , Dan Jurafsky

Recent advances in deep learning and automatic speech recognition (ASR) have enabled the end-to-end (E2E) ASR system and boosted the accuracy to a new level. The E2E systems implicitly model all conventional ASR components, such as the…

We propose a new framework to improve automatic speech recognition (ASR) systems in resource-scarce environments using a generative adversarial network (GAN) operating on acoustic input features. The GAN is used to enhance the features of…

声音 · 计算机科学 2022-10-07 Walter Heymans , Marelie H. Davel , Charl van Heerden

In this paper, we present our overall efforts to improve the performance of a code-switching speech recognition system using semi-supervised training methods from lexicon learning to acoustic modeling, on the South East Asian…

计算与语言 · 计算机科学 2018-06-19 Pengcheng Guo , Haihua Xu , Lei Xie , Eng Siong Chng

Modern ASR systems are typically trained on large-scale pseudo-labeled, in-the-wild data spanning multiple domains. While such heterogeneous data benefit generalist models designed for broad deployment, they pose challenges for specialist…

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

音频与语音处理 · 电气工程与系统科学 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu

Automatic speech recognition for low-resource languages remains fundamentally constrained by the scarcity of labeled data and computational resources required by state-of-the-art models. We present a systematic investigation into…

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

计算与语言 · 计算机科学 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian