中文
相关论文

相关论文: Crossmodal ASR Error Correction with Discrete Spee…

200 篇论文

Recognizing written domain numeric utterances (e.g. I need $1.25.) can be challenging for ASR systems, particularly when numeric sequences are not seen during training. This out-of-vocabulary (OOV) issue is addressed in conventional ASR…

音频与语音处理 · 电气工程与系统科学 2019-07-03 Cal Peyser , Hao Zhang , Tara N. Sainath , Zelin Wu

Automatic Speech Recognition (ASR) systems suffer considerably when source speech is corrupted with noise or room impulse responses (RIR). Typically, speech enhancement is applied in both mismatched and matched scenario training and…

音频与语音处理 · 电气工程与系统科学 2022-04-26 Shashi Kumar , Shakti P. Rath , Abhishek Pandey

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

计算与语言 · 计算机科学 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1,000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system. Contrary to what one might expect, despite the data being…

音频与语音处理 · 电气工程与系统科学 2025-12-22 Jimmy Tobin , Katrin Tomanek , Subhashini Venugopalan

Recent work on self-supervised pre-training focus on leveraging large-scale unlabeled speech data to build robust end-to-end (E2E) acoustic models (AM) that can be later fine-tuned on downstream tasks e.g., automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2022-10-18 Juan Zuluaga-Gomez , Amrutha Prasad , Iuliia Nigmatulina , Saeed Sarfjoo , Petr Motlicek , Matthias Kleinert , Hartmut Helmke , Oliver Ohneiser , Qingran Zhan

ASR endpointing (EP) plays a major role in delivering a good user experience in products supporting human or artificial agents in human-human/machine conversations. Transducer-based ASR (T-ASR) is an end-to-end (E2E) ASR modelling technique…

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Jenthe Thienpondt , Kris Demuynck

With the massive developments of end-to-end (E2E) neural networks, recent years have witnessed unprecedented breakthroughs in automatic speech recognition (ASR). However, the codeswitching phenomenon remains a major obstacle that hinders…

计算与语言 · 计算机科学 2024-02-28 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Chi-Han Lin , Berlin Chen

Multi-speaker automatic speech recognition (ASR) is crucial for many real-world applications, but it requires dedicated modeling techniques. Existing approaches can be divided into modular and end-to-end methods. Modular approaches separate…

计算与语言 · 计算机科学 2023-06-22 Simon Berger , Peter Vieting , Christoph Boeddeker , Ralf Schlüter , Reinhold Haeb-Umbach

Sequence-to-sequence attention-based models integrate an acoustic, pronunciation and language model into a single neural network, which make them very suitable for multilingual automatic speech recognition (ASR). In this paper, we are…

音频与语音处理 · 电气工程与系统科学 2018-06-15 Shiyu Zhou , Shuang Xu , Bo Xu

Accurately classifying accents and assessing accentedness in non-native speakers are both challenging tasks due to the complexity and diversity of accent and dialect variations. In this study, embeddings from advanced pre-trained language…

音频与语音处理 · 电气工程与系统科学 2023-10-18 Shahram Ghorbani , John H. L. Hansen

Mapping two modalities, speech and text, into a shared representation space, is a research topic of using text-only data to improve end-to-end automatic speech recognition (ASR) performance in new domains. However, the length of speech…

声音 · 计算机科学 2023-10-10 Jiaxu Zhu , Weinan Tong , Yaoxun Xu , Changhe Song , Zhiyong Wu , Zhao You , Dan Su , Dong Yu , Helen Meng

In a pipeline speech translation system, automatic speech recognition (ASR) system will transmit errors in recognition to the downstream machine translation (MT) system. A standard machine translation system is usually trained on parallel…

计算与语言 · 计算机科学 2019-10-29 Qiao Cheng , Meiyuan Fang , Yaqian Han , Jin Huang , Yitao Duan

The recent emergence of joint CTC-Attention model shows significant improvement in automatic speech recognition (ASR). The improvement largely lies in the modeling of linguistic information by decoder. The decoder joint-optimized with an…

计算与语言 · 计算机科学 2022-10-27 Xulong Zhang , Jianzong Wang , Ning Cheng , Mengyuan Zhao , Zhiyong Zhang , Jing Xiao

Voice digital assistants must keep up with trending search queries. We rely on a speech recognition model using contextual biasing with a rapidly updated set of entities, instead of frequent model retraining, to keep up with trends. There…

计算与语言 · 计算机科学 2023-06-13 Tianyu Huang , Chung Hoon Hong , Carl Wivagg , Kanna Shimizu

The advances in attention-based encoder-decoder (AED) networks have brought great progress to end-to-end (E2E) automatic speech recognition (ASR). One way to further improve the performance of AED-based E2E ASR is to introduce an extra text…

声音 · 计算机科学 2021-10-26 Wei Wang , Shuo Ren , Yao Qian , Shujie Liu , Yu Shi , Yanmin Qian , Michael Zeng

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

计算与语言 · 计算机科学 2023-09-28 Yanan Jia

Despite advancements in speech recognition, accented speech remains challenging. While previous approaches have focused on modeling techniques or creating accented speech datasets, gathering sufficient data for the multitude of accents,…

Semi-supervised training (SST) is a common approach to leverage untranscribed/unlabeled speech data to improve automatic speech recognition performance in low-resource languages. However, if the available unlabeled speech is mismatched to…

计算与语言 · 计算机科学 2021-06-03 Jayadev Billa

Automatic speech recognition (ASR) systems remain brittle on dysarthric and other atypical speech. Recent audio-language models raise the possibility of improving performance by conditioning on additional clinical context at inference time,…