中文
相关论文

相关论文: Contextual-Utterance Training for Automatic Speech…

200 篇论文

In this work, we propose a training algorithm for an audio-visual automatic speech recognition (AV-ASR) system using deep recurrent neural network (RNN).First, we train a deep RNN acoustic model with a Connectionist Temporal Classification…

计算机视觉与模式识别 · 计算机科学 2016-11-10 Abhinav Thanda , Shankar M Venkatesan

This paper proposes a new approach to perform unsupervised fine-tuning and self-training using unlabeled speech data for recurrent neural network (RNN)-Transducer (RNN-T) end-to-end (E2E) automatic speech recognition (ASR) systems.…

计算与语言 · 计算机科学 2022-08-01 Cong-Thanh Do , Mohan Li , Rama Doddipatla

Speech enhancement (SE) systems are typically evaluated using a variety of instrumental metrics. The use of automatic speech recognition (ASR) systems to evaluate SE performance is common in literature, usually in terms of word error rate…

音频与语音处理 · 电气工程与系统科学 2026-05-13 Danilo de Oliveira , Tal Peer , Timo Gerkmann

Non-autoregressive automatic speech recognition (ASR) modeling has received increasing attention recently because of its fast decoding speed and superior performance. Among representatives, methods based on the connectionist temporal…

计算与语言 · 计算机科学 2022-10-13 Ke-Han Lu , Kuan-Yu Chen

Machine learning model weights and activations are represented in full-precision during training. This leads to performance degradation in runtime when deployed on neural network accelerator (NNA) chips, which leverage highly parallelized…

Recently, a few novel streaming attention-based sequence-to-sequence (S2S) models have been proposed to perform online speech recognition with linear-time decoding complexity. However, in these models, the decisions to generate tokens are…

计算与语言 · 计算机科学 2020-05-18 Hirofumi Inaguma , Yashesh Gaur , Liang Lu , Jinyu Li , Yifan Gong

Contextual automatic speech recognition (ASR) systems allow for recognizing out-of-vocabulary (OOV) words, such as named entities or rare words. However, it remains challenging due to limited training data and ambiguous or inconsistent…

计算与语言 · 计算机科学 2025-09-03 Changsong Liu , Yizhou Peng , Eng Siong Chng

Deep biasing improves automatic speech recognition (ASR) performance by incorporating contextual phrases. However, most existing methods enhance subwords in a contextual phrase as independent units, potentially compromising contextual…

声音 · 计算机科学 2025-05-30 Zhennan Lin , Kaixun Huang , Wei Ren , Linju Yang , Lei Xie

The two most popular loss functions for streaming end-to-end automatic speech recognition (ASR) are RNN-Transducer (RNN-T) and connectionist temporal classification (CTC). Between these two loss types we can classify the monotonic RNN-T…

音频与语音处理 · 电气工程与系统科学 2022-10-25 Niko Moritz , Frank Seide , Duc Le , Jay Mahadeokar , Christian Fuegen

Recurrent neural transducer (RNN-T) is a promising end-to-end (E2E) model in automatic speech recognition (ASR). It has shown superior performance compared to traditional hybrid ASR systems. However, training RNN-T from scratch is still…

音频与语音处理 · 电气工程与系统科学 2020-11-04 Mingkun Huang , Jun Zhang , Meng Cai , Yang Zhang , Jiali Yao , Yongbin You , Yi He , Zejun Ma

We present a streaming, Transformer-based end-to-end automatic speech recognition (ASR) architecture which achieves efficient neural inference through compute cost amortization. Our architecture creates sparse computation pathways…

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

音频与语音处理 · 电气工程与系统科学 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

The RNN-Transducer (RNN-T) framework for speech recognition has been growing in popularity, particularly for deployed real-time ASR systems, because it combines high accuracy with naturally streaming recognition. One of the drawbacks of…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Fangjun Kuang , Liyong Guo , Wei Kang , Long Lin , Mingshuang Luo , Zengwei Yao , Daniel Povey

In real-world applications, automatic speech recognition (ASR) systems must handle overlapping speech from multiple speakers and recognize rare words like technical terms. Traditional methods address multi-talker ASR and contextual biasing…

音频与语音处理 · 电气工程与系统科学 2025-06-17 Jiajun He , Naoki Sawada , Koichi Miyazaki , Tomoki Toda

Traditional automatic speech recognition~(ASR) systems usually focus on individual utterances, without considering long-form speech with useful historical information, which is more practical in real scenarios. Simply attending longer…

声音 · 计算机科学 2022-11-18 Xun Gong , Yu Wu , Jinyu Li , Shujie Liu , Rui Zhao , Xie Chen , Yanmin Qian

Deep learning approaches have been widely used in Automatic Speech Recognition (ASR) and they have achieved a significant accuracy improvement. Especially, Convolutional Neural Networks (CNNs) have been revisited in ASR recently. However,…

计算与语言 · 计算机科学 2017-02-28 Yisen Wang , Xuejiao Deng , Songbai Pu , Zhiheng Huang

This paper tackles several challenges that arise when integrating Automatic Speech Recognition (ASR) and Machine Translation (MT) for real-time, on-device streaming speech translation. Although state-of-the-art ASR systems based on…

计算与语言 · 计算机科学 2025-08-20 Zeeshan Ahmed , Frank Seide , Niko Moritz , Ju Lin , Ruiming Xie , Simone Merello , Zhe Liu , Christian Fuegen

Automatic speech recognition (ASR) models with low-footprint are increasingly being deployed on edge devices for conversational agents, which enhances privacy. We study the problem of federated continual incremental learning for recurrent…

音频与语音处理 · 电气工程与系统科学 2023-06-22 Milind Rao , Gopinath Chennupati , Gautam Tiwari , Anit Kumar Sahu , Anirudh Raju , Ariya Rastrow , Jasha Droppo

Statistical language models (LM) play a key role in Automatic Speech Recognition (ASR) systems used by conversational agents. These ASR systems should provide a high accuracy under a variety of speaking styles, domains, vocabulary and…

The neural transducer is an end-to-end model for automatic speech recognition (ASR). While the model is well-suited for streaming ASR, the training process remains challenging. During training, the memory requirements may quickly exceed the…

计算与语言 · 计算机科学 2023-03-14 Stefan Braun , Erik McDermott , Roger Hsiao