中文
相关论文

相关论文: Exploring RNN-Transducer for Chinese Speech Recogn…

200 篇论文

Although recent advances in deep learning technology have boosted automatic speech recognition (ASR) performance in the single-talker case, it remains difficult to recognize multi-talker speech in which many voices overlap. One conventional…

音频与语音处理 · 电气工程与系统科学 2022-09-20 Takafumi Moriya , Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Takahiro Shinozaki

With the recent advances in technology, automatic speech recognition (ASR) has been widely used in real-world applications. The efficiency of converting large amounts of speech into text accurately with limited resources has become more…

音频与语音处理 · 电气工程与系统科学 2021-12-09 Yoo Rhee Oh , Kiyoung Park , Jeon Gyu Park

In this work, we perform an empirical comparison among the CTC, RNN-Transducer, and attention-based Seq2Seq models for end-to-end speech recognition. We show that, without any language model, Seq2Seq and RNN-Transducer models both…

In this paper, we propose an RNN-Transducer model for recognizing Japanese and Chinese offline handwritten text line images. As far as we know, it is the first approach that adopts the RNN-Transducer model for offline handwritten text…

计算机视觉与模式识别 · 计算机科学 2021-06-29 Trung Tan Ngo , Hung Tuan Nguyen , Nam Tuan Ly , Masaki Nakagawa

As one of the most popular sequence-to-sequence modeling approaches for speech recognition, the RNN-Transducer has achieved evolving performance with more and more sophisticated neural network models of growing size and increasing training…

计算与语言 · 计算机科学 2023-10-20 Wei Zhou , Wilfried Michel , Ralf Schlüter , Hermann Ney

We present a novel approach to end-to-end automatic speech recognition (ASR) that utilizes pre-trained masked language models (LMs) to facilitate the extraction of linguistic information. The proposed models, BERT-CTC and BECTRA, are…

音频与语音处理 · 电气工程与系统科学 2024-10-02 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

We present a comprehensive study on building and adapting RNN transducer (RNN-T) models for spoken language understanding(SLU). These end-to-end (E2E) models are constructed in three practical settings: a case where verbatim transcripts are…

计算与语言 · 计算机科学 2021-04-09 Samuel Thomas , Hong-Kwang J. Kuo , George Saon , Zoltán Tüske , Brian Kingsbury , Gakuto Kurata , Zvi Kons , Ron Hoory

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

计算与语言 · 计算机科学 2016-10-12 Xiangang Li , Xihong Wu

Inspired by the progress of the End-to-End approach [1], this paper systematically studies the effects of Number of Filters of convolutional layers on the model prediction accuracy of CNN+RNN (Convolutional Neural Networks adding to…

机器学习 · 计算机科学 2021-02-05 James Mou , Jun Li

Speech transcription, emotion recognition, and language identification are usually considered to be three different tasks. Each one requires a different model with a different architecture and training process. We propose using a recurrent…

音频与语音处理 · 电气工程与系统科学 2022-07-29 Zvi Kons , Hagai Aronowitz , Edmilson Morais , Matheus Damasceno , Hong-Kwang Kuo , Samuel Thomas , George Saon

Traditional automatic speech recognition~(ASR) systems usually focus on individual utterances, without considering long-form speech with useful historical information, which is more practical in real scenarios. Simply attending longer…

声音 · 计算机科学 2022-11-18 Xun Gong , Yu Wu , Jinyu Li , Shujie Liu , Rui Zhao , Xie Chen , Yanmin Qian

In real-time speech recognition applications, the latency is an important issue. We have developed a character-level incremental speech recognition (ISR) system that responds quickly even during the speech, where the hypotheses are…

计算与语言 · 计算机科学 2016-06-29 Kyuyeon Hwang , Wonyong Sung

Transducer-based models, such as RNN-Transducer and transformer-transducer, have achieved great success in speech recognition. A typical transducer model decodes the output sequence conditioned on the current acoustic state and previously…

音频与语音处理 · 电气工程与系统科学 2021-04-08 Zhengkun Tian , Jiangyan Yi , Ye Bai , Jianhua Tao , Shuai Zhang , Zhengqi Wen

A deep learning approach has been widely applied in sequence modeling problems. In terms of automatic speech recognition (ASR), its performance has significantly been improved by increasing large speech corpus and deeper neural network.…

计算与语言 · 计算机科学 2016-12-28 Zewang Zhang , Zheng Sun , Jiaqi Liu , Jingwen Chen , Zhao Huo , Xiao Zhang

This paper proposes a new approach to perform unsupervised fine-tuning and self-training using unlabeled speech data for recurrent neural network (RNN)-Transducer (RNN-T) end-to-end (E2E) automatic speech recognition (ASR) systems.…

计算与语言 · 计算机科学 2022-08-01 Cong-Thanh Do , Mohan Li , Rama Doddipatla

Automatic Speech Recognition (ASR) based on Recurrent Neural Network Transducers (RNN-T) is gaining interest in the speech community. We investigate data selection and preparation choices aiming for improved robustness of RNN-T ASR to…

计算与语言 · 计算机科学 2020-12-14 Valentin Mendelev , Tina Raissi , Guglielmo Camporese , Manuel Giollo

The RNN-Transducers and improved attention-based encoder-decoder models are widely applied to streaming speech recognition. Compared with these two end-to-end models, the CTC model is more efficient in training and inference. However, it…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Zhengkun Tian , Jiangyan Yi , Ye Bai , Jianhua Tao , Shuai Zhang , Zhengqi Wen

In this paper, a multilingual end-to-end framework, called as ATCSpeechNet, is proposed to tackle the issue of translating communication speech into human-readable text in air traffic control (ATC) systems. In the proposed framework, we…

计算与语言 · 计算机科学 2021-02-18 Yi Lin , Bo Yang , Linchao Li , Dongyue Guo , Jianwei Zhang , Hu Chen , Yi Zhang

This paper describes a novel text-to-speech (TTS) technique based on deep convolutional neural networks (CNN), without use of any recurrent units. Recurrent neural networks (RNN) have become a standard technique to model sequential data…

声音 · 计算机科学 2020-10-01 Hideyuki Tachibana , Katsuya Uenoyama , Shunsuke Aihara

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

音频与语音处理 · 电气工程与系统科学 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li