English
Related papers

Related papers: RNN-Transducer-based Losses for Speech Recognition…

200 papers

End-to-end model, especially Recurrent Neural Network Transducer (RNN-T), has achieved great success in speech recognition. However, transducer requires a great memory footprint and computing time when processing a long decoding sequence.…

Sound · Computer Science 2023-07-18 Xiaohui Zhang , Mangui Liang , Zhengkun Tian , Jiangyan Yi , Jianhua Tao

Target-speaker speech recognition aims to recognize target-speaker speech from noisy environments with background noise and interfering speakers. This work presents a joint framework that combines time-domain target-speaker speech…

Sound · Computer Science 2021-03-01 Jiatong Shi , Chunlei Zhang , Chao Weng , Shinji Watanabe , Meng Yu , Dong Yu

There is a growing interest in the speech community in developing Recurrent Neural Network Transducer (RNN-T) models for automatic speech recognition (ASR) applications. RNN-T is trained with a loss function that does not enforce temporal…

Computation and Language · Computer Science 2020-11-20 Jay Mahadeokar , Yuan Shangguan , Duc Le , Gil Keren , Hang Su , Thong Le , Ching-Feng Yeh , Christian Fuegen , Michael L. Seltzer

Recently, several types of end-to-end speech recognition methods named transformer-transducer were introduced. According to those kinds of methods, transcription networks are generally modeled by transformer-based neural networks, while…

Machine Learning · Computer Science 2020-11-03 Jae-Jin Jeon , Eesung Kim

This paper proposes a modification to RNN-Transducer (RNN-T) models for automatic speech recognition (ASR). In standard RNN-T, the emission of a blank symbol consumes exactly one input frame; in our proposed method, we introduce additional…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-15 Hainan Xu , Fei Jia , Somshubra Majumdar , Shinji Watanabe , Boris Ginsburg

The recurrent neural network transducer (RNN-T) objective plays a major role in building today's best automatic speech recognition (ASR) systems for production. Similarly to the connectionist temporal classification (CTC) objective, the…

Computation and Language · Computer Science 2022-04-01 Niko Moritz , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux

RNN-Transducers (RNN-Ts) have gained widespread acceptance as an end-to-end model for speech to text conversion because of their high accuracy and streaming capabilities. A typical RNN-T independently encodes the input audio and the text…

Computation and Language · Computer Science 2023-07-12 Vinit S. Unni , Ashish Mittal , Preethi Jyothi , Sunita Sarawagi

The Transducer (e.g. RNN-Transducer or Conformer-Transducer) generates an output label sequence as it traverses the input sequence. It is straightforward to use in streaming mode, where it generates partial hypotheses before the complete…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-21 Rogier van Dalen

The RNN-Transducer (RNN-T) framework for speech recognition has been growing in popularity, particularly for deployed real-time ASR systems, because it combines high accuracy with naturally streaming recognition. One of the drawbacks of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Fangjun Kuang , Liyong Guo , Wei Kang , Long Lin , Mingshuang Luo , Zengwei Yao , Daniel Povey

In this paper, several works are proposed to address practical challenges for deploying RNN Transducer (RNN-T) based speech recognition system. These challenges are adapting a well-trained RNN-T model to a new domain without collecting the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-20 Rui Zhao , Jian Xue , Jinyu Li , Wenning Wei , Lei He , Yifan Gong

End-to-end approaches have drawn much attention recently for significantly simplifying the construction of an automatic speech recognition (ASR) system. RNN transducer (RNN-T) is one of the popular end-to-end methods. Previous studies have…

Computation and Language · Computer Science 2019-04-24 Senmao Wang , Pan Zhou , Wei Chen , Jia Jia , Lei Xie

We investigate training end-to-end speech recognition models with the recurrent neural network transducer (RNN-T): a streaming, all-neural, sequence-to-sequence architecture which jointly learns acoustic and language model components from…

Computation and Language · Computer Science 2018-01-04 Kanishka Rao , Haşim Sak , Rohit Prabhavalkar

The acoustic and linguistic features are important cues for the spoken language identification (LID) task. Recent advanced LID systems mainly use acoustic features that lack the usage of explicit linguistic feature encoding. In this paper,…

Computation and Language · Computer Science 2022-08-01 Peng Shen , Xugang Lu , Hisashi Kawai

Recently, recurrent neural network transducer (RNN-T) gains increasing popularity due to its natural streaming capability as well as superior performance. Nevertheless, RNN-T training requires large time and computation resources as RNN-T…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-22 Keyu An , Xian Shi , Shiliang Zhang

In this paper we present an end-to-end speech recognition model with Transformer encoders that can be used in a streaming speech recognition system. Transformer computation blocks based on self-attention are used to encode both audio and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Qian Zhang , Han Lu , Hasim Sak , Anshuman Tripathi , Erik McDermott , Stephen Koo , Shankar Kumar

Recently, language identity information has been utilized to improve the performance of end-to-end code-switching (CS) speech recognition. However, previous works use an additional language identification (LID) model as an auxiliary module,…

Computation and Language · Computer Science 2020-02-20 Shuai Zhang , Jiangyan Yi , Zhengkun Tian , Jianhua Tao , Ye Bai

Machine learning model weights and activations are represented in full-precision during training. This leads to performance degradation in runtime when deployed on neural network accelerator (NNA) chips, which leverage highly parallelized…

Automatic Speech Recognition (ASR) based on Recurrent Neural Network Transducers (RNN-T) is gaining interest in the speech community. We investigate data selection and preparation choices aiming for improved robustness of RNN-T ASR to…

Computation and Language · Computer Science 2020-12-14 Valentin Mendelev , Tina Raissi , Guglielmo Camporese , Manuel Giollo

Recent studies reveal the potential of recurrent neural network transducer (RNN-T) for end-to-end (E2E) speech recognition. Among some most popular E2E systems including RNN-T, Attention Encoder-Decoder (AED), and Connectionist Temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Bin Wang , Yan Yin , Hui Lin

RNN-Transducer has been one of promising architectures for end-to-end automatic speech recognition. Although RNN-Transducer has many advantages including its strong accuracy and streaming-friendly property, its high memory consumption…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-01 Jaesong Lee , Lukas Lee , Shinji Watanabe
‹ Prev 1 2 3 10 Next ›