English
Related papers

Related papers: Toward Streaming ASR with Non-Autoregressive Inser…

200 papers

ASR endpointing (EP) plays a major role in delivering a good user experience in products supporting human or artificial agents in human-human/machine conversations. Transducer-based ASR (T-ASR) is an end-to-end (E2E) ASR modelling technique…

In the present paper, an attempt is made to combine Mask-CTC and the triggered attention mechanism to construct a streaming end-to-end automatic speech recognition (ASR) system that provides high performance with low latency. The triggered…

Sound · Computer Science 2021-10-22 Huaibo Zhao , Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

The autoregressive (AR) models, such as attention-based encoder-decoder models and RNN-Transducer, have achieved great success in speech recognition. They predict the output sequence conditioned on the previous tokens and acoustic encoded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Zhengkun Tian , Jiangyan Yi , Jianhua Tao , Ye Bai , Shuai Zhang , Zhengqi Wen , Xuefei Liu

This paper describes a variational auto-encoder based non-autoregressive text-to-speech (VAENAR-TTS) model. The autoregressive TTS (AR-TTS) models based on the sequence-to-sequence architecture can generate high-quality speech, but their…

Sound · Computer Science 2021-07-08 Hui Lu , Zhiyong Wu , Xixin Wu , Xu Li , Shiyin Kang , Xunying Liu , Helen Meng

While Transformers have achieved promising results in end-to-end (E2E) automatic speech recognition (ASR), their autoregressive (AR) structure becomes a bottleneck for speeding up the decoding process. For real-world deployment, ASR systems…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-27 Keqi Deng , Zehui Yang , Shinji Watanabe , Yosuke Higuchi , Gaofeng Cheng , Pengyuan Zhang

Due to the simple design pipeline, end-to-end (E2E) neural models for speech enhancement (SE) have attracted great interest. In order to improve the performance of the E2E model, the locality and temporal sequential properties of speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Tsun-An Hsieh , Hsin-Min Wang , Xugang Lu , Yu Tsao

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

Computation and Language · Computer Science 2023-09-28 Yanan Jia

While autoregressive (AR) LLM-based ASR systems achieve strong accuracy, their sequential decoding limits parallelism and incurs high latency. We propose NLE, a non-autoregressive (NAR) approach that formulates speech recognition as…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Avihu Dekel , Samuel Thomas , Takashi Fukada , George Saon

Speech applications in far-field real world settings often deal with signals that are corrupted by reverberation. The task of dereverberation constitutes an important step to improve the audible quality and to reduce the error rates in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-26 Anurenjan Purushothaman , Debottam Dutta , Rohit Kumar , Sriram Ganapathy

Automatic speech quality assessment has raised more attention as an alternative or support to traditional perceptual clinical evaluation. However, most research so far only gains good results on simple tasks such as binary classification,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-01 Tuan Nguyen , Corinne Fredouille , Alain Ghio , Mathieu Balaguer , Virginie Woisard

Recent advances in Automatic Speech Recognition (ASR) demonstrated how end-to-end systems are able to achieve state-of-the-art performance. There is a trend towards deeper neural networks, however those ASR models are also more complex and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-22 Ludwig Kürzinger , Edgar Ricardo Chavez Rosas , Lujun Li , Tobias Watzel , Gerhard Rigoll

Language identification is critical for many downstream tasks in automatic speech recognition (ASR), and is beneficial to integrate into multilingual end-to-end ASR as an additional task. In this paper, we propose to modify the structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-14 Chao Zhang , Bo Li , Tara Sainath , Trevor Strohman , Sepand Mavandadi , Shuo-yiin Chang , Parisa Haghani

End-to-end transformer-based automatic speech recognition (ASR) systems often capture multiple speech traits in their learned representations that are highly entangled, leading to a lack of interpretability. In this study, we propose the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Pu Wang , Hugo Van hamme

Despite the rapid progress of end-to-end (E2E) automatic speech recognition (ASR), it has been shown that incorporating external language models (LMs) into the decoding can further improve the recognition performance of E2E ASR systems. To…

Computation and Language · Computer Science 2022-04-13 Jinchuan Tian , Jianwei Yu , Chao Weng , Yuexian Zou , Dong Yu

Audiovisual speech recognition (AVSR) is a method to alleviate the adverse effect of noise in the acoustic signal. Leveraging recent developments in deep neural network-based speech recognition, we present an AVSR neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Michael Wand , Ngoc Thang Vu , Juergen Schmidhuber

Attention-based end-to-end automatic speech recognition (ASR) systems have recently demonstrated state-of-the-art results for numerous tasks. However, the application of self-attention and attention-based encoder-decoder models remains…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Niko Moritz , Takaaki Hori , Jonathan Le Roux

We propose a streaming non-autoregressive (non-AR) decoding algorithm to deliberate the hypothesis alignment of a streaming RNN-T model. Our algorithm facilitates a simple greedy decoding procedure, and at the same time is capable of…

Computation and Language · Computer Science 2022-04-18 Weiran Wang , Ke Hu , Tara N. Sainath

Despite improved performances of the latest Automatic Speech Recognition (ASR) systems, transcription errors are still unavoidable. These errors can have a considerable impact in critical domains such as healthcare, when used to help with…

Computation and Language · Computer Science 2022-07-25 Nimshi Venkat Meripo , Sandeep Konam

Sequence-to-sequence models have shown success in end-to-end speech recognition. However these models have only used shallow acoustic encoder networks. In our work, we successively train very deep convolutional networks to add more…

Computation and Language · Computer Science 2016-10-11 Yu Zhang , William Chan , Navdeep Jaitly

We propose an end-to-end Automatic Speech Recognition (ASR) system that can be trained on transcribed speech data, text-only data, or a mixture of both. The proposed model uses an integrated auxiliary block for text-based training. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Vladimir Bataev , Roman Korostik , Evgeny Shabalin , Vitaly Lavrukhin , Boris Ginsburg