中文
相关论文

相关论文: Transformer-based Online Speech Recognition with D…

200 篇论文

The recent emergence of joint CTC-Attention model shows significant improvement in automatic speech recognition (ASR). The improvement largely lies in the modeling of linguistic information by decoder. The decoder joint-optimized with an…

计算与语言 · 计算机科学 2022-10-27 Xulong Zhang , Jianzong Wang , Ning Cheng , Mengyuan Zhao , Zhiyong Zhang , Jing Xiao

The demand for fast and accurate incremental speech recognition increases as the applications of automatic speech recognition (ASR) proliferate. Incremental speech recognizers output chunks of partially recognized words while the user is…

计算与语言 · 计算机科学 2020-08-18 Yuan Shangguan , Kate Knister , Yanzhang He , Ian McGraw , Francoise Beaufays

Non-autoregressive automatic speech recognition (ASR) has become a mainstream of ASR modeling because of its fast decoding speed and satisfactory result. To further boost the performance, relaxing the conditional independence assumption and…

计算与语言 · 计算机科学 2023-05-19 Chong-En Lin , Kuan-Yu Chen

The accuracy of end-to-end (E2E) automatic speech recognition (ASR) models continues to improve as they are scaled to larger sizes, with some now reaching billions of parameters. Widespread deployment and adoption of these models, however,…

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

计算与语言 · 计算机科学 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

End-to-end automatic speech recognition (ASR) models, including both attention-based models and the recurrent neural network transducer (RNN-T), have shown superior performance compared to conventional systems. However, previous studies…

Attention-based end-to-end automatic speech recognition (ASR) systems have recently demonstrated state-of-the-art results for numerous tasks. However, the application of self-attention and attention-based encoder-decoder models remains…

音频与语音处理 · 电气工程与系统科学 2021-07-06 Niko Moritz , Takaaki Hori , Jonathan Le Roux

Prompts are crucial to large language models as they provide context information such as topic or logical relationships. Inspired by this, we propose PromptASR, a framework that integrates prompts in end-to-end automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2024-01-25 Xiaoyu Yang , Wei Kang , Zengwei Yao , Yifan Yang , Liyong Guo , Fangjun Kuang , Long Lin , Daniel Povey

While Transformers have achieved promising results in end-to-end (E2E) automatic speech recognition (ASR), their autoregressive (AR) structure becomes a bottleneck for speeding up the decoding process. For real-world deployment, ASR systems…

音频与语音处理 · 电气工程与系统科学 2022-01-27 Keqi Deng , Zehui Yang , Shinji Watanabe , Yosuke Higuchi , Gaofeng Cheng , Pengyuan Zhang

Recently, several studies reported that dot-product selfattention (SA) may not be indispensable to the state-of-theart Transformer models. Motivated by the fact that dense synthesizer attention (DSA), which dispenses with dot products and…

声音 · 计算机科学 2021-07-27 Menglong Xu , Shengqiang Li , Xiao-Lei Zhang

End-to-end (E2E) automatic speech recognition (ASR) can operate in two modes: streaming and non-streaming, each with its pros and cons. Streaming ASR processes the speech frames in real-time as it is being received, while non-streaming ASR…

音频与语音处理 · 电气工程与系统科学 2024-09-12 Muhammad Shakeel , Yui Sudo , Yifan Peng , Shinji Watanabe

Recently, end-to-end (E2E) speech recognition has become popular, since it can integrate the acoustic, pronunciation and language models into a single neural network, which outperforms conventional models. Among E2E approaches,…

声音 · 计算机科学 2021-07-08 Zhifu Gao , Yiwu Yao , Shiliang Zhang , Jun Yang , Ming Lei , Ian McLoughlin

Recently, speaker-attributed automatic speech recognition (SA-ASR) has attracted a wide attention, which aims at answering the question ``who spoke what''. Different from modular systems, end-to-end (E2E) SA-ASR minimizes the…

音频与语音处理 · 电气工程与系统科学 2023-05-23 Mohan Shi , Zhihao Du , Qian Chen , Fan Yu , Yangze Li , Shiliang Zhang , Jie Zhang , Li-Rong Dai

Recent studies reveal the potential of recurrent neural network transducer (RNN-T) for end-to-end (E2E) speech recognition. Among some most popular E2E systems including RNN-T, Attention Encoder-Decoder (AED), and Connectionist Temporal…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Bin Wang , Yan Yin , Hui Lin

We study speech intent classification and slot filling (SICSF) by proposing to use an encoder pretrained on speech recognition (ASR) to initialize an end-to-end (E2E) Conformer-Transformer model, which achieves the new state-of-the-art…

计算与语言 · 计算机科学 2023-07-17 He Huang , Jagadeesh Balam , Boris Ginsburg

We present a streaming, Transformer-based end-to-end automatic speech recognition (ASR) architecture which achieves efficient neural inference through compute cost amortization. Our architecture creates sparse computation pathways…

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

End-to-end speech recognition is a promising technology for enabling compact automatic speech recognition (ASR) systems since it can unify the acoustic and language model into a single neural network. However, as a drawback, training of…

计算与语言 · 计算机科学 2022-02-17 Yotaro Kubo , Shigeki Karita , Michiel Bacchiani

We propose a cross-modal transformer-based neural correction models that refines the output of an automatic speech recognition (ASR) system so as to exclude ASR errors. Generally, neural correction models are composed of encoder-decoder…

We live in a world where 60% of the population can speak two or more languages fluently. Members of these communities constantly switch between languages when having a conversation. As automatic speech recognition (ASR) systems are being…

计算与语言 · 计算机科学 2021-02-16 Siddharth Dalmia , Yuzong Liu , Srikanth Ronanki , Katrin Kirchhoff