中文
相关论文

相关论文: Toward Streaming ASR with Non-Autoregressive Inser…

200 篇论文

Non-autoregressive (NAR) models simultaneously generate multiple outputs in a sequence, which significantly reduces the inference speed at the cost of accuracy drop compared to autoregressive baselines. Showing great potential for real-time…

音频与语音处理 · 电气工程与系统科学 2021-10-12 Yosuke Higuchi , Nanxin Chen , Yuya Fujita , Hirofumi Inaguma , Tatsuya Komatsu , Jaesong Lee , Jumon Nozaki , Tianzi Wang , Shinji Watanabe

End-to-end (E2E) automatic speech recognition (ASR) can operate in two modes: streaming and non-streaming, each with its pros and cons. Streaming ASR processes the speech frames in real-time as it is being received, while non-streaming ASR…

音频与语音处理 · 电气工程与系统科学 2024-09-12 Muhammad Shakeel , Yui Sudo , Yifan Peng , Shinji Watanabe

Automatic speech recognition (ASR) systems typically rely on an external endpointer (EP) model to identify speech boundaries. In this work, we propose a method to jointly train the ASR and EP tasks in a single end-to-end (E2E) multitask…

声音 · 计算机科学 2023-02-16 Shaan Bijwadia , Shuo-yiin Chang , Bo Li , Tara Sainath , Chao Zhang , Yanzhang He

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of…

计算与语言 · 计算机科学 2018-02-14 Kartik Audhkhasi , Andrew Rosenberg , Abhinav Sethy , Bhuvana Ramabhadran , Brian Kingsbury

The end-to-end (E2E) automatic speech recognition (ASR) systems are often required to operate in reverberant conditions, where the long-term sub-band envelopes of the speech are temporally smeared. In this paper, we develop a feature…

音频与语音处理 · 电气工程与系统科学 2022-02-21 Rohit Kumar , Anurenjan Purushothaman , Anirudh Sreeram , Sriram Ganapathy

End-to-end (E2E) modeling is advantageous for automatic speech recognition (ASR) especially for Japanese since word-based tokenization of Japanese is not trivial, and E2E modeling is able to model character sequences directly. This paper…

计算与语言 · 计算机科学 2021-06-10 Shigeki Karita , Yotaro Kubo , Michiel Adriaan Unico Bacchiani , Llion Jones

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

声音 · 计算机科学 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

Encoder-decoder based sequence-to-sequence models have demonstrated state-of-the-art results in end-to-end automatic speech recognition (ASR). Recently, the transformer architecture, which uses self-attention to model temporal context…

声音 · 计算机科学 2020-07-02 Niko Moritz , Takaaki Hori , Jonathan Le Roux

Improving the performance of end-to-end ASR models on long utterances ranging from minutes to hours in length is an ongoing challenge in speech recognition. A common solution is to segment the audio in advance using a separate voice…

We propose an unsupervised speaker adaptation method inspired by the neural Turing machine for end-to-end (E2E) automatic speech recognition (ASR). The proposed model contains a memory block that holds speaker i-vectors extracted from the…

音频与语音处理 · 电气工程与系统科学 2020-02-17 Leda Sarı , Niko Moritz , Takaaki Hori , Jonathan Le Roux

The streaming automatic speech recognition (ASR) models are more popular and suitable for voice-based applications. However, non-streaming models provide better performance as they look at the entire audio context. To leverage the benefits…

声音 · 计算机科学 2022-08-26 Raviraj Joshi , Subodh Kumar

In recent years, the evolution of end-to-end (E2E) automatic speech recognition (ASR) models has been remarkable, largely due to advances in deep learning architectures like transformer. On top of E2E systems, researchers have achieved…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Shiyi Han , Zhihong Lei , Mingbin Xu , Xingyu Na , Zhen Huang

The attention-based encoder-decoder modeling paradigm has achieved promising results on a variety of speech processing tasks like automatic speech recognition (ASR), text-to-speech (TTS) and among others. This paradigm takes advantage of…

音频与语音处理 · 电气工程与系统科学 2021-07-23 Shi-Yan Weng , Berlin Chen

All-neural, end-to-end ASR systems gained rapid interest from the speech recognition community. Such systems convert speech input to text units using a single trainable neural network model. E2E models require large amounts of paired speech…

计算与语言 · 计算机科学 2021-10-08 Rongqing Huang

We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language…

计算与语言 · 计算机科学 2022-09-08 Duc Le , Akshat Shrivastava , Paden Tomasello , Suyoun Kim , Aleksandr Livshits , Ozlem Kalinli , Michael L. Seltzer

Attention-based encoder-decoder model has achieved impressive results for both automatic speech recognition (ASR) and text-to-speech (TTS) tasks. This approach takes advantage of the memorization capacity of neural networks to learn the…

计算与语言 · 计算机科学 2020-03-17 Chengyi Wang , Yu Wu , Yujiao Du , Jinyu Li , Shujie Liu , Liang Lu , Shuo Ren , Guoli Ye , Sheng Zhao , Ming Zhou

Recently, an end-to-end (E2E) speaker-attributed automatic speech recognition (SA-ASR) model was proposed as a joint model of speaker counting, speech recognition and speaker identification for monaural overlapped speech. It showed…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Naoyuki Kanda , Xuankai Chang , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

Recently, end-to-end (E2E) speech recognition has become popular, since it can integrate the acoustic, pronunciation and language models into a single neural network, which outperforms conventional models. Among E2E approaches,…

声音 · 计算机科学 2021-07-08 Zhifu Gao , Yiwu Yao , Shiliang Zhang , Jun Yang , Ming Lei , Ian McLoughlin

The demand for fast and accurate incremental speech recognition increases as the applications of automatic speech recognition (ASR) proliferate. Incremental speech recognizers output chunks of partially recognized words while the user is…

计算与语言 · 计算机科学 2020-08-18 Yuan Shangguan , Kate Knister , Yanzhang He , Ian McGraw , Francoise Beaufays

The requirements for many applications of state-of-the-art speech recognition systems include not only low word error rate (WER) but also low latency. Specifically, for many use-cases, the system must be able to decode utterances in a…