中文
相关论文

相关论文: Sequence-to-Sequence Learning via Attention Transf…

200 篇论文

Sequence-to-sequence attention-based models integrate an acoustic, pronunciation and language model into a single neural network, which make them very suitable for multilingual automatic speech recognition (ASR). In this paper, we are…

音频与语音处理 · 电气工程与系统科学 2018-06-15 Shiyu Zhou , Shuang Xu , Bo Xu

Attention-based sequence-to-sequence models have shown promising results in automatic speech recognition. Using these architectures, one-dimensional input and output sequences are related by an attention approach, thereby replacing more…

计算与语言 · 计算机科学 2019-11-21 Parnia Bahar , Albert Zeyer , Ralf Schlüter , Hermann Ney

In real-time speech recognition applications, the latency is an important issue. We have developed a character-level incremental speech recognition (ISR) system that responds quickly even during the speech, where the hypotheses are…

计算与语言 · 计算机科学 2016-06-29 Kyuyeon Hwang , Wonyong Sung

Training a conventional automatic speech recognition (ASR) system to support multiple languages is challenging because the sub-word unit, lexicon and word inventories are typically language specific. In contrast, sequence-to-sequence models…

音频与语音处理 · 电气工程与系统科学 2018-02-16 Shubham Toshniwal , Tara N. Sainath , Ron J. Weiss , Bo Li , Pedro Moreno , Eugene Weinstein , Kanishka Rao

Sequence-to-sequence attention-based models have recently shown very promising results on automatic speech recognition (ASR) tasks, which integrate an acoustic, pronunciation and language model into a single neural network. In these models,…

音频与语音处理 · 电气工程与系统科学 2018-06-05 Shiyu Zhou , Linhao Dong , Shuang Xu , Bo Xu

Recurrent sequence generators conditioned on input data through an attention mechanism have recently shown very good performance on a range of tasks in- cluding machine translation, handwriting synthesis and image caption gen- eration. We…

计算与语言 · 计算机科学 2015-06-25 Jan Chorowski , Dzmitry Bahdanau , Dmitriy Serdyuk , Kyunghyun Cho , Yoshua Bengio

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

音频与语音处理 · 电气工程与系统科学 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

Neural sequence-to-sequence automatic speech recognition (ASR) systems are in principle open vocabulary systems, when using appropriate modeling units. In practice, however, they often fail to recognize words not seen during training, e.g.,…

计算与语言 · 计算机科学 2022-03-30 Christian Huber , Rishu Kumar , Ondřej Bojar , Alexander Waibel

End-to-end automatic speech recognition (ASR) commonly transcribes audio signals into sequences of characters while its performance is evaluated by measuring the word-error rate (WER). This suggests that predicting sequences of words…

计算与语言 · 计算机科学 2018-12-07 Jan Kremer , Lasse Borgholt , Lars Maaløe

Recently, self-supervised pre-training has gained success in automatic speech recognition (ASR). However, considering the difference between speech accents in real scenarios, how to identify accents and use accent features to improve ASR is…

音频与语音处理 · 电气工程与系统科学 2021-09-16 Keqi Deng , Songjun Cao , Long Ma

The Transformer architecture model, based on self-attention and multi-head attention, has achieved remarkable success in offline end-to-end Automatic Speech Recognition (ASR). However, self-attention and multi-head attention cannot be…

计算与语言 · 计算机科学 2022-10-03 Chendong Zhao , Jianzong Wang , Wen qi Wei , Xiaoyang Qu , Haoqian Wang , Jing Xiao

When tasks change over time, meta-transfer learning seeks to improve the efficiency of learning a new task via both meta-learning and transfer-learning. While the standard attention has been effective in a variety of settings, we question…

机器学习 · 计算机科学 2020-06-30 Jaesik Yoon , Gautam Singh , Sungjin Ahn

End-to-end (E2E) automatic speech recognition (ASR) with sequence-to-sequence models has gained attention because of its simple model training compared with conventional hidden Markov model based ASR. Recently, several studies report the…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Yuya Fujita , Aswin Shanmugam Subramanian , Motoi Omachi , Shinji Watanabe

Speaker recognition is a well known and studied task in the speech processing domain. It has many applications, either for security or speaker adaptation of personal devices. In this paper, we present a new paradigm for automatic speaker…

音频与语音处理 · 电气工程与系统科学 2020-08-10 Mathieu Seurin , Florian Strub , Philippe Preux , Olivier Pietquin

Recent studies of streaming automatic speech recognition (ASR) recurrent neural network transducer (RNN-T)-based systems have fed the encoder with past contextual information in order to improve its word error rate (WER) performance. In…

音频与语音处理 · 电气工程与系统科学 2022-10-31 Alejandro Gomez-Alanis , Lukas Drude , Andreas Schwarz , Rupak Vignesh Swaminathan , Simon Wiesler

Sequence-to-sequence (seq2seq) approach for low-resource ASR is a relatively new direction in speech research. The approach benefits by performing model training without using lexicon and alignments. However, this poses a new problem of…

In the present paper, an attempt is made to combine Mask-CTC and the triggered attention mechanism to construct a streaming end-to-end automatic speech recognition (ASR) system that provides high performance with low latency. The triggered…

声音 · 计算机科学 2021-10-22 Huaibo Zhao , Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

Self-attention networks (SAN) have been introduced into automatic speech recognition (ASR) and achieved state-of-the-art performance owing to its superior ability in capturing long term dependency. One of the key ingredients is the…

音频与语音处理 · 电气工程与系统科学 2019-10-30 Zhao You , Dan Su , Jie Chen , Chao Weng , Dong Yu

The Transformer self-attention network has recently shown promising performance as an alternative to recurrent neural networks (RNNs) in end-to-end (E2E) automatic speech recognition (ASR) systems. However, the Transformer has a drawback in…

音频与语音处理 · 电气工程与系统科学 2019-10-17 Emiru Tsunoo , Yosuke Kashiwagi , Toshiyuki Kumakura , Shinji Watanabe

Automatic Speech Recognition (ASR) is an imperfect process that results in certain mismatches in ASR output text when compared to plain written text or transcriptions. When plain text data is to be used to train systems for spoken language…

计算与语言 · 计算机科学 2021-04-02 Prashant Serai , Vishal Sunder , Eric Fosler-Lussier