中文
相关论文

相关论文: Transformer-based Online Speech Recognition with D…

200 篇论文

Conventional automatic speech recognition (ASR) typically performs multi-level pattern recognition tasks that map the acoustic speech waveform into a hierarchy of speech units. But, it is widely known that information loss in the earlier…

计算与语言 · 计算机科学 2017-09-25 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

The Transformer self-attention network has recently shown promising performance as an alternative to recurrent neural networks (RNNs) in end-to-end (E2E) automatic speech recognition (ASR) systems. However, the Transformer has a drawback in…

音频与语音处理 · 电气工程与系统科学 2019-10-17 Emiru Tsunoo , Yosuke Kashiwagi , Toshiyuki Kumakura , Shinji Watanabe

Currently, there are mainly three kinds of Transformer encoder based streaming End to End (E2E) Automatic Speech Recognition (ASR) approaches, namely time-restricted methods, chunk-wise methods, and memory-based methods. Generally, all of…

声音 · 计算机科学 2022-09-27 Fangyuan Wang , Bo Xu

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

计算与语言 · 计算机科学 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

声音 · 计算机科学 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

This paper proposes a model for transforming speech features using the frequency-directional attention model for End-to-End (E2E) automatic speech recognition. The idea is based on the hypothesis that in the phoneme system of each language,…

音频与语音处理 · 电气工程与系统科学 2022-03-30 Akihiro Dobashi , Chee Siang Leow , Hiromitsu Nishizaki

Recently, attention-based encoder-decoder (AED) models have shown high performance for end-to-end automatic speech recognition (ASR) across several tasks. Addressing overconfidence in such models, in this paper we introduce the concept of…

音频与语音处理 · 电气工程与系统科学 2021-12-16 Timo Lohrenz , Patrick Schwarz , Zhengyang Li , Tim Fingscheidt

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

音频与语音处理 · 电气工程与系统科学 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

Automatic Speech Recognition (ASR) using multiple microphone arrays has achieved great success in the far-field robustness. Taking advantage of all the information that each array shares and contributes is crucial in this task. Motivated by…

计算与语言 · 计算机科学 2019-02-20 Xiaofei Wang , Ruizhi Li , Sri Harish Mallid , Takaaki Hori , Shinji Watanabe , Hynek Hermansky

Automatic speech recognition (ASR) systems typically rely on an external endpointer (EP) model to identify speech boundaries. In this work, we propose a method to jointly train the ASR and EP tasks in a single end-to-end (E2E) multitask…

声音 · 计算机科学 2023-02-16 Shaan Bijwadia , Shuo-yiin Chang , Bo Li , Tara Sainath , Chao Zhang , Yanzhang He

In the last decade of automatic speech recognition (ASR) research, the introduction of deep learning brought considerable reductions in word error rate of more than 50% relative, compared to modeling without deep learning. In the wake of…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Rohit Prabhavalkar , Takaaki Hori , Tara N. Sainath , Ralf Schlüter , Shinji Watanabe

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

声音 · 计算机科学 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

Transformer-based architectures are the most used architectures in many deep learning fields like Natural Language Processing, Computer Vision or Speech processing. It may encourage the direct use of Transformers in the constrained tasks,…

音频与语音处理 · 电气工程与系统科学 2026-01-29 Youness Dkhissi , Valentin Vielzeuf , Elys Allesiardo , Anthony Larcher

While significant improvements have been made in recent years in terms of end-to-end automatic speech recognition (ASR) performance, such improvements were obtained through the use of very large neural networks, unfit for embedded use on…

计算与语言 · 计算机科学 2020-03-25 Alex Bie , Bharat Venkitesh , Joao Monteiro , Md. Akmal Haidar , Mehdi Rezagholizadeh

There is often a trade-off between performance and latency in streaming automatic speech recognition (ASR). Traditional methods such as look-ahead and chunk-based methods, usually require information from future frames to advance…

音频与语音处理 · 电气工程与系统科学 2022-07-07 Zehan Li , Haoran Miao , Keqi Deng , Gaofeng Cheng , Sanli Tian , Ta Li , Yonghong Yan

Non-autoregressive (NAR) modeling has gained more and more attention in speech processing. With recent state-of-the-art attention-based automatic speech recognition (ASR) structure, NAR can realize promising real-time factor (RTF)…

音频与语音处理 · 电气工程与系统科学 2021-07-21 Tianzi Wang , Yuya Fujita , Xuankai Chang , Shinji Watanabe

Automatic speech recognition (ASR) systems are primarily evaluated on transcription accuracy. However, in some use cases such as subtitling, verbatim transcription would reduce output readability given limited screen size and reading time.…

计算与语言 · 计算机科学 2020-05-26 Danni Liu , Jan Niehues , Gerasimos Spanakis

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural…

We present a state-of-the-art end-to-end Automatic Speech Recognition (ASR) model. We learn to listen and write characters with a joint Connectionist Temporal Classification (CTC) and attention-based encoder-decoder network. The encoder is…

计算与语言 · 计算机科学 2017-06-12 Takaaki Hori , Shinji Watanabe , Yu Zhang , William Chan

Information in speech signals is not evenly distributed, making it an additional challenge for end-to-end (E2E) speech translation (ST) to learn to focus on informative features. In this paper, we propose adaptive feature selection (AFS)…

计算与语言 · 计算机科学 2020-10-21 Biao Zhang , Ivan Titov , Barry Haddow , Rico Sennrich