中文
相关论文

相关论文: Enhancing CTC-based speech recognition with divers…

200 篇论文

We explore diverse representations of speech audio, and their effect on a performance of late fusion ensemble of E-Branchformer models, applied to Automatic Speech Recognition (ASR) task. Although it is generally known that ensemble methods…

音频与语音处理 · 电气工程与系统科学 2024-12-04 Marin Jezidžić , Matej Mihelčić

Code-Switching (CS) is referred to the phenomenon of alternately using words and phrases from different languages. While today's neural end-to-end (E2E) models deliver state-of-the-art performances on the task of automatic speech…

计算与语言 · 计算机科学 2023-07-04 Enes Yavuz Ugan , Christian Huber , Juan Hussain , Alexander Waibel

This paper proposes an adaptation method for end-to-end speech recognition. In this method, multiple automatic speech recognition (ASR) 1-best hypotheses are integrated in the computation of the connectionist temporal classification (CTC)…

计算与语言 · 计算机科学 2021-04-01 Cong-Thanh Do , Rama Doddipatla , Thomas Hain

Code-switching deals with alternative languages in communication process. Training end-to-end (E2E) automatic speech recognition (ASR) systems for code-switching is especially challenging as code-switching training data are always…

计算与语言 · 计算机科学 2022-06-30 Shuai Zhang , Jiangyan Yi , Zhengkun Tian , Jianhua Tao , Yu Ting Yeung , Liqun Deng

In automatic speech recognition (ASR) what a user says depends on the particular context she is in. Typically, this context is represented as a set of word n-grams. In this work, we present a novel, all-neural, end-to-end (E2E) ASR sys- tem…

音频与语音处理 · 电气工程与系统科学 2018-08-09 Golan Pundak , Tara N. Sainath , Rohit Prabhavalkar , Anjuli Kannan , Ding Zhao

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

音频与语音处理 · 电气工程与系统科学 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

We present a novel approach to end-to-end automatic speech recognition (ASR) that utilizes pre-trained masked language models (LMs) to facilitate the extraction of linguistic information. The proposed models, BERT-CTC and BECTRA, are…

音频与语音处理 · 电气工程与系统科学 2024-10-02 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

We present BERT-CTC-Transducer (BECTRA), a novel end-to-end automatic speech recognition (E2E-ASR) model formulated by the transducer with a BERT-enhanced encoder. Integrating a large-scale pre-trained language model (LM) into E2E-ASR has…

音频与语音处理 · 电气工程与系统科学 2023-03-20 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

Neural models have become ubiquitous in automatic speech recognition systems. While neural networks are typically used as acoustic models in more complex systems, recent studies have explored end-to-end speech recognition systems based on…

计算与语言 · 计算机科学 2017-09-15 Yonatan Belinkov , James Glass

The recent emergence of joint CTC-Attention model shows significant improvement in automatic speech recognition (ASR). The improvement largely lies in the modeling of linguistic information by decoder. The decoder joint-optimized with an…

计算与语言 · 计算机科学 2022-10-27 Xulong Zhang , Jianzong Wang , Ning Cheng , Mengyuan Zhao , Zhiyong Zhang , Jing Xiao

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

声音 · 计算机科学 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end (E2E) Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by…

音频与语音处理 · 电气工程与系统科学 2019-10-22 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Shinji Watanabe , Takaaki Hori , Hynek Hermansky

Exploiting effective target modeling units is very important and has always been a concern in end-to-end automatic speech recognition (ASR). In this work, we propose a phonetic-assisted multi target units (PMU) modeling approach, to enhance…

音频与语音处理 · 电气工程与系统科学 2023-07-10 Li Li , Dongxing Xu , Haoran Wei , Yanhua Long

End-to-end (E2E) systems for automatic speech recognition (ASR), such as RNN Transducer (RNN-T) and Listen-Attend-Spell (LAS) blend the individual components of a traditional hybrid ASR system - acoustic model, language model, pronunciation…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Mahaveer Jain , Gil Keren , Jay Mahadeokar , Geoffrey Zweig , Florian Metze , Yatharth Saraf

In recent years, end-to-end (E2E) based automatic speech recognition (ASR) systems have achieved great success due to their simplicity and promising performance. Neural Transducer based models are increasingly popular in streaming E2E based…

计算与语言 · 计算机科学 2021-10-19 Xie Chen , Zhong Meng , Sarangarajan Parthasarathy , Jinyu Li

Mispronunciation detection and diagnosis (MDD) is a core component of computer-assisted pronunciation training (CAPT). Most of the existing MDD approaches focus on dealing with categorical errors (viz. one canonical phone is substituted by…

音频与语音处理 · 电气工程与系统科学 2020-08-31 Bi-Cheng Yan , Meng-Che Wu , Hsiao-Tsung Hung , Berlin Chen

End-to-end (E2E) automatic speech recognition (ASR) methods exhibit remarkable performance. However, since the performance of such methods is intrinsically linked to the context present in the training data, E2E-ASR methods do not perform…

音频与语音处理 · 电气工程与系统科学 2024-01-22 Yui Sudo , Muhammad Shakeel , Yosuke Fukumoto , Yifan Peng , Shinji Watanabe

We present a Conformer-based end-to-end neural diarization (EEND) model that uses both acoustic input and features derived from an automatic speech recognition (ASR) model. Two categories of features are explored: features derived directly…

计算与语言 · 计算机科学 2022-07-13 Aparna Khare , Eunjung Han , Yuguang Yang , Andreas Stolcke

Personal rare word recognition in end-to-end Automatic Speech Recognition (E2E ASR) models is a challenge due to the lack of training data. A standard way to address this issue is with shallow fusion methods at inference time. However, due…

Recently, end-to-end ASR based either on sequence-to-sequence networks or on the CTC objective function gained a lot of interest from the community, achieving competitive results over traditional systems using robust but complex pipelines.…

计算与语言 · 计算机科学 2019-10-24 Florian Boyer , Jean-Luc Rouas