English
Related papers

Related papers: Boundary and Context Aware Training for CIF-based …

200 papers

This paper proposes an adaptation method for end-to-end speech recognition. In this method, multiple automatic speech recognition (ASR) 1-best hypotheses are integrated in the computation of the connectionist temporal classification (CTC)…

Computation and Language · Computer Science 2021-04-01 Cong-Thanh Do , Rama Doddipatla , Thomas Hain

Automatic speech recognition (ASR) systems often rely on autoregressive (AR) Transformer decoder architectures, which limit efficient inference parallelization due to their sequential nature. To this end, non-autoregressive (NAR) approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-13 Tianzi Wang , Xurong Xie , Zengrui Jin , Mengzhe Geng , Jiajun Deng , Zhaoqing Li , Shoukang Hu , Shujie Hu , Guinan Li , Mingyu Cui , Helen Meng , Xunying Liu

We present Mask CTC, a novel non-autoregressive end-to-end automatic speech recognition (ASR) framework, which generates a sequence by refining outputs of the connectionist temporal classification (CTC). Neural sequence-to-sequence models…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Yosuke Higuchi , Shinji Watanabe , Nanxin Chen , Tetsuji Ogawa , Tetsunori Kobayashi

Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. One approach is the attention-based encoder-decoder framework that learns a mapping…

Computation and Language · Computer Science 2017-02-02 Suyoun Kim , Takaaki Hori , Shinji Watanabe

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

Sound · Computer Science 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

Code-Switching (CS) remains a challenge for Automatic Speech Recognition (ASR), especially character-based models. With the combined choice of characters from multiple languages, the outcome from character-based models suffers from phoneme…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-24 Burin Naowarat , Thananchai Kongthaworn , Korrawe Karunratanakul , Sheng Hui Wu , Ekapol Chuangsuwanich

End-to-end (E2E) models have gained attention in the research field of automatic speech recognition (ASR). Many E2E models proposed so far assume left-to-right autoregressive generation of an output token sequence except for connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-17 Yuya Fujita , Shinji Watanabe , Motoi Omachi , Xuankai Chan

End-to-end (E2E) automatic speech recognition (ASR) systems have revolutionized the field by integrating all components into a single neural network, with attention-based encoder-decoder models achieving state-of-the-art performance.…

Computation and Language · Computer Science 2025-07-01 Duygu Altinok

The two most common paradigms for end-to-end speech recognition are connectionist temporal classification (CTC) and attention-based encoder-decoder (AED) models. It has been argued that the latter is better suited for learning an implicit…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-22 Lasse Borgholt , Jakob Drachmann Havtorn , Željko Agić , Anders Søgaard , Lars Maaløe , Christian Igel

Zero-shot ASR for Arabic remains challenging: while multilingual models perform well on Modern Standard Arabic (MSA), error rates rise sharply on dialectal and accented speech due to linguistic mismatch and scarce labeled data. We study…

Computation and Language · Computer Science 2026-01-13 Bashar Talafha , Amin Abu Alhassan , Muhammad Abdul-Mageed

The attention-based deep contextual biasing method has been demonstrated to effectively improve the recognition performance of end-to-end automatic speech recognition (ASR) systems on given contextual phrases. However, unlike shallow fusion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Kaixun Huang , Ao Zhang , Binbin Zhang , Tianyi Xu , Xingchen Song , Lei Xie

Non-autoregressive mechanisms can significantly decrease inference time for speech transformers, especially when the single step variant is applied. Previous work on CTC alignment-based single step non-autoregressive transformer (CASS-NAT)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Ruchao Fan , Wei Chu , Peng Chang , Jing Xiao , Abeer Alwan

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

Sound · Computer Science 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

Human listeners readily adjust to unfamiliar speakers and language varieties through exposure, but do these adaptation benefits extend to state-of-the-art spoken language models? We introduce a scalable framework that allows for in-context…

Computation and Language · Computer Science 2025-05-22 Nathan Roll , Calbert Graham , Yuka Tatsumi , Kim Tien Nguyen , Meghan Sumner , Dan Jurafsky

Low-resource accented speech recognition is one of the important challenges faced by current ASR technology in practical applications. In this study, we propose a Conformer-based architecture, called Aformer, to leverage both the acoustic…

Sound · Computer Science 2023-06-21 Xuefei Wang , Yanhua Long , Yijie Li , Haoran Wei

Although contextualized automatic speech recognition (ASR) systems are commonly used to improve the recognition of uncommon words, their effectiveness is hindered by the inherent limitations of speech-text data availability. To address this…

Sound · Computer Science 2024-06-17 Naijun Zheng , Xucheng Wan , Kai Liu , Ziqing Du , Zhou Huan

Accurately classifying accents and assessing accentedness in non-native speakers are both challenging tasks due to the complexity and diversity of accent and dialect variations. In this study, embeddings from advanced pre-trained language…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-18 Shahram Ghorbani , John H. L. Hansen

Non-autoregressive models greatly improve decoding speed over typical sequence-to-sequence models, but suffer from degraded performance. Infilling and iterative refinement models make up some of this gap by editing the outputs of a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-28 Ethan A. Chi , Julian Salazar , Katrin Kirchhoff

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

Modern non-autoregressive~(NAR) speech recognition systems aim to accelerate the inference speed; however, they suffer from performance degradation compared with autoregressive~(AR) models as well as the huge model size issue. We propose a…

Sound · Computer Science 2022-07-22 Xun Gong , Zhikai Zhou , Yanmin Qian