English
Related papers

Related papers: Non-Autoregressive Transformer ASR with CTC-Enhanc…

200 papers

Mandarin-English code-switching (CS) is frequently used among East and Southeast Asian people. However, the intra-sentence language switching of the two very different languages makes recognizing CS speech challenging. Meanwhile, the recent…

Computation and Language · Computer Science 2021-10-05 Shun-Po Chuang , Heng-Jui Chang , Sung-Feng Huang , Hung-yi Lee

Non-AutoRegressive (NAR) text generation models have drawn much attention because of their significantly faster decoding speed and good generation quality in machine translation. However, in a wider range of text generation tasks, existing…

Computation and Language · Computer Science 2023-04-25 Fei Huang , Pei Ke , Minlie Huang

Code completion tools are frequently used by software developers to accelerate software development by suggesting the following code elements. Completing a sequence of code tokens (e.g., a full line of code) has been proved more efficient…

Software Engineering · Computer Science 2022-04-22 Fang Liu , Zhiyi Fu , Ge Li , Zhi Jin , Hui Liu , Yiyang Hao

Connectionist temporal classification (CTC) -based models are attractive in automatic speech recognition (ASR) because of their non-autoregressive nature. To take advantage of text-only data, language model (LM) integration approaches such…

Computation and Language · Computer Science 2022-09-12 Hayato Futami , Hirofumi Inaguma , Sei Ueno , Masato Mimura , Shinsuke Sakai , Tatsuya Kawahara

Autoregressive sequence Generation models have achieved state-of-the-art performance in areas like machine translation and image captioning. These models are autoregressive in that they generate each word by conditioning on previously…

Computation and Language · Computer Science 2021-01-26 Longteng Guo , Jing Liu , Xinxin Zhu , Hanqing Lu

Non-autoregressive automatic speech recognition (NASR) models have gained attention due to their parallelism and fast inference. The encoder-based NASR, e.g. connectionist temporal classification (CTC), can be initialized from the speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-15 Ruchao Fan , Natarajan Balaji Shanka , Abeer Alwan

Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word positions. Latent…

Computation and Language · Computer Science 2022-10-11 Chenze Shao , Yang Feng

Autoregressive (AR) models have been the dominating approach to conditional sequence generation, but are suffering from the issue of high inference latency. Non-autoregressive (NAR) models have been recently proposed to reduce the latency…

Machine Learning · Computer Science 2020-07-01 Zhiqing Sun , Yiming Yang

This paper proposes CTC-based non-autoregressive ASR with self-conditioned folded encoders. The proposed method realizes non-autoregressive ASR with fewer parameters by folding the conventional stack of encoders into only two blocks; base…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Tatsuya Komatsu

Enlightened by the success of machine learning techniques in various application areas, recent years have witnessed a surge of research efforts on automatic program repair (APR) using machine learning techniques. Previous machine…

Software Engineering · Computer Science 2025-10-03 Zhenyu Yang , Yue Pan , Zhen Yang , Zhongxing Yu

While autoregressive (AR) LLM-based ASR systems achieve strong accuracy, their sequential decoding limits parallelism and incurs high latency. We propose NLE, a non-autoregressive (NAR) approach that formulates speech recognition as…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Avihu Dekel , Samuel Thomas , Takashi Fukada , George Saon

We present a simple and efficient auxiliary loss function for automatic speech recognition (ASR) based on the connectionist temporal classification (CTC) objective. The proposed objective, an intermediate CTC loss, is attached to an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-08 Jaesong Lee , Shinji Watanabe

This paper describes a variational auto-encoder based non-autoregressive text-to-speech (VAENAR-TTS) model. The autoregressive TTS (AR-TTS) models based on the sequence-to-sequence architecture can generate high-quality speech, but their…

Sound · Computer Science 2021-07-08 Hui Lu , Zhiyong Wu , Xixin Wu , Xu Li , Shiyin Kang , Xunying Liu , Helen Meng

Non-autoregressive (NAR) models can generate sentences with less computation than autoregressive models but sacrifice generation quality. Previous studies addressed this issue through iterative decoding. This study proposes using nearest…

Computation and Language · Computer Science 2022-08-29 Ayana Niwa , Sho Takase , Naoaki Okazaki

End-to-end automatic speech recognition (ASR), unlike conventional ASR, does not have modules to learn the semantic representation from speech encoder. Moreover, the higher frame-rate of speech representation prevents the model to learn the…

Artificial Intelligence · Computer Science 2021-03-19 Md Akmal Haidar , Chao Xing , Mehdi Rezagholizadeh

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

This paper proposes a novel voice conversion (VC) method based on non-autoregressive sequence-to-sequence (NAR-S2S) models. Inspired by the great success of NAR-S2S models such as FastSpeech in text-to-speech (TTS), we extend the…

Sound · Computer Science 2021-04-15 Tomoki Hayashi , Wen-Chin Huang , Kazuhiro Kobayashi , Tomoki Toda

Transformer-based models have led to significant innovation in classical and practical subjects as varied as speech processing, natural language processing, and computer vision. On top of the Transformer, attention-based end-to-end…

Computation and Language · Computer Science 2022-05-19 Fu-Hao Yu , Kuan-Yu Chen

Non-autoregressive Transformer(NAT) significantly accelerates the inference of neural machine translation. However, conventional NAT models suffer from limited expression power and performance degradation compared to autoregressive (AT)…

Computation and Language · Computer Science 2023-11-15 Shangtong Gui , Chenze Shao , Zhengrui Ma , Xishan Zhang , Yunji Chen , Yang Feng

Non-autoregressive models greatly improve decoding speed over typical sequence-to-sequence models, but suffer from degraded performance. Infilling and iterative refinement models make up some of this gap by editing the outputs of a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-28 Ethan A. Chi , Julian Salazar , Katrin Kirchhoff