English
Related papers

Related papers: Retrieving Sequential Information for Non-Autoregr…

200 papers

Non-autoregressive Transformers (NATs) significantly reduce the decoding latency by generating all tokens in parallel. However, such independent predictions prevent NATs from capturing the dependencies between the tokens for generating…

Computation and Language · Computer Science 2022-05-17 Fei Huang , Hao Zhou , Yang Liu , Hang Li , Minlie Huang

Human motion prediction, which aims at predicting future human skeletons given the past ones, is a typical sequence-to-sequence problem. Therefore, extensive efforts have been continued on exploring different RNN-based encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Bin Li , Jian Tian , Zhongfei Zhang , Hailin Feng , Xi Li

Non-autoregressive translation (NAT) models generate multiple tokens in one forward pass and is highly efficient at inference stage compared with autoregressive translation (AT) methods. However, NAT models often suffer from the…

Computation and Language · Computer Science 2020-02-11 Xiaoya Li , Yuxian Meng , Arianna Yuan , Fei Wu , Jiwei Li

The field of unsupervised machine translation has seen significant advancement from the marriage of the Transformer and the back-translation algorithm. The Transformer is a powerful generative model, and back-translation leverages…

Computation and Language · Computer Science 2023-12-05 Benjamin Brimacombe , Jiawei Zhou

Autoregressive sequence models based on deep neural networks, such as RNNs, Wavenet and the Transformer attain state-of-the-art results on many tasks. However, they are difficult to parallelize and are thus slow at processing long…

Machine Learning · Computer Science 2018-06-11 Łukasz Kaiser , Aurko Roy , Ashish Vaswani , Niki Parmar , Samy Bengio , Jakob Uszkoreit , Noam Shazeer

Recent advances have made non-autoregressive (NAT) translation comparable to autoregressive methods (AT). However, their evaluation using BLEU has been shown to weakly correlate with human annotations. Limited research compares…

Computation and Language · Computer Science 2024-05-22 Yafu Li , Huajian Zhang , Jianhao Yan , Yongjing Yin , Yue Zhang

Knowledge distillation (KD) is commonly used to construct synthetic data for training non-autoregressive translation (NAT) models. However, there exists a discrepancy on low-frequency words between the distilled and the original data,…

Computation and Language · Computer Science 2022-04-27 Liang Ding , Longyue Wang , Xuebo Liu , Derek F. Wong , Dacheng Tao , Zhaopeng Tu

End-to-end (E2E) models have gained attention in the research field of automatic speech recognition (ASR). Many E2E models proposed so far assume left-to-right autoregressive generation of an output token sequence except for connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-17 Yuya Fujita , Shinji Watanabe , Motoi Omachi , Xuankai Chan

Autoregressive decoding limits the efficiency of transformers for Machine Translation (MT). The community proposed specific network architectures and learning-based methods to solve this issue, which are expensive and require changes to the…

Computation and Language · Computer Science 2025-02-06 Andrea Santilli , Silvio Severino , Emilian Postolache , Valentino Maiorca , Michele Mancusi , Riccardo Marin , Emanuele Rodolà

This paper presents the use of non-autoregressive (NAR) approaches for joint automatic speech recognition (ASR) and spoken language understanding (SLU) tasks. The proposed NAR systems employ a Conformer encoder that applies connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-24 Mohan Li , Rama Doddipatla

Non-autoregressive approaches aim to improve the inference speed of translation models by only requiring a single forward pass to generate the output sequence instead of iteratively producing each predicted token. Consequently, their…

Computation and Language · Computer Science 2022-10-24 Robin M. Schmidt , Telmo Pires , Stephan Peitz , Jonas Lööf

Autoregressive models have been widely used in unsupervised text style transfer. Despite their success, these models still suffer from the content preservation problem that they usually ignore part of the source sentence and generate some…

Computation and Language · Computer Science 2021-06-07 Fei Huang , Zikai Chen , Chen Henry Wu , Qihan Guo , Xiaoyan Zhu , Minlie Huang

Much recent effort has been invested in non-autoregressive neural machine translation, which appears to be an efficient alternative to state-of-the-art autoregressive machine translation on modern GPUs. In contrast to the latter, where…

Computation and Language · Computer Science 2021-06-28 Jungo Kasai , Nikolaos Pappas , Hao Peng , James Cross , Noah A. Smith

Non-autoregressive translation (NAT) model achieves a much faster inference speed than the autoregressive translation (AT) model because it can simultaneously predict all tokens during inference. However, its translation quality suffers…

Computation and Language · Computer Science 2023-01-30 Huanran Zheng , Wei Zhu , Pengfei Wang , Xiaoling Wang

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

Computation and Language · Computer Science 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee

Autoregressive (AR) and Non-autoregressive (NAR) models have their own superiority on the performance and latency, combining them into one model may take advantage of both. Current combination frameworks focus more on the integration of…

Computation and Language · Computer Science 2022-01-03 Minghan Wang , Jiaxin Guo , Yuxia Wang , Daimeng Wei , Hengchao Shang , Chang Su , Yimeng Chen , Yinglu Li , Min Zhang , Shimin Tao , Hao Yang

Combining end-to-end speech translation (ST) and non-autoregressive (NAR) generation is promising in language and speech processing for their advantages of less error propagation and low latency. In this paper, we investigate the potential…

Computation and Language · Computer Science 2023-05-30 Chen Xu , Xiaoqian Liu , Xiaowen Liu , Qingxuan Sun , Yuhao Zhang , Murun Yang , Qianqian Dong , Tom Ko , Mingxuan Wang , Tong Xiao , Anxiang Ma , Jingbo Zhu

Non-autoregressive (NAR) models can generate sentences with less computation than autoregressive models but sacrifice generation quality. Previous studies addressed this issue through iterative decoding. This study proposes using nearest…

Computation and Language · Computer Science 2022-08-29 Ayana Niwa , Sho Takase , Naoaki Okazaki

In this paper, we propose methods for improving the modeling performance of a Transformer-based non-autoregressive text-to-speech (TNA-TTS) model. Although the text encoder and audio decoder handle different types and lengths of data (i.e.,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-30 Jae-Sung Bae , Tae-Jun Bak , Young-Sun Joo , Hoon-Young Cho

Recently, simultaneous translation has gathered a lot of attention since it enables compelling applications such as subtitle translation for a live event or real-time video-call translation. Some of these translation applications allow…

Computation and Language · Computer Science 2021-06-03 Hyojung Han , Sathish Indurthi , Mohd Abbas Zaidi , Nikhil Kumar Lakumarapu , Beomseok Lee , Sangha Kim , Chanwoo Kim , Inchul Hwang