English
Related papers

Related papers: Revisiting Non-Autoregressive Translation at Scale

200 papers

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

Computation and Language · Computer Science 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

Non-autoregressive translation (NAT) models achieve comparable performance and superior speed compared to auto-regressive translation (AT) models in the context of sentence-level machine translation (MT). However, their abilities are…

Computation and Language · Computer Science 2023-12-12 Guangsheng Bao , Zhiyang Teng , Hao Zhou , Jianhao Yan , Yue Zhang

Non-Autoregressive Neural Machine Translation (NAT) has achieved significant inference speedup by generating all tokens simultaneously. Despite its high efficiency, NAT usually suffers from two kinds of translation errors: over-translation…

Computation and Language · Computer Science 2021-04-27 Yong Shan , Yang Feng , Chenze Shao

Non-Autoregressive machine Translation (NAT) models have demonstrated significant inference speedup but suffer from inferior translation accuracy. The common practice to tackle the problem is transferring the Autoregressive machine…

Computation and Language · Computer Science 2021-05-18 Yongchang Hao , Shilin He , Wenxiang Jiao , Zhaopeng Tu , Michael Lyu , Xing Wang

Non-autoregressive neural machine translation (NAT) generates each target word in parallel and has achieved promising inference acceleration. However, existing NAT models still have a big gap in translation quality compared to…

Computation and Language · Computer Science 2020-12-17 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou

Recent advances have made non-autoregressive (NAT) translation comparable to autoregressive methods (AT). However, their evaluation using BLEU has been shown to weakly correlate with human annotations. Limited research compares…

Computation and Language · Computer Science 2024-05-22 Yafu Li , Huajian Zhang , Jianhao Yan , Yongjing Yin , Yue Zhang

Non-autoregressive neural machine translation (NAT) offers substantial translation speed up compared to autoregressive neural machine translation (AT) at the cost of translation quality. Latent variable modeling has emerged as a promising…

Computation and Language · Computer Science 2024-09-10 DongNyeong Heo , Heeyoul Choi

Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to the…

Computation and Language · Computer Science 2021-01-01 Jiatao Gu , Xiang Kong

Non-Autoregressive Transformer (NAT) aims to accelerate the Transformer model through discarding the autoregressive mechanism and generating target words independently, which fails to exploit the target sequential information.…

Computation and Language · Computer Science 2019-06-25 Chenze Shao , Yang Feng , Jinchao Zhang , Fandong Meng , Xilin Chen , Jie Zhou

As a new neural machine translation approach, Non-Autoregressive machine Translation (NAT) has attracted attention recently due to its high efficiency in inference. However, the high efficiency has come at the cost of not capturing the…

Computation and Language · Computer Science 2019-02-28 Yiren Wang , Fei Tian , Di He , Tao Qin , ChengXiang Zhai , Tie-Yan Liu

Despite low latency, non-autoregressive machine translation (NAT) suffers severe performance deterioration due to the naive independence assumption. This assumption is further strengthened by cross-entropy loss, which encourages a strict…

Computation and Language · Computer Science 2022-10-21 Yafu Li , Leyang Cui , Yongjing Yin , Yue Zhang

Non-autoregressive translation models (NAT) have achieved impressive inference speedup. A potential issue of the existing NAT algorithms, however, is that the decoding is conducted in parallel, without directly considering previous context.…

Computation and Language · Computer Science 2019-07-23 Bingzhen Wei , Mingxuan Wang , Hao Zhou , Junyang Lin , Jun Xie , Xu Sun

Non-autoregressive neural machine translation (NAT) models are proposed to accelerate the inference process while maintaining relatively high performance. However, existing NAT models are difficult to achieve the desired efficiency-quality…

Computation and Language · Computer Science 2023-03-15 Pei Guo , Yisheng Xiao , Juntao Li , Min Zhang

Non-autoregressive machine translation (NAT) models have lower translation quality than autoregressive translation (AT) models because NAT decoders do not depend on previous target tokens in the decoder input. We propose a novel and general…

Computation and Language · Computer Science 2023-08-03 Jiaao Zhan , Qian Chen , Boxing Chen , Wen Wang , Yu Bai , Yang Gao

However, current autoregressive approaches suffer from high latency. In this paper, we focus on non-autoregressive translation (NAT) for this problem for its efficiency advantage. We identify that current constrained NAT models, which are…

Computation and Language · Computer Science 2022-10-27 Chun Zeng , Jiangjie Chen , Tianyi Zhuang , Rui Xu , Hao Yang , Ying Qin , Shimin Tao , Yanghua Xiao

Non-autoregressive translation (NAT) achieves faster inference speed but at the cost of worse accuracy compared with autoregressive translation (AT). Since AT and NAT can share model structure and AT is an easier task than NAT due to the…

Computation and Language · Computer Science 2020-07-20 Jinglin Liu , Yi Ren , Xu Tan , Chen Zhang , Tao Qin , Zhou Zhao , Tie-Yan Liu

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to…

Machine Learning · Computer Science 2019-11-25 Junliang Guo , Xu Tan , Linli Xu , Tao Qin , Enhong Chen , Tie-Yan Liu

In this work, we study the effect of varying the architecture and training data quality on the data scaling properties of Neural Machine Translation (NMT). First, we establish that the test loss of encoder-decoder transformer models scales…

Machine Learning · Computer Science 2022-02-07 Yamini Bansal , Behrooz Ghorbani , Ankush Garg , Biao Zhang , Maxim Krikun , Colin Cherry , Behnam Neyshabur , Orhan Firat

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

Computation and Language · Computer Science 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee
‹ Prev 1 2 3 10 Next ›