English
Related papers

Related papers: Imitation Learning for Non-Autoregressive Neural M…

200 papers

Non-autoregressive (NAR) neural machine translation is usually done via knowledge distillation from an autoregressive (AR) model. Under this framework, we leverage large monolingual corpora to improve the NAR model's performance, with the…

Computation and Language · Computer Science 2020-12-01 Jiawei Zhou , Phillip Keung

Non-autoregressive neural machine translation (NAT) predicts the entire target sequence simultaneously and significantly accelerates inference process. However, NAT discards the dependency information in a sentence, and thus inevitably…

Computation and Language · Computer Science 2020-06-11 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou

Non-autoregressive translation (NAT) achieves faster inference speed but at the cost of worse accuracy compared with autoregressive translation (AT). Since AT and NAT can share model structure and AT is an easier task than NAT due to the…

Computation and Language · Computer Science 2020-07-20 Jinglin Liu , Yi Ren , Xu Tan , Chen Zhang , Tao Qin , Zhou Zhao , Tie-Yan Liu

Non-autoregressive neural machine translation (NAT) offers substantial translation speed up compared to autoregressive neural machine translation (AT) at the cost of translation quality. Latent variable modeling has emerged as a promising…

Computation and Language · Computer Science 2024-09-10 DongNyeong Heo , Heeyoul Choi

As a new neural machine translation approach, Non-Autoregressive machine Translation (NAT) has attracted attention recently due to its high efficiency in inference. However, the high efficiency has come at the cost of not capturing the…

Computation and Language · Computer Science 2019-02-28 Yiren Wang , Fei Tian , Di He , Tao Qin , ChengXiang Zhai , Tie-Yan Liu

In this work, we introduce a novel local autoregressive translation (LAT) mechanism into non-autoregressive translation (NAT) models so as to capture local dependencies among tar-get outputs. Specifically, for each target decoding position,…

Computation and Language · Computer Science 2020-11-13 Xiang Kong , Zhisong Zhang , Eduard Hovy

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

Non-autoregressive Transformers (NATs) reduce the inference latency of Autoregressive Transformers (ATs) by predicting words all at once rather than in sequential order. They have achieved remarkable progress in machine translation as well…

Computation and Language · Computer Science 2023-06-05 Chenxin An , Jiangtao Feng , Fei Huang , Xipeng Qiu , Lingpeng Kong

Non-autoregressive neural machine translation (NAT) models suffer from the multi-modality problem that there may exist multiple possible translations of a source sentence, so the reference sentence may be inappropriate for the training when…

Computation and Language · Computer Science 2022-12-01 Chenze Shao , Jinchao Zhang , Jie Zhou , Yang Feng

Recent advances have made non-autoregressive (NAT) translation comparable to autoregressive methods (AT). However, their evaluation using BLEU has been shown to weakly correlate with human annotations. Limited research compares…

Computation and Language · Computer Science 2024-05-22 Yafu Li , Huajian Zhang , Jianhao Yan , Yongjing Yin , Yue Zhang

We propose an efficient inference procedure for non-autoregressive machine translation that iteratively refines translation purely in the continuous space. Given a continuous latent variable model for machine translation (Shu et al., 2020),…

Computation and Language · Computer Science 2020-09-16 Jason Lee , Raphael Shu , Kyunghyun Cho

Non-Autoregressive Neural Machine Translation (NAT) achieves significant decoding speedup through generating target words independently and simultaneously. However, in the context of non-autoregressive translation, the word-level…

Computation and Language · Computer Science 2019-11-22 Chenze Shao , Jinchao Zhang , Yang Feng , Fandong Meng , Jie Zhou

Efficient machine translation models are commercially important as they can increase inference speeds, and reduce costs and carbon emissions. Recently, there has been much interest in non-autoregressive (NAR) models, which promise faster…

Computation and Language · Computer Science 2022-05-05 Jindřich Helcl , Barry Haddow , Alexandra Birch

Non-autoregressive approaches aim to improve the inference speed of translation models by only requiring a single forward pass to generate the output sequence instead of iteratively producing each predicted token. Consequently, their…

Computation and Language · Computer Science 2022-10-24 Robin M. Schmidt , Telmo Pires , Stephan Peitz , Jonas Lööf

The non-autoregressive models have boosted the efficiency of neural machine translation through parallelized decoding at the cost of effectiveness when comparing with the autoregressive counterparts. In this paper, we claim that the…

Computation and Language · Computer Science 2021-01-25 Ye Liu , Yao Wan , Jian-Guo Zhang , Wenting Zhao , Philip S. Yu

Non-Autoregressive Transformer (NAT) aims to accelerate the Transformer model through discarding the autoregressive mechanism and generating target words independently, which fails to exploit the target sequential information.…

Computation and Language · Computer Science 2019-06-25 Chenze Shao , Yang Feng , Jinchao Zhang , Fandong Meng , Xilin Chen , Jie Zhou

Non-autoregressive translation (NAT) significantly accelerates the inference process via predicting the entire target sequence. However, recent studies show that NAT is weak at learning high-mode of knowledge such as one-to-many…

Computation and Language · Computer Science 2021-06-14 Liang Ding , Longyue Wang , Xuebo Liu , Derek F. Wong , Dacheng Tao , Zhaopeng Tu

In real-world systems, scaling has been critical for improving the translation quality in autoregressive translation (AT), which however has not been well studied for non-autoregressive translation (NAT). In this work, we bridge the gap by…

Computation and Language · Computer Science 2023-06-05 Zhihao Wang , Longyue Wang , Jinsong Su , Junfeng Yao , Zhaopeng Tu

Simultaneous machine translation (SiMT) models are trained to strike a balance between latency and translation quality. However, training these models to achieve high quality while maintaining low latency often leads to a tendency for…

Computation and Language · Computer Science 2023-10-24 Zhengrui Ma , Shaolei Zhang , Shoutao Guo , Chenze Shao , Min Zhang , Yang Feng

Non-autoregressive Transformer (NAT) is a family of text generation models, which aims to reduce the decoding latency by predicting the whole sentences in parallel. However, such latency reduction sacrifices the ability to capture…

Computation and Language · Computer Science 2022-06-14 Fei Huang , Tianhua Tao , Hao Zhou , Lei Li , Minlie Huang