English
Related papers

Related papers: Hint-Based Training for Non-Autoregressive Machine…

200 papers

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

Computation and Language · Computer Science 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to the…

Computation and Language · Computer Science 2021-01-01 Jiatao Gu , Xiang Kong

As a new neural machine translation approach, Non-Autoregressive machine Translation (NAT) has attracted attention recently due to its high efficiency in inference. However, the high efficiency has come at the cost of not capturing the…

Computation and Language · Computer Science 2019-02-28 Yiren Wang , Fei Tian , Di He , Tao Qin , ChengXiang Zhai , Tie-Yan Liu

Non-autoregressive neural machine translation (NART) models suffer from the multi-modality problem which causes translation inconsistency such as token repetition. Most recent approaches have attempted to solve this problem by implicitly…

Computation and Language · Computer Science 2021-09-15 Jongyoon Song , Sungwon Kim , Sungroh Yoon

Non-autoregressive (NAR) neural machine translation is usually done via knowledge distillation from an autoregressive (AR) model. Under this framework, we leverage large monolingual corpora to improve the NAR model's performance, with the…

Computation and Language · Computer Science 2020-12-01 Jiawei Zhou , Phillip Keung

In this work, we empirically confirm that non-autoregressive translation with an iterative refinement mechanism (IR-NAT) suffers from poor acceleration robustness because it is more sensitive to decoding batch size and computing device…

Computation and Language · Computer Science 2022-10-20 Qiang Wang , Xinhui Hu , Ming Chen

Non-autoregressive translation models (NAT) have achieved impressive inference speedup. A potential issue of the existing NAT algorithms, however, is that the decoding is conducted in parallel, without directly considering previous context.…

Computation and Language · Computer Science 2019-07-23 Bingzhen Wei , Mingxuan Wang , Hao Zhou , Junyang Lin , Jun Xie , Xu Sun

Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word positions. Latent…

Computation and Language · Computer Science 2022-10-11 Chenze Shao , Yang Feng

The non-autoregressive models have boosted the efficiency of neural machine translation through parallelized decoding at the cost of effectiveness when comparing with the autoregressive counterparts. In this paper, we claim that the…

Computation and Language · Computer Science 2021-01-25 Ye Liu , Yao Wan , Jian-Guo Zhang , Wenting Zhao , Philip S. Yu

Although neural machine translation models reached high translation quality, the autoregressive nature makes inference difficult to parallelize and leads to high translation latency. Inspired by recent refinement-based approaches, we…

Computation and Language · Computer Science 2019-11-22 Raphael Shu , Jason Lee , Hideki Nakayama , Kyunghyun Cho

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

Computation and Language · Computer Science 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee

Non-autoregressive (NAR) generation, which is first proposed in neural machine translation (NMT) to speed up inference, has attracted much attention in both machine learning and natural language processing communities. While NAR generation…

Computation and Language · Computer Science 2023-07-07 Yisheng Xiao , Lijun Wu , Junliang Guo , Juntao Li , Min Zhang , Tao Qin , Tie-yan Liu

Non-Autoregressive Neural Machine Translation (NAT) has achieved significant inference speedup by generating all tokens simultaneously. Despite its high efficiency, NAT usually suffers from two kinds of translation errors: over-translation…

Computation and Language · Computer Science 2021-04-27 Yong Shan , Yang Feng , Chenze Shao

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to…

Machine Learning · Computer Science 2019-11-25 Junliang Guo , Xu Tan , Linli Xu , Tao Qin , Enhong Chen , Tie-Yan Liu

Non-autoregressive neural machine translation (NAT) generates each target word in parallel and has achieved promising inference acceleration. However, existing NAT models still have a big gap in translation quality compared to…

Computation and Language · Computer Science 2020-12-17 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou

Non-autoregressive Transformer is a promising text generation model. However, current non-autoregressive models still fall behind their autoregressive counterparts in translation quality. We attribute this accuracy gap to the lack of…

Computation and Language · Computer Science 2021-03-23 Yu Bao , Shujian Huang , Tong Xiao , Dongqi Wang , Xinyu Dai , Jiajun Chen

Non-Autoregressive machine Translation (NAT) models have demonstrated significant inference speedup but suffer from inferior translation accuracy. The common practice to tackle the problem is transferring the Autoregressive machine…

Computation and Language · Computer Science 2021-05-18 Yongchang Hao , Shilin He , Wenxiang Jiao , Zhaopeng Tu , Michael Lyu , Xing Wang

However, current autoregressive approaches suffer from high latency. In this paper, we focus on non-autoregressive translation (NAT) for this problem for its efficiency advantage. We identify that current constrained NAT models, which are…

Computation and Language · Computer Science 2022-10-27 Chun Zeng , Jiangjie Chen , Tianyi Zhuang , Rui Xu , Hao Yang , Ying Qin , Shimin Tao , Yanghua Xiao

Non-autoregressive translation (NAT) significantly accelerates the inference process via predicting the entire target sequence. However, recent studies show that NAT is weak at learning high-mode of knowledge such as one-to-many…

Computation and Language · Computer Science 2021-06-14 Liang Ding , Longyue Wang , Xuebo Liu , Derek F. Wong , Dacheng Tao , Zhaopeng Tu

Existing approaches to neural machine translation condition each output word on previously generated outputs. We introduce a model that avoids this autoregressive property and produces its outputs in parallel, allowing an order of magnitude…

Computation and Language · Computer Science 2018-03-12 Jiatao Gu , James Bradbury , Caiming Xiong , Victor O. K. Li , Richard Socher
‹ Prev 1 2 3 10 Next ›