English
Related papers

Related papers: Multi-Granularity Optimization for Non-Autoregress…

200 papers

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to…

Machine Learning · Computer Science 2019-11-25 Junliang Guo , Xu Tan , Linli Xu , Tao Qin , Enhong Chen , Tie-Yan Liu

Non-autoregressive Transformer(NAT) significantly accelerates the inference of neural machine translation. However, conventional NAT models suffer from limited expression power and performance degradation compared to autoregressive (AT)…

Computation and Language · Computer Science 2023-11-15 Shangtong Gui , Chenze Shao , Zhengrui Ma , Xishan Zhang , Yunji Chen , Yang Feng

Non-autoregressive neural machine translation (NAT) generates each target word in parallel and has achieved promising inference acceleration. However, existing NAT models still have a big gap in translation quality compared to…

Computation and Language · Computer Science 2020-12-17 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou

In this work, we empirically confirm that non-autoregressive translation with an iterative refinement mechanism (IR-NAT) suffers from poor acceleration robustness because it is more sensitive to decoding batch size and computing device…

Computation and Language · Computer Science 2022-10-20 Qiang Wang , Xinhui Hu , Ming Chen

Recent advances have made non-autoregressive (NAT) translation comparable to autoregressive methods (AT). However, their evaluation using BLEU has been shown to weakly correlate with human annotations. Limited research compares…

Computation and Language · Computer Science 2024-05-22 Yafu Li , Huajian Zhang , Jianhao Yan , Yongjing Yin , Yue Zhang

Non-Autoregressive Transformer (NAT) aims to accelerate the Transformer model through discarding the autoregressive mechanism and generating target words independently, which fails to exploit the target sequential information.…

Computation and Language · Computer Science 2019-06-25 Chenze Shao , Yang Feng , Jinchao Zhang , Fandong Meng , Xilin Chen , Jie Zhou

Non-autoregressive neural machine translation (NART) models suffer from the multi-modality problem which causes translation inconsistency such as token repetition. Most recent approaches have attempted to solve this problem by implicitly…

Computation and Language · Computer Science 2021-09-15 Jongyoon Song , Sungwon Kim , Sungroh Yoon

Improving neural machine translation (NMT) models using the back-translations of the monolingual target data (synthetic parallel data) is currently the state-of-the-art approach for training improved translation systems. The quality of the…

Computation and Language · Computer Science 2021-02-16 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

It is difficult for non-autoregressive translation (NAT) models to capture the multi-modal distribution of target translations due to their conditional independence assumption, which is known as the "multi-modality problem", including the…

Computation and Language · Computer Science 2022-07-12 Kexun Zhang , Rui Wang , Xu Tan , Junliang Guo , Yi Ren , Tao Qin , Tie-Yan Liu

Back-translation - data augmentation by translating target monolingual data - is a crucial component in modern neural machine translation (NMT). In this work, we reformulate back-translation in the scope of cross-entropy optimization of an…

Computation and Language · Computer Science 2019-06-19 Miguel Graça , Yunsu Kim , Julian Schamper , Shahram Khadivi , Hermann Ney

Recent work on non-autoregressive neural machine translation (NAT) aims at improving the efficiency by parallel decoding without sacrificing the quality. However, existing NAT methods are either inferior to Transformer or require multiple…

Computation and Language · Computer Science 2021-05-14 Lihua Qian , Hao Zhou , Yu Bao , Mingxuan Wang , Lin Qiu , Weinan Zhang , Yong Yu , Lei Li

Non-autoregressive translation (NAT) reduces the decoding latency but suffers from performance degradation due to the multi-modality problem. Recently, the structure of directed acyclic graph has achieved great success in NAT, which tackles…

Computation and Language · Computer Science 2023-07-18 Zhengrui Ma , Chenze Shao , Shangtong Gui , Min Zhang , Yang Feng

Due to the unparallelizable nature of the autoregressive factorization, AutoRegressive Translation (ART) models have to generate tokens sequentially during decoding and thus suffer from high inference latency. Non-AutoRegressive Translation…

Computation and Language · Computer Science 2019-09-17 Zhuohan Li , Zi Lin , Di He , Fei Tian , Tao Qin , Liwei Wang , Tie-Yan Liu

Although neural machine translation models reached high translation quality, the autoregressive nature makes inference difficult to parallelize and leads to high translation latency. Inspired by recent refinement-based approaches, we…

Computation and Language · Computer Science 2019-11-22 Raphael Shu , Jason Lee , Hideki Nakayama , Kyunghyun Cho

Existing approaches to neural machine translation condition each output word on previously generated outputs. We introduce a model that avoids this autoregressive property and produces its outputs in parallel, allowing an order of magnitude…

Computation and Language · Computer Science 2018-03-12 Jiatao Gu , James Bradbury , Caiming Xiong , Victor O. K. Li , Richard Socher

Non-autoregressive translation (NAT) significantly accelerates the inference process by predicting the entire target sequence. However, due to the lack of target dependency modelling in the decoder, the conditional generation process…

Computation and Language · Computer Science 2020-11-03 Liang Ding , Longyue Wang , Di Wu , Dacheng Tao , Zhaopeng Tu

Non-autoregressive machine translation (NAT) has recently made great progress. However, most works to date have focused on standard translation tasks, even though some edit-based NAT models, such as the Levenshtein Transformer (LevT), seem…

Computation and Language · Computer Science 2023-02-21 Jitao Xu , Josep Crego , François Yvon

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

Recently, non-autoregressive (NAR) neural machine translation models have received increasing attention due to their efficient parallel decoding. However, the probabilistic framework of NAR models necessitates conditional independence…

Computation and Language · Computer Science 2022-11-14 Xinyou Wang , Zaixiang Zheng , Shujian Huang