English
Related papers

Related papers: Learning to Recover from Multi-Modality Errors for…

200 papers

Non-autoregressive translation models (NAT) have achieved impressive inference speedup. A potential issue of the existing NAT algorithms, however, is that the decoding is conducted in parallel, without directly considering previous context.…

Computation and Language · Computer Science 2019-07-23 Bingzhen Wei , Mingxuan Wang , Hao Zhou , Junyang Lin , Jun Xie , Xu Sun

Non-autoregressive Transformer (NAT) is a family of text generation models, which aims to reduce the decoding latency by predicting the whole sentences in parallel. However, such latency reduction sacrifices the ability to capture…

Computation and Language · Computer Science 2022-06-14 Fei Huang , Tianhua Tao , Hao Zhou , Lei Li , Minlie Huang

In this work, we introduce a novel local autoregressive translation (LAT) mechanism into non-autoregressive translation (NAT) models so as to capture local dependencies among tar-get outputs. Specifically, for each target decoding position,…

Computation and Language · Computer Science 2020-11-13 Xiang Kong , Zhisong Zhang , Eduard Hovy

Non-autoregressive machine translation (NAT) has recently made great progress. However, most works to date have focused on standard translation tasks, even though some edit-based NAT models, such as the Levenshtein Transformer (LevT), seem…

Computation and Language · Computer Science 2023-02-21 Jitao Xu , Josep Crego , François Yvon

Non-autoregressive Transformer(NAT) significantly accelerates the inference of neural machine translation. However, conventional NAT models suffer from limited expression power and performance degradation compared to autoregressive (AT)…

Computation and Language · Computer Science 2023-11-15 Shangtong Gui , Chenze Shao , Zhengrui Ma , Xishan Zhang , Yunji Chen , Yang Feng

It is difficult for non-autoregressive translation (NAT) models to capture the multi-modal distribution of target translations due to their conditional independence assumption, which is known as the "multi-modality problem", including the…

Computation and Language · Computer Science 2022-07-12 Kexun Zhang , Rui Wang , Xu Tan , Junliang Guo , Yi Ren , Tao Qin , Tie-Yan Liu

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

Non-autoregressive translation (NAT) achieves faster inference speed but at the cost of worse accuracy compared with autoregressive translation (AT). Since AT and NAT can share model structure and AT is an easier task than NAT due to the…

Computation and Language · Computer Science 2020-07-20 Jinglin Liu , Yi Ren , Xu Tan , Chen Zhang , Tao Qin , Zhou Zhao , Tie-Yan Liu

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to…

Machine Learning · Computer Science 2019-11-25 Junliang Guo , Xu Tan , Linli Xu , Tao Qin , Enhong Chen , Tie-Yan Liu

Simultaneous machine translation (SiMT) models are trained to strike a balance between latency and translation quality. However, training these models to achieve high quality while maintaining low latency often leads to a tendency for…

Computation and Language · Computer Science 2023-10-24 Zhengrui Ma , Shaolei Zhang , Shoutao Guo , Chenze Shao , Min Zhang , Yang Feng

Human motion prediction, which aims at predicting future human skeletons given the past ones, is a typical sequence-to-sequence problem. Therefore, extensive efforts have been continued on exploring different RNN-based encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Bin Li , Jian Tian , Zhongfei Zhang , Hailin Feng , Xi Li

Despite low latency, non-autoregressive machine translation (NAT) suffers severe performance deterioration due to the naive independence assumption. This assumption is further strengthened by cross-entropy loss, which encourages a strict…

Computation and Language · Computer Science 2022-10-21 Yafu Li , Leyang Cui , Yongjing Yin , Yue Zhang

Non-autoregressive (NAR) neural machine translation is usually done via knowledge distillation from an autoregressive (AR) model. Under this framework, we leverage large monolingual corpora to improve the NAR model's performance, with the…

Computation and Language · Computer Science 2020-12-01 Jiawei Zhou , Phillip Keung

Non-Autoregressive Neural Machine Translation (NAT) achieves significant decoding speedup through generating target words independently and simultaneously. However, in the context of non-autoregressive translation, the word-level…

Computation and Language · Computer Science 2019-11-22 Chenze Shao , Jinchao Zhang , Yang Feng , Fandong Meng , Jie Zhou

Non-autoregressive neural machine translation (NAT) suffers from the multi-modality problem: the source sentence may have multiple correct translations, but the loss function is calculated only according to the reference sentence.…

Computation and Language · Computer Science 2022-05-31 Chenze Shao , Xuanfu Wu , Yang Feng

Non-autoregressive translation (NAT) significantly accelerates the inference process by predicting the entire target sequence. However, due to the lack of target dependency modelling in the decoder, the conditional generation process…

Computation and Language · Computer Science 2020-11-03 Liang Ding , Longyue Wang , Di Wu , Dacheng Tao , Zhaopeng Tu

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

The autoregressive (AR) models, such as attention-based encoder-decoder models and RNN-Transducer, have achieved great success in speech recognition. They predict the output sequence conditioned on the previous tokens and acoustic encoded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Zhengkun Tian , Jiangyan Yi , Jianhua Tao , Ye Bai , Shuai Zhang , Zhengqi Wen , Xuefei Liu

In this work, we empirically confirm that non-autoregressive translation with an iterative refinement mechanism (IR-NAT) suffers from poor acceleration robustness because it is more sensitive to decoding batch size and computing device…

Computation and Language · Computer Science 2022-10-20 Qiang Wang , Xinhui Hu , Ming Chen

Non-autoregressive translation (NAT) reduces the decoding latency but suffers from performance degradation due to the multi-modality problem. Recently, the structure of directed acyclic graph has achieved great success in NAT, which tackles…

Computation and Language · Computer Science 2023-07-18 Zhengrui Ma , Chenze Shao , Shangtong Gui , Min Zhang , Yang Feng