English
Related papers

Related papers: Semi-Autoregressive Neural Machine Translation

200 papers

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

Computation and Language · Computer Science 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee

Autoregressive models have been widely used in unsupervised text style transfer. Despite their success, these models still suffer from the content preservation problem that they usually ignore part of the source sentence and generate some…

Computation and Language · Computer Science 2021-06-07 Fei Huang , Zikai Chen , Chen Henry Wu , Qihan Guo , Xiaoyan Zhu , Minlie Huang

Autoregressive sequence models achieve state-of-the-art performance in domains like machine translation. However, due to the autoregressive factorization nature, these models suffer from heavy latency during inference. Recently,…

Machine Learning · Computer Science 2020-01-10 Zhiqing Sun , Zhuohan Li , Haoqing Wang , Zi Lin , Di He , Zhi-Hong Deng

Non-autoregressive neural machine translation (NAT) usually employs sequence-level knowledge distillation using autoregressive neural machine translation (AT) as its teacher model. However, a NAT model often outputs shorter sentences than…

Computation and Language · Computer Science 2021-07-30 Yui Oka , Katsuhito Sudoh , Satoshi Nakamura

Non-autoregressive Transformer is a promising text generation model. However, current non-autoregressive models still fall behind their autoregressive counterparts in translation quality. We attribute this accuracy gap to the lack of…

Computation and Language · Computer Science 2021-03-23 Yu Bao , Shujian Huang , Tong Xiao , Dongqi Wang , Xinyu Dai , Jiajun Chen

Recently, simultaneous translation has gathered a lot of attention since it enables compelling applications such as subtitle translation for a live event or real-time video-call translation. Some of these translation applications allow…

Computation and Language · Computer Science 2021-06-03 Hyojung Han , Sathish Indurthi , Mohd Abbas Zaidi , Nikhil Kumar Lakumarapu , Beomseok Lee , Sangha Kim , Chanwoo Kim , Inchul Hwang

In simultaneous machine translation, the objective is to determine when to produce a partial translation given a continuous stream of source words, with a trade-off between latency and quality. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2020-06-01 Patrick Wilken , Tamer Alkhouli , Evgeny Matusov , Pavel Golik

Transformer-based approaches have revolutionized image super-resolution by modeling long-range dependencies. However, the quadratic computational complexity of vanilla self-attention mechanisms poses significant challenges, often leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Dinh Phu Tran , Thao Do , Saad Wazir , Seongah Kim , Seon Kwon Kim , Daeyoung Kim

Neural Machine Translation has achieved state-of-the-art performance for several language pairs using a combination of parallel and synthetic data. Synthetic data is often generated by back-translating sentences randomly sampled from…

Computation and Language · Computer Science 2018-09-24 Marzieh Fadaee , Christof Monz

Non-autoregressive Transformer (NAT) is a family of text generation models, which aims to reduce the decoding latency by predicting the whole sentences in parallel. However, such latency reduction sacrifices the ability to capture…

Computation and Language · Computer Science 2022-06-14 Fei Huang , Tianhua Tao , Hao Zhou , Lei Li , Minlie Huang

Non-autoregressive models are promising on various text generation tasks. Previous work hardly considers to explicitly model the positions of generated words. However, position modeling is an essential problem in non-autoregressive text…

Computation and Language · Computer Science 2019-12-02 Yu Bao , Hao Zhou , Jiangtao Feng , Mingxuan Wang , Shujian Huang , Jiajun Chen , Lei LI

Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word positions. Latent…

Computation and Language · Computer Science 2022-10-11 Chenze Shao , Yang Feng

Simultaneous machine translation (SimulMT) speeds up the translation process by starting to translate before the source sentence is completely available. It is difficult due to limited context and word order difference between languages.…

Computation and Language · Computer Science 2022-05-05 Chih-Chiang Chang , Shun-Po Chuang , Hung-yi Lee

Due to the unparallelizable nature of the autoregressive factorization, AutoRegressive Translation (ART) models have to generate tokens sequentially during decoding and thus suffer from high inference latency. Non-AutoRegressive Translation…

Computation and Language · Computer Science 2019-09-17 Zhuohan Li , Zi Lin , Di He , Fei Tian , Tao Qin , Liwei Wang , Tie-Yan Liu

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to…

Machine Learning · Computer Science 2019-11-25 Junliang Guo , Xu Tan , Linli Xu , Tao Qin , Enhong Chen , Tie-Yan Liu

Current state-of-the-art approaches for image captioning typically adopt an autoregressive manner, i.e., generating descriptions word by word, which suffers from slow decoding issue and becomes a bottleneck in real-time applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Xu Yan , Zhengcong Fei , Zekang Li , Shuhui Wang , Qingming Huang , Qi Tian

A great proportion of sequence-to-sequence (Seq2Seq) models for Neural Machine Translation (NMT) adopt Recurrent Neural Network (RNN) to generate translation word by word following a sequential order. As the studies of linguistics have…

Computation and Language · Computer Science 2018-06-14 Junyang Lin , Xu Sun , Xuancheng Ren , Shuming Ma , Jinsong Su , Qi Su

However, current autoregressive approaches suffer from high latency. In this paper, we focus on non-autoregressive translation (NAT) for this problem for its efficiency advantage. We identify that current constrained NAT models, which are…

Computation and Language · Computer Science 2022-10-27 Chun Zeng , Jiangjie Chen , Tianyi Zhuang , Rui Xu , Hao Yang , Ying Qin , Shimin Tao , Yanghua Xiao

Non-autoregressive (NAR) neural machine translation is usually done via knowledge distillation from an autoregressive (AR) model. Under this framework, we leverage large monolingual corpora to improve the NAR model's performance, with the…

Computation and Language · Computer Science 2020-12-01 Jiawei Zhou , Phillip Keung

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier