English
Related papers

Related papers: DePA: Improving Non-autoregressive Machine Transla…

200 papers

Non-autoregressive translation (NAT) significantly accelerates the inference process via predicting the entire target sequence. However, recent studies show that NAT is weak at learning high-mode of knowledge such as one-to-many…

Computation and Language · Computer Science 2021-06-14 Liang Ding , Longyue Wang , Xuebo Liu , Derek F. Wong , Dacheng Tao , Zhaopeng Tu

How do we perform efficient inference while retaining high translation quality? Existing neural machine translation models, such as Transformer, achieve high performance, but they decode words one by one, which is inefficient. Recent…

Computation and Language · Computer Science 2021-10-15 Chenyang Huang , Hao Zhou , Osmar R. Zaïane , Lili Mou , Lei Li

In this work, we introduce a novel local autoregressive translation (LAT) mechanism into non-autoregressive translation (NAT) models so as to capture local dependencies among tar-get outputs. Specifically, for each target decoding position,…

Computation and Language · Computer Science 2020-11-13 Xiang Kong , Zhisong Zhang , Eduard Hovy

Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word positions. Latent…

Computation and Language · Computer Science 2022-10-11 Chenze Shao , Yang Feng

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

Computation and Language · Computer Science 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

Non-autoregressive translation models (NAT) have achieved impressive inference speedup. A potential issue of the existing NAT algorithms, however, is that the decoding is conducted in parallel, without directly considering previous context.…

Computation and Language · Computer Science 2019-07-23 Bingzhen Wei , Mingxuan Wang , Hao Zhou , Junyang Lin , Jun Xie , Xu Sun

Autoregressive decoding limits the efficiency of transformers for Machine Translation (MT). The community proposed specific network architectures and learning-based methods to solve this issue, which are expensive and require changes to the…

Computation and Language · Computer Science 2025-02-06 Andrea Santilli , Silvio Severino , Emilian Postolache , Valentino Maiorca , Michele Mancusi , Riccardo Marin , Emanuele Rodolà

Attention-based sequence-to-sequence model has proved successful in Neural Machine Translation (NMT). However, the attention without consideration of decoding history, which includes the past information in the decoder and the attention…

Computation and Language · Computer Science 2018-02-07 Junyang Lin , Shuming Ma , Qi Su , Xu Sun

In NMT, how far can we get without attention and without separate encoding and decoding? To answer that question, we introduce a recurrent neural translation model that does not use attention and does not have a separate encoder and…

Computation and Language · Computer Science 2018-11-01 Ofir Press , Noah A. Smith

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

Human motion prediction, which aims at predicting future human skeletons given the past ones, is a typical sequence-to-sequence problem. Therefore, extensive efforts have been continued on exploring different RNN-based encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Bin Li , Jian Tian , Zhongfei Zhang , Hailin Feng , Xi Li

However, current autoregressive approaches suffer from high latency. In this paper, we focus on non-autoregressive translation (NAT) for this problem for its efficiency advantage. We identify that current constrained NAT models, which are…

Computation and Language · Computer Science 2022-10-27 Chun Zeng , Jiangjie Chen , Tianyi Zhuang , Rui Xu , Hao Yang , Ying Qin , Shimin Tao , Yanghua Xiao

Non-autoregressive Transformers (NATs) significantly reduce the decoding latency by generating all tokens in parallel. However, such independent predictions prevent NATs from capturing the dependencies between the tokens for generating…

Computation and Language · Computer Science 2022-05-17 Fei Huang , Hao Zhou , Yang Liu , Hang Li , Minlie Huang

Non-autoregressive Transformers (NATs) reduce the inference latency of Autoregressive Transformers (ATs) by predicting words all at once rather than in sequential order. They have achieved remarkable progress in machine translation as well…

Computation and Language · Computer Science 2023-06-05 Chenxin An , Jiangtao Feng , Fei Huang , Xipeng Qiu , Lingpeng Kong

The conversion from text to speech relies on the accurate mapping from linguistic to acoustic symbol sequences, for which current practice employs recurrent statistical models like recurrent neural networks. Despite the good performance of…

Sound · Computer Science 2018-11-07 Santiago Pascual , Antonio Bonafonte , Joan Serrà

The field of image synthesis is currently flourishing due to the advancements in diffusion models. While diffusion models have been successful, their computational intensity has prompted the pursuit of more efficient alternatives. As a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Zanlin Ni , Yulin Wang , Renping Zhou , Jiayi Guo , Jinyi Hu , Zhiyuan Liu , Shiji Song , Yuan Yao , Gao Huang

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

Computation and Language · Computer Science 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee

Non-autoregressive translation (NAT) achieves faster inference speed but at the cost of worse accuracy compared with autoregressive translation (AT). Since AT and NAT can share model structure and AT is an easier task than NAT due to the…

Computation and Language · Computer Science 2020-07-20 Jinglin Liu , Yi Ren , Xu Tan , Chen Zhang , Tao Qin , Zhou Zhao , Tie-Yan Liu

Most of modern neural machine translation (NMT) models are based on an encoder-decoder framework with an attention mechanism. While they perform well on standard datasets, they can have trouble in translation of long inputs that are rare or…

Computation and Language · Computer Science 2026-03-31 Shuhei Kondo , Katsuhito Sudoh , Yuji Matsumoto