English
Related papers

Related papers: Retrieving Sequential Information for Non-Autoregr…

200 papers

Non-AutoRegressive (NAR) text generation models have drawn much attention because of their significantly faster decoding speed and good generation quality in machine translation. However, in a wider range of text generation tasks, existing…

Computation and Language · Computer Science 2023-04-25 Fei Huang , Pei Ke , Minlie Huang

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

Computation and Language · Computer Science 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word positions. Latent…

Computation and Language · Computer Science 2022-10-11 Chenze Shao , Yang Feng

Non-autoregressive (NAR) language models are known for their low latency in neural machine translation (NMT). However, a performance gap exists between NAR and autoregressive models due to the large decoding space and difficulty in…

Computation and Language · Computer Science 2024-07-03 Hao Wang , Tetsuro Morimura , Ukyo Honda , Daisuke Kawahara

Non-autoregressive machine translation (NAT) models have lower translation quality than autoregressive translation (AT) models because NAT decoders do not depend on previous target tokens in the decoder input. We propose a novel and general…

Computation and Language · Computer Science 2023-08-03 Jiaao Zhan , Qian Chen , Boxing Chen , Wen Wang , Yu Bai , Yang Gao

The non-autoregressive models have boosted the efficiency of neural machine translation through parallelized decoding at the cost of effectiveness when comparing with the autoregressive counterparts. In this paper, we claim that the…

Computation and Language · Computer Science 2021-01-25 Ye Liu , Yao Wan , Jian-Guo Zhang , Wenting Zhao , Philip S. Yu

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

Computation and Language · Computer Science 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

Non-autoregressive models generate target words in a parallel way, which achieve a faster decoding speed but at the sacrifice of translation accuracy. To remedy a flawed translation by non-autoregressive models, a promising approach is to…

Computation and Language · Computer Science 2020-10-27 Pan Xie , Zhi Cui , Xiuyin Chen , Xiaohui Hu , Jianwei Cui , Bin Wang

Existing sentence ordering approaches generally employ encoder-decoder frameworks with the pointer net to recover the coherence by recurrently predicting each sentence step-by-step. Such an autoregressive manner only leverages unilateral…

Computation and Language · Computer Science 2023-10-20 Yi Bin , Wenhao Shi , Bin Ji , Jipeng Zhang , Yujuan Ding , Yang Yang

Recent work on non-autoregressive neural machine translation (NAT) aims at improving the efficiency by parallel decoding without sacrificing the quality. However, existing NAT methods are either inferior to Transformer or require multiple…

Computation and Language · Computer Science 2021-05-14 Lihua Qian , Hao Zhou , Yu Bao , Mingxuan Wang , Lin Qiu , Weinan Zhang , Yong Yu , Lei Li

Non-autoregressive mechanisms can significantly decrease inference time for speech transformers, especially when the single step variant is applied. Previous work on CTC alignment-based single step non-autoregressive transformer (CASS-NAT)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Ruchao Fan , Wei Chu , Peng Chang , Jing Xiao , Abeer Alwan

Standard decoders for neural machine translation autoregressively generate a single target token per time step, which slows inference especially for long outputs. While architectural advances such as the Transformer fully parallelize the…

Computation and Language · Computer Science 2020-10-06 Nader Akoury , Kalpesh Krishna , Mohit Iyyer

The dominant neural machine translation (NMT) models apply unified attentional encoder-decoder neural networks for translation. Traditionally, the NMT decoders adopt recurrent neural networks (RNNs) to perform translation in a left-toright…

Computation and Language · Computer Science 2018-02-06 Xiangwen Zhang , Jinsong Su , Yue Qin , Yang Liu , Rongrong Ji , Hongji Wang

Non-autoregressive automatic speech recognition (ASR) has become a mainstream of ASR modeling because of its fast decoding speed and satisfactory result. To further boost the performance, relaxing the conditional independence assumption and…

Computation and Language · Computer Science 2023-05-19 Chong-En Lin , Kuan-Yu Chen

Neural sequence-to-sequence networks with attention have achieved remarkable performance for machine translation. One of the reasons for their effectiveness is their ability to capture relevant source-side contextual information at each…

Computation and Language · Computer Science 2018-10-02 Lesly Miculicich Werlen , Nikolaos Pappas , Dhananjay Ram , Andrei Popescu-Belis

Recently, non-autoregressive (NAR) neural machine translation models have received increasing attention due to their efficient parallel decoding. However, the probabilistic framework of NAR models necessitates conditional independence…

Computation and Language · Computer Science 2022-11-14 Xinyou Wang , Zaixiang Zheng , Shujian Huang

Due to the unparallelizable nature of the autoregressive factorization, AutoRegressive Translation (ART) models have to generate tokens sequentially during decoding and thus suffer from high inference latency. Non-AutoRegressive Translation…

Computation and Language · Computer Science 2019-09-17 Zhuohan Li , Zi Lin , Di He , Fei Tian , Tao Qin , Liwei Wang , Tie-Yan Liu

Non-autoregressive models are promising on various text generation tasks. Previous work hardly considers to explicitly model the positions of generated words. However, position modeling is an essential problem in non-autoregressive text…

Computation and Language · Computer Science 2019-12-02 Yu Bao , Hao Zhou , Jiangtao Feng , Mingxuan Wang , Shujian Huang , Jiajun Chen , Lei LI

Non-autoregressive neural machine translation (NAT) offers substantial translation speed up compared to autoregressive neural machine translation (AT) at the cost of translation quality. Latent variable modeling has emerged as a promising…

Computation and Language · Computer Science 2024-09-10 DongNyeong Heo , Heeyoul Choi