English
Related papers

Related papers: Retrieving Sequential Information for Non-Autoregr…

200 papers

Fast inference speed is an important goal towards real-world deployment of speech translation (ST) systems. End-to-end (E2E) models based on the encoder-decoder architecture are more suitable for this goal than traditional cascaded systems,…

Computation and Language · Computer Science 2021-02-19 Hirofumi Inaguma , Yosuke Higuchi , Kevin Duh , Tatsuya Kawahara , Shinji Watanabe

Non-autoregressive (nAR) models for machine translation (MT) manifest superior decoding speed when compared to autoregressive (AR) models, at the expense of impaired fluency of their outputs. We improve the fluency of a nAR model with…

Computation and Language · Computer Science 2020-04-08 Zdeněk Kasner , Jindřich Libovický , Jindřich Helcl

This paper describes a variational auto-encoder based non-autoregressive text-to-speech (VAENAR-TTS) model. The autoregressive TTS (AR-TTS) models based on the sequence-to-sequence architecture can generate high-quality speech, but their…

Sound · Computer Science 2021-07-08 Hui Lu , Zhiyong Wu , Xixin Wu , Xu Li , Shiyin Kang , Xunying Liu , Helen Meng

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the recurrent networks…

Computation and Language · Computer Science 2021-05-04 Ritam Mallick , Seba Susan , Vaibhaw Agrawal , Rizul Garg , Prateek Rawal

Efficient machine translation models are commercially important as they can increase inference speeds, and reduce costs and carbon emissions. Recently, there has been much interest in non-autoregressive (NAR) models, which promise faster…

Computation and Language · Computer Science 2022-05-05 Jindřich Helcl , Barry Haddow , Alexandra Birch

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

State-of-the-art Transformer-based neural machine translation (NMT) systems still follow a standard encoder-decoder framework, in which source sentence representation can be well done by an encoder with self-attention mechanism. Though…

Computation and Language · Computer Science 2019-12-30 Zuchao Li , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Zhuosheng Zhang , Hai Zhao

Neural machine translation (NMT) takes deterministic sequences for source representations. However, either word-level or subword-level segmentations have multiple choices to split a source sequence with different word segmentors or…

Computation and Language · Computer Science 2019-06-05 Fengshun Xiao , Jiangtong Li , Hai Zhao , Rui Wang , Kehai Chen

Direct speech-to-speech translation (S2ST) has achieved impressive translation quality, but it often faces the challenge of slow decoding due to the considerable length of speech sequences. Recently, some research has turned to…

Computation and Language · Computer Science 2024-06-12 Qingkai Fang , Zhengrui Ma , Yan Zhou , Min Zhang , Yang Feng

Multilingual neural machine translation (MNMT) aims at using one single model for multiple translation directions. Recent work applies non-autoregressive Transformers to improve the efficiency of MNMT, but requires expensive knowledge…

Computation and Language · Computer Science 2025-02-10 Chenyang Huang , Fei Huang , Zaixiang Zheng , Osmar R. Zaïane , Hao Zhou , Lili Mou

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

Computation and Language · Computer Science 2016-03-24 Jiwei Li , Dan Jurafsky

Nearest neighbor machine translation augments the Autoregressive Translation~(AT) with $k$-nearest-neighbor retrieval, by comparing the similarity between the token-level context representations of the target tokens in the query and the…

Computation and Language · Computer Science 2023-02-08 Rui Lv , Junliang Guo , Rui Wang , Xu Tan , Qi Liu , Tao Qin

Although attention-based Neural Machine Translation has achieved remarkable progress in recent layers, it still suffers from issue of making insufficient use of the output of each layer. In transformer, it only uses the top layer of encoder…

Computation and Language · Computer Science 2021-08-02 GuoLiang Li , Yiyang Li

Non-autoregressive (NAR) models simultaneously generate multiple outputs in a sequence, which significantly reduces the inference speed at the cost of accuracy drop compared to autoregressive baselines. Showing great potential for real-time…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Yosuke Higuchi , Nanxin Chen , Yuya Fujita , Hirofumi Inaguma , Tatsuya Komatsu , Jaesong Lee , Jumon Nozaki , Tianzi Wang , Shinji Watanabe

The generation of transferable adversarial perturbations typically involves training a generator to maximize embedding separation between clean and adversarial images at a single mid-layer of a source model. In this work, we build on this…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Krishna Kanth Nakka , Alexandre Alahi

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Non-autoregressive neural machine translation (NAT) suffers from the multi-modality problem: the source sentence may have multiple correct translations, but the loss function is calculated only according to the reference sentence.…

Computation and Language · Computer Science 2022-05-31 Chenze Shao , Xuanfu Wu , Yang Feng

In this paper, we describe the use of recurrent neural networks to capture sequential information from the self-attention representations to improve the Transformers. Although self-attention mechanism provides a means to exploit long…

Computation and Language · Computer Science 2021-04-06 Tze Yuang Chong , Xuyang Wang , Lin Yang , Junjie Wang

One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previously seen…

Computation and Language · Computer Science 2018-04-10 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

Non-autoregressive (NAR) machine translation has recently achieved significant improvements, and now outperforms autoregressive (AR) models on some benchmarks, providing an efficient alternative to AR inference. However, while AR…

Computation and Language · Computer Science 2021-12-17 Sweta Agrawal , Julia Kreutzer , Colin Cherry