English
Related papers

Related papers: Improving Top-K Decoding for Non-Autoregressive Se…

200 papers

Non-autoregressive translation (NAT) significantly accelerates the inference process by predicting the entire target sequence. However, due to the lack of target dependency modelling in the decoder, the conditional generation process…

Computation and Language · Computer Science 2020-11-03 Liang Ding , Longyue Wang , Di Wu , Dacheng Tao , Zhaopeng Tu

An effective recipe for building seq2seq, non-autoregressive, task-oriented parsers to map utterances to semantic frames proceeds in three steps: encoding an utterance $x$, predicting a frame's length |y|, and decoding a |y|-sized frame…

Computation and Language · Computer Science 2021-09-16 Akshat Shrivastava , Pierce Chuang , Arun Babu , Shrey Desai , Abhinav Arora , Alexander Zotov , Ahmed Aly

Existing sentence ordering approaches generally employ encoder-decoder frameworks with the pointer net to recover the coherence by recurrently predicting each sentence step-by-step. Such an autoregressive manner only leverages unilateral…

Computation and Language · Computer Science 2023-10-20 Yi Bin , Wenhao Shi , Bin Ji , Jipeng Zhang , Yujuan Ding , Yang Yang

Long-context modeling is crucial for next-generation language models, yet the high computational cost of standard attention mechanisms poses significant computational challenges. Sparse attention offers a promising direction for improving…

Context-aware neural machine translation aims to use the document-level context to improve translation quality. However, not all words in the context are helpful. The irrelevant or trivial words may bring some noise and distract the model…

Computation and Language · Computer Science 2023-04-20 Jian Yang , Yuwei Yin , Shuming Ma , Liqun Yang , Hongcheng Guo , Haoyang Huang , Dongdong Zhang , Yutao Zeng , Zhoujun Li , Furu Wei

Conventional spoken language understanding systems consist of two main components: an automatic speech recognition module that converts audio to a transcript, and a natural language understanding module that transforms the resulting text…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Parisa Haghani , Arun Narayanan , Michiel Bacchiani , Galen Chuang , Neeraj Gaur , Pedro Moreno , Rohit Prabhavalkar , Zhongdi Qu , Austin Waters

In sequence-to-sequence Transformer ASR, autoregressive (AR) models achieve strong accuracy but suffer from slow decoding, while non-autoregressive (NAR) models enable parallel decoding at the cost of degraded performance. We propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-26 Hao Yen , Pin-Jui Ku , Ante Jukić , Sabato Marco Siniscalchi

Autoregressive sequence Generation models have achieved state-of-the-art performance in areas like machine translation and image captioning. These models are autoregressive in that they generate each word by conditioning on previously…

Computation and Language · Computer Science 2021-01-26 Longteng Guo , Jing Liu , Xinxin Zhu , Hanqing Lu

The non-autoregressive models have boosted the efficiency of neural machine translation through parallelized decoding at the cost of effectiveness when comparing with the autoregressive counterparts. In this paper, we claim that the…

Computation and Language · Computer Science 2021-01-25 Ye Liu , Yao Wan , Jian-Guo Zhang , Wenting Zhao , Philip S. Yu

Understanding human instructions and accomplishing Vision-Language Navigation tasks in unknown environments is essential for robots. However, existing modular approaches heavily rely on the quality of training data and often exhibit poor…

Robotics · Computer Science 2025-09-30 Yao Wang , Zhirui Sun , Wenzheng Chi , Baozhi Jia , Wenjun Xu , Jiankun Wang

Combining end-to-end speech translation (ST) and non-autoregressive (NAR) generation is promising in language and speech processing for their advantages of less error propagation and low latency. In this paper, we investigate the potential…

Computation and Language · Computer Science 2023-05-30 Chen Xu , Xiaoqian Liu , Xiaowen Liu , Qingxuan Sun , Yuhao Zhang , Murun Yang , Qianqian Dong , Tom Ko , Mingxuan Wang , Tong Xiao , Anxiang Ma , Jingbo Zhu

Sign Language Production (SLP) aims to translate expressions in spoken language into corresponding ones in sign language, such as skeleton-based sign poses or videos. Existing SLP models are either AutoRegressive (AR) or Non-Autoregressive…

Machine Learning · Computer Science 2022-08-24 Eui Jun Hwang , Jung Ho Kim , Suk Min Cho , Jong C. Park

Non-Autoregressive Neural Machine Translation (NAT) has achieved significant inference speedup by generating all tokens simultaneously. Despite its high efficiency, NAT usually suffers from two kinds of translation errors: over-translation…

Computation and Language · Computer Science 2021-04-27 Yong Shan , Yang Feng , Chenze Shao

We propose an efficient inference procedure for non-autoregressive machine translation that iteratively refines translation purely in the continuous space. Given a continuous latent variable model for machine translation (Shu et al., 2020),…

Computation and Language · Computer Science 2020-09-16 Jason Lee , Raphael Shu , Kyunghyun Cho

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

Recent advances in End-to-End (E2E) Spoken Language Understanding (SLU) have been primarily due to effective pretraining of speech representations. One such pretraining paradigm is the distillation of semantic knowledge from…

Computation and Language · Computer Science 2022-07-04 Vishal Sunder , Eric Fosler-Lussier , Samuel Thomas , Hong-Kwang J. Kuo , Brian Kingsbury

Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to the…

Computation and Language · Computer Science 2021-01-01 Jiatao Gu , Xiang Kong

Recent studies find existing self-supervised speech encoders contain primarily acoustic rather than semantic information. As a result, pipelined supervised automatic speech recognition (ASR) to large language model (LLM) systems achieve…

Sparse autoencoders (SAEs) have recently emerged as a powerful tool for language model steering. Prior work has explored top-k SAE latents for steering, but we observe that many dimensions among the top-k latents capture non-semantic…

Computation and Language · Computer Science 2025-10-03 Jiaqing Xie

Non-autoregressive (NAR) transformer models have achieved significantly inference speedup but at the cost of inferior accuracy compared to autoregressive (AR) models in automatic speech recognition (ASR). Most of the NAR transformers take a…

Sound · Computer Science 2021-04-19 Xingchen Song , Zhiyong Wu , Yiheng Huang , Chao Weng , Dan Su , Helen Meng