English
Related papers

Related papers: Decoder-only Streaming Transformer for Simultaneou…

200 papers

Simultaneous translation (ST) outputs translation while receiving the source inputs, and hence requires a policy to determine whether to translate a target token or wait for the next source token. The major challenge of ST is that each…

Computation and Language · Computer Science 2022-11-02 Shaolei Zhang , Yang Feng

The dominant neural machine translation (NMT) models apply unified attentional encoder-decoder neural networks for translation. Traditionally, the NMT decoders adopt recurrent neural networks (RNNs) to perform translation in a left-toright…

Computation and Language · Computer Science 2018-02-06 Xiangwen Zhang , Jinsong Su , Yue Qin , Yang Liu , Rongrong Ji , Hongji Wang

The study of the attention mechanism has sparked interest in many fields, such as language modeling and machine translation. Although its patterns have been exploited to perform different tasks, from neural network understanding to textual…

Computation and Language · Computer Science 2023-10-19 Sara Papi , Matteo Negri , Marco Turchi

Existing wisdom demonstrates the significance of syntactic knowledge for the improvement of neural machine translation models. However, most previous works merely focus on leveraging the source syntax in the well-known encoder-decoder…

Computation and Language · Computer Science 2023-05-30 Lei Li , Kai Fan , Lingyu Yang , Hongjia Li , Chun Yuan

Decoder-only methods, such as GPT, have demonstrated superior performance in many areas compared to traditional encoder-decoder structure transformer methods. Over the years, end-to-end methods based on the traditional transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Liao Pan , Yang Feng , Zhao Wenhui , Yua Jinwen , Zhang Dingwen

Simultaneous machine translation (SiMT) outputs translation while receiving the streaming source inputs, and hence needs a policy to determine where to start translating. The alignment between target and source words often implies the most…

Computation and Language · Computer Science 2022-03-18 Shaolei Zhang , Yang Feng

Simultaneous Machine Translation (SiMT) generates translations while reading the source sentence, necessitating a policy to determine the optimal timing for reading and generating words. Despite the remarkable performance achieved by Large…

Computation and Language · Computer Science 2024-02-21 Shoutao Guo , Shaolei Zhang , Zhengrui Ma , Min Zhang , Yang Feng

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

Computation and Language · Computer Science 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

Streaming Machine Translation (MT) is the task of translating an unbounded input text stream in real-time. The traditional cascade approach, which combines an Automatic Speech Recognition (ASR) and an MT system, relies on an intermediate…

Computation and Language · Computer Science 2024-05-29 Javier Iranzo-Sánchez , Jorge Iranzo-Sánchez , Adrià Giménez , Jorge Civera , Alfons Juan

Simultaneous machine translation (SiMT) outputs translation while reading the source sentence. Unlike conventional sequence-to-sequence (seq2seq) training, existing SiMT methods adopt the prefix-to-prefix (prefix2prefix) training, where the…

Computation and Language · Computer Science 2024-05-29 Shoutao Guo , Shaolei Zhang , Yang Feng

Simultaneous machine translation (SiMT) outputs the target sequence while receiving the source sequence, and hence learning when to start translating each target token is the core challenge for SiMT task. However, it is non-trivial to learn…

Computation and Language · Computer Science 2023-03-02 Shaolei Zhang , Yang Feng

Neural transducers have been widely used in automatic speech recognition (ASR). In this paper, we introduce it to streaming end-to-end speech translation (ST), which aims to convert audio signals to texts in other languages directly.…

Computation and Language · Computer Science 2022-07-05 Jian Xue , Peidong Wang , Jinyu Li , Matt Post , Yashesh Gaur

Neural machine translation (NMT) models generally adopt an encoder-decoder architecture for modeling the entire translation process. The encoder summarizes the representation of input sentence from scratch, which is potentially a problem if…

Computation and Language · Computer Science 2018-12-27 Xinwei Geng , Longyue Wang , Xing Wang , Bing Qin , Ting Liu , Zhaopeng Tu

There have been significant efforts to interpret the encoder of Transformer-based encoder-decoder architectures for neural machine translation (NMT); meanwhile, the decoder remains largely unexamined despite its critical role. During…

Computation and Language · Computer Science 2020-10-07 Yilin Yang , Longyue Wang , Shuming Shi , Prasad Tadepalli , Stefan Lee , Zhaopeng Tu

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

Computation and Language · Computer Science 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

Computation and Language · Computer Science 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong

Standard decoders for neural machine translation autoregressively generate a single target token per time step, which slows inference especially for long outputs. While architectural advances such as the Transformer fully parallelize the…

Computation and Language · Computer Science 2020-10-06 Nader Akoury , Kalpesh Krishna , Mohit Iyyer

Simultaneous machine translation (SiMT) generates translation before reading the entire source sentence and hence it has to trade off between translation quality and latency. To fulfill the requirements of different translation quality and…

Computation and Language · Computer Science 2022-03-22 Shaolei Zhang , Yang Feng

With the evergrowing sizes of pre-trained models (PTMs), it has been an emerging practice to only provide the inference APIs for users, namely model-as-a-service (MaaS) setting. To adapt PTMs with model parameters frozen, most current…

Computation and Language · Computer Science 2023-05-25 Ganqu Cui , Wentao Li , Ning Ding , Longtao Huang , Zhiyuan Liu , Maosong Sun

Speech-to-text translation (ST), which directly translates the source language speech to the target language text, has attracted intensive attention recently. However, the combination of speech recognition and machine translation in a…

Computation and Language · Computer Science 2022-04-18 Qianqian Dong , Mingxuan Wang , Hao Zhou , Shuang Xu , Bo Xu , Lei Li