中文
相关论文

相关论文: Interactive Attention for Neural Machine Translati…

200 篇论文

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

计算与语言 · 计算机科学 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

This work investigates the alignment problem in state-of-the-art multi-head attention models based on the transformer architecture. We demonstrate that alignment extraction in transformer models can be improved by augmenting an additional…

计算与语言 · 计算机科学 2018-09-12 Tamer Alkhouli , Gabriel Bretschner , Hermann Ney

Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation…

计算与语言 · 计算机科学 2020-03-31 Pei Zhang , Xu Zhang , Wei Chen , Jian Yu , Yanfeng Wang , Deyi Xiong

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

计算与语言 · 计算机科学 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

计算与语言 · 计算机科学 2017-08-22 Robert Östling , Jörg Tiedemann

Attention-based sequence-to-sequence model has proved successful in Neural Machine Translation (NMT). However, the attention without consideration of decoding history, which includes the past information in the decoder and the attention…

计算与语言 · 计算机科学 2018-02-07 Junyang Lin , Shuming Ma , Qi Su , Xu Sun

Attention-based autoregressive models have achieved state-of-the-art performance in various sequence-to-sequence tasks, including Text-To-Speech (TTS) and Neural Machine Translation (NMT), but can be difficult to train. The standard…

计算与语言 · 计算机科学 2022-11-08 Qingyun Dou , Mark Gales

Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be…

计算与语言 · 计算机科学 2020-06-23 Junxuan Chen , Xiang Li , Jiarui Zhang , Chulun Zhou , Jianwei Cui , Bin Wang , Jinsong Su

The interest in statistical machine translation systems increases currently due to political and social events in the world. A proposed Statistical Machine Translation (SMT) based model that can be used to translate a sentence from the…

计算与语言 · 计算机科学 2015-06-04 Ahmed G. M. ElSayed , Ahmed S. Salama , Alaa El-Din M. El-Ghazali

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the…

计算与语言 · 计算机科学 2023-12-11 Ke Wang , Jun Xie , Yuqi Zhang , Yu Zhao

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

计算与语言 · 计算机科学 2024-04-30 Charles Brazier , Jean-Luc Rouas

We propose a novel neural attention architecture to tackle machine comprehension tasks, such as answering Cloze-style queries with respect to a document. Unlike previous models, we do not collapse the query into a single vector, instead we…

计算与语言 · 计算机科学 2016-11-10 Alessandro Sordoni , Philip Bachman , Adam Trischler , Yoshua Bengio

The attentional mechanism has proven to be effective in improving end-to-end neural machine translation. However, due to the intricate structural divergence between natural languages, unidirectional attention-based models might only capture…

计算与语言 · 计算机科学 2016-04-25 Yong Cheng , Shiqi Shen , Zhongjun He , Wei He , Hua Wu , Maosong Sun , Yang Liu

Neural Machine Translation (NMT) systems are used in various applications. However, it has been shown that they are vulnerable to very small perturbations of their inputs, known as adversarial attacks. In this paper, we propose a new…

计算与语言 · 计算机科学 2023-03-03 Sahar Sadrizadeh , AmirHossein Dabiri Aghdam , Ljiljana Dolamic , Pascal Frossard

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

计算与语言 · 计算机科学 2018-12-19 Markus Freitag , Yaser Al-Onaizan

We present a three-pronged approach to improving Statistical Machine Translation (SMT), building on recent success in the application of neural networks to SMT. First, we propose new features based on neural networks to model various…

计算与语言 · 计算机科学 2015-06-03 Hendra Setiawan , Zhongqiang Huang , Jacob Devlin , Thomas Lamar , Rabih Zbib , Richard Schwartz , John Makhoul

Machine translation (MT) is a technique that leverages computers to translate human languages automatically. Nowadays, neural machine translation (NMT) which models direct mapping between source and target languages with deep neural…

计算与语言 · 计算机科学 2020-04-14 Jiajun Zhang , Chengqing Zong

Neural Machine Translation (NMT) has achieved notable success in recent years. Such a framework usually generates translations in isolation. In contrast, human translators often refer to reference data, either rephrasing the intricate…

计算与语言 · 计算机科学 2019-08-28 Han Fu , Chenghao Liu , Jianling Sun

In this paper, we study a new learning paradigm for Neural Machine Translation (NMT). Instead of maximizing the likelihood of the human translation as in previous works, we minimize the distinction between human translation and the…

计算与语言 · 计算机科学 2018-10-02 Lijun Wu , Yingce Xia , Li Zhao , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

For machine translation to tackle discourse phenomena, models must have access to extra-sentential linguistic context. There has been recent interest in modelling context in neural machine translation (NMT), but models have been principally…

计算与语言 · 计算机科学 2018-04-23 Rachel Bawden , Rico Sennrich , Alexandra Birch , Barry Haddow