中文
相关论文

相关论文: Memory-enhanced Decoder for Neural Machine Transla…

200 篇论文

The advent of the attention mechanism in neural machine translation models has improved the performance of machine translation systems by enabling selective lookup into the source sentence. In this paper, the efficiencies of translation…

计算与语言 · 计算机科学 2017-01-10 Krupakar Hans , R S Milton

Neural machine translation (NMT) has recently achieved impressive results. A potential problem of the existing NMT algorithm, however, is that the decoding is conducted from left to right, without considering the right context. This paper…

计算与语言 · 计算机科学 2017-10-06 Aodong Li , Shiyue Zhang , Dong Wang , Thomas Fang Zheng

Recent work in multilingual translation advances translation quality surpassing bilingual baselines using deep transformer models with increased capacity. However, the extra latency and memory costs introduced by this approach may make it…

计算与语言 · 计算机科学 2022-06-07 Xiang Kong , Adithya Renduchintala , James Cross , Yuqing Tang , Jiatao Gu , Xian Li

A great proportion of sequence-to-sequence (Seq2Seq) models for Neural Machine Translation (NMT) adopt Recurrent Neural Network (RNN) to generate translation word by word following a sequential order. As the studies of linguistics have…

计算与语言 · 计算机科学 2018-06-14 Junyang Lin , Xu Sun , Xuancheng Ren , Shuming Ma , Jinsong Su , Qi Su

Named-entity recognition (NER) detects texts with predefined semantic labels and is an essential building block for natural language processing (NLP). Notably, recent NER research focuses on utilizing massive extra data, including…

计算与语言 · 计算机科学 2023-05-09 Yuxiang Zhang , Junjie Wang , Xinyu Zhu , Tetsuya Sakai , Hayato Yamana

In recent years, several studies on neural machine translation (NMT) have attempted to use document-level context by using a multi-encoder and two attention mechanisms to read the current and previous sentences to incorporate the context of…

计算与语言 · 计算机科学 2019-09-04 Hayahide Yamagishi , Mamoru Komachi

Neural Machine Translation (NMT) models are strong enough to convey semantic and syntactic information from the source language to the target language. However, these models are suffering from the need for a large amount of data to learn…

计算与语言 · 计算机科学 2023-01-13 Mohaddeseh Bastan , Shahram Khadivi

Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating into morphologically…

计算与语言 · 计算机科学 2019-06-20 Adithya Renduchintala , Pamela Shapiro , Kevin Duh , Philipp Koehn

Neural encoder-decoder models of machine translation have achieved impressive results, while learning linguistic knowledge of both the source and target languages in an implicit end-to-end manner. We propose a framework in which our model…

计算与语言 · 计算机科学 2018-04-26 Eliyahu Kiperwasser , Miguel Ballesteros

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

计算与语言 · 计算机科学 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a…

计算与语言 · 计算机科学 2017-04-25 Akiko Eriguchi , Yoshimasa Tsuruoka , Kyunghyun Cho

Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length…

计算与语言 · 计算机科学 2014-10-08 Kyunghyun Cho , Bart van Merrienboer , Dzmitry Bahdanau , Yoshua Bengio

Neural Machine Translation (NMT) has become a popular technology in recent years, and the encoder-decoder framework is the mainstream among all the methods. It's obvious that the quality of the semantic representations from encoding is very…

计算与语言 · 计算机科学 2020-01-15 Boyuan Pan , Yazheng Yang , Zhou Zhao , Yueting Zhuang , Deng Cai

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

计算与语言 · 计算机科学 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

Compared to traditional statistical machine translation (SMT), neural machine translation (NMT) often sacrifices adequacy for the sake of fluency. We propose a method to combine the advantages of traditional SMT and NMT by exploiting an…

计算与语言 · 计算机科学 2017-11-02 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

Self-supervised pre-training of text representations has been successfully applied to low-resource Neural Machine Translation (NMT). However, it usually fails to achieve notable gains on resource-rich NMT. In this paper, we propose a joint…

计算与语言 · 计算机科学 2021-06-09 Yong Cheng , Wei Wang , Lu Jiang , Wolfgang Macherey

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

计算与语言 · 计算机科学 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e.g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding in the opposite…

计算与语言 · 计算机科学 2019-09-04 Tianchi Bi , Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

End-to-end neural machine translation has overtaken statistical machine translation in terms of translation quality for some language pairs, specially those with large amounts of parallel data. Besides this palpable improvement, neural…

计算与语言 · 计算机科学 2017-11-16 Cristina España-Bonet , Ádám Csaba Varga , Alberto Barrón-Cedeño , Josef van Genabith

Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models…

计算与语言 · 计算机科学 2021-04-08 Hassan S. Shavarani , Anoop Sarkar