中文
相关论文

相关论文: Memory-enhanced Decoder for Neural Machine Transla…

200 篇论文

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

计算与语言 · 计算机科学 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

计算与语言 · 计算机科学 2018-12-19 Markus Freitag , Yaser Al-Onaizan

The dominant neural machine translation (NMT) models apply unified attentional encoder-decoder neural networks for translation. Traditionally, the NMT decoders adopt recurrent neural networks (RNNs) to perform translation in a left-toright…

计算与语言 · 计算机科学 2018-02-06 Xiangwen Zhang , Jinsong Su , Yue Qin , Yang Liu , Rongrong Ji , Hongji Wang

In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixed-length vector representation, and the other decodes…

Recent years has witnessed dramatic progress of neural machine translation (NMT), however, the method of manually guiding the translation procedure remains to be better explored. Previous works proposed to handle such problem through…

计算与语言 · 计算机科学 2019-02-01 Ya Li , Xinyu Liu , Dan Liu , Xueqiang Zhang , Junhua Liu

Neural Machine Translation (NMT) can be improved by including document-level contextual information. For this purpose, we propose a hierarchical attention model to capture the context in a structured and dynamic manner. The model is…

计算与语言 · 计算机科学 2018-10-02 Lesly Miculicich , Dhananjay Ram , Nikolaos Pappas , James Henderson

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

计算与语言 · 计算机科学 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

Neural machine translation (NMT) has recently become popular in the field of machine translation. However, NMT suffers from the problem of repeating or missing words in the translation. To address this problem, Tu et al. (2017) proposed an…

计算与语言 · 计算机科学 2017-06-27 Yukio Matsumura , Takayuki Sato , Mamoru Komachi

In Neural Machine Translation (NMT), the decoder can capture the features of the entire prediction history with neural connections and representations. This means that partial hypotheses with different prefixes will be regarded differently…

计算与语言 · 计算机科学 2018-10-16 Zhisong Zhang , Rui Wang , Masao Utiyama , Eiichiro Sumita , Hai Zhao

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree…

计算与语言 · 计算机科学 2018-08-29 Xinyi Wang , Hieu Pham , Pengcheng Yin , Graham Neubig

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

计算与语言 · 计算机科学 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

Even though sequence-to-sequence neural machine translation (NMT) model have achieved state-of-art performance in the recent fewer years, but it is widely concerned that the recurrent neural network (RNN) units are very hard to capture the…

计算与语言 · 计算机科学 2018-05-28 Wen Zhang , Jiawei Hu , Yang Feng , Qun Liu

Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that…

计算与语言 · 计算机科学 2016-11-22 Zhaopeng Tu , Yang Liu , Lifeng Shang , Xiaohua Liu , Hang Li

In this paper, we try to understand neural machine translation (NMT) via simplifying NMT architectures and training encoder-free NMT models. In an encoder-free model, the sums of word embeddings and positional embeddings represent the…

计算与语言 · 计算机科学 2019-07-19 Gongbo Tang , Rico Sennrich , Joakim Nivre

While current state-of-the-art NMT models, such as RNN seq2seq and Transformers, possess a large number of parameters, they are still shallow in comparison to convolutional models used for both text and vision applications. In this work we…

计算与语言 · 计算机科学 2018-09-06 Ankur Bapna , Mia Xu Chen , Orhan Firat , Yuan Cao , Yonghui Wu

Syntax has been proven to be remarkably effective in neural machine translation (NMT). Previous models obtained syntax information from syntactic parsing tools and integrated it into NMT models to improve translation performance. In this…

计算与语言 · 计算机科学 2024-06-18 Yang Liu , Yuexian Hou

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

计算与语言 · 计算机科学 2024-04-30 Charles Brazier , Jean-Luc Rouas

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the recurrent networks…

计算与语言 · 计算机科学 2021-05-04 Ritam Mallick , Seba Susan , Vaibhaw Agrawal , Rizul Garg , Prateek Rawal

Recent evidence reveals that Neural Machine Translation (NMT) models with deeper neural networks can be more effective but are difficult to train. In this paper, we present a MultiScale Collaborative (MSC) framework to ease the training of…

计算与语言 · 计算机科学 2020-05-12 Xiangpeng Wei , Heng Yu , Yue Hu , Yue Zhang , Rongxiang Weng , Weihua Luo

Neural machine translation (NMT) typically adopts the encoder-decoder framework. A good understanding of the characteristics and functionalities of the encoder and decoder can help to explain the pros and cons of the framework, and design…

计算与语言 · 计算机科学 2019-08-20 Tianyu He , Xu Tan , Tao Qin