English
Related papers

Related papers: Memory-enhanced Decoder for Neural Machine Transla…

200 papers

We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source…

Computation and Language · Computer Science 2018-08-30 Felix Stahlberg , Danielle Saunders , Bill Byrne

One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previously seen…

Computation and Language · Computer Science 2018-04-10 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-07-21 Zi Long , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

This paper demonstrates that word sense disambiguation (WSD) can improve neural machine translation (NMT) by widening the source context considered when modeling the senses of potentially ambiguous words. We first introduce three adaptive…

Computation and Language · Computer Science 2018-10-08 Xiao Pu , Nikolaos Pappas , James Henderson , Andrei Popescu-Belis

Neural machine translation (NMT) has been a new paradigm in machine translation, and the attention mechanism has become the dominant approach with the state-of-the-art records in many language pairs. While there are variants of the…

Computation and Language · Computer Science 2018-04-04 Heeyoul Choi , Kyunghyun Cho , Yoshua Bengio

Recently, word enhancement has become very popular for Chinese Named Entity Recognition (NER), reducing segmentation errors and increasing the semantic and boundary information of Chinese words. However, these methods tend to ignore the…

Computation and Language · Computer Science 2021-07-13 Shuang Wu , Xiaoning Song , Zhenhua Feng

Neural Machine Translation (NMT) is a new approach for Machine Translation (MT), and due to its success, it has absorbed the attention of many researchers in the field. In this paper, we study NMT model on Persian-English language pairs, to…

Computation and Language · Computer Science 2017-01-10 Mohaddeseh Bastan , Shahram Khadivi , Mohammad Mehdi Homayounpour

In this paper, we propose a robust neural machine translation (NMT) framework. The framework consists of a homophone noise detector and a syllable-aware NMT model to homophone errors. The detector identifies potential homophone errors in a…

Computation and Language · Computer Science 2020-12-16 Wenjie Qin , Xiang Li , Yuhui Sun , Deyi Xiong , Jianwei Cui , Bin Wang

In this paper, we propose Neural Phrase-to-Phrase Machine Translation (NP$^2$MT). Our model uses a phrase attention mechanism to discover relevant input (source) segments that are used by a decoder to generate output (target) phrases. We…

Computation and Language · Computer Science 2018-11-07 Jiangtao Feng , Lingpeng Kong , Po-Sen Huang , Chong Wang , Da Huang , Jiayuan Mao , Kan Qiao , Dengyong Zhou

We present Neural Machine Translation (NMT) training using document-level metrics with batch-level documents. Previous sequence-objective approaches to NMT training focus exclusively on sentence-level metrics like sentence BLEU which do not…

Computation and Language · Computer Science 2020-05-05 Danielle Saunders , Felix Stahlberg , Bill Byrne

We introduce $k$-nearest-neighbor machine translation ($k$NN-MT), which predicts tokens with a nearest neighbor classifier over a large datastore of cached examples, using representations from a neural translation model for similarity…

Computation and Language · Computer Science 2021-07-23 Urvashi Khandelwal , Angela Fan , Dan Jurafsky , Luke Zettlemoyer , Mike Lewis

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

The Neural Machine Translation (NMT) model is essentially a joint language model conditioned on both the source sentence and partial translation. Therefore, the NMT model naturally involves the mechanism of the Language Model (LM) that…

Computation and Language · Computer Science 2021-06-01 Mengqi Miao , Fandong Meng , Yijin Liu , Xiao-Hua Zhou , Jie Zhou

We present a three-pronged approach to improving Statistical Machine Translation (SMT), building on recent success in the application of neural networks to SMT. First, we propose new features based on neural networks to model various…

Computation and Language · Computer Science 2015-06-03 Hendra Setiawan , Zhongqiang Huang , Jacob Devlin , Thomas Lamar , Rabih Zbib , Richard Schwartz , John Makhoul

Neural Machine Translation (NMT) is widely applied in software engineering tasks. The effectiveness of NMT for code retrieval relies on the ability to learn from the sequence of tokens in the source language to the sequence of tokens in the…

Software Engineering · Computer Science 2023-08-10 Hung Phan , Ali Jannesari

Existing neural machine translation (NMT) models generally translate sentences in isolation, missing the opportunity to take advantage of document-level information. In this work, we propose to augment NMT models with a very light-weight…

Computation and Language · Computer Science 2017-11-28 Zhaopeng Tu , Yang Liu , Shuming Shi , Tong Zhang

We build a multi-source machine translation model and train it to maximize the probability of a target English string given French and German sources. Using the neural encoder-decoder framework, we explore several combination methods and…

Computation and Language · Computer Science 2016-01-06 Barret Zoph , Kevin Knight

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to…

Neural machine translation (NMT) is notoriously sensitive to noises, but noises are almost inevitable in practice. One special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. We…

Computation and Language · Computer Science 2019-06-05 Hairong Liu , Mingbo Ma , Liang Huang , Hao Xiong , Zhongjun He

Multilingual training of neural machine translation (NMT) systems has led to impressive accuracy improvements on low-resource languages. However, there are still significant challenges in efficiently learning word representations in the…

Computation and Language · Computer Science 2019-02-12 Xinyi Wang , Hieu Pham , Philip Arthur , Graham Neubig