English
Related papers

Related papers: Exploring the Robustness of NMT Systems to Nonsens…

200 papers

We present META-MT, a meta-learning approach to adapt Neural Machine Translation (NMT) systems in a few-shot setting. META-MT provides a new approach to make NMT models easily adaptable to many target domains with the minimal amount of…

Computation and Language · Computer Science 2020-04-07 Amr Sharaf , Hany Hassan , Hal Daumé

The attention model has become a standard component in neural machine translation (NMT) and it guides translation process by selectively focusing on parts of the source sentence when predicting each target word. However, we find that the…

Computation and Language · Computer Science 2017-08-31 Long Zhou , Jiajun Zhang , Chengqing Zong

Machine translation systems are conventionally trained on textual resources that do not model phenomena that occur in spoken language. While the evaluation of neural machine translation systems on textual inputs is actively researched in…

Computation and Language · Computer Science 2019-04-26 Nicholas Ruiz , Mattia Antonino Di Gangi , Nicola Bertoldi , Marcello Federico

In recent years, several studies on neural machine translation (NMT) have attempted to use document-level context by using a multi-encoder and two attention mechanisms to read the current and previous sentences to incorporate the context of…

Computation and Language · Computer Science 2019-09-04 Hayahide Yamagishi , Mamoru Komachi

Neural Machine translation is a challenging task due to the inherent complex nature and the fluidity that natural languages bring. Nonetheless, in recent years, it has achieved state-of-the-art performance in several language pairs.…

Computation and Language · Computer Science 2023-04-19 Vakul Goyle , Parvathy Krishnaswamy , Kannan Girija Ravikumar , Utsa Chattopadhyay , Kartikay Goyle

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Lexical ambiguity is a significant and pervasive challenge in Neural Machine Translation (NMT), with many state-of-the-art (SOTA) NMT systems struggling to handle polysemous words (Campolungo et al., 2022). The same holds for the NMT…

Computation and Language · Computer Science 2023-10-24 Vivek Iyer , Edoardo Barba , Alexandra Birch , Jeff Z. Pan , Roberto Navigli

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages.…

Computation and Language · Computer Science 2021-04-20 Seiichiro Kondo , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

Auto-regressive sequence-to-sequence models with attention mechanisms have achieved state-of-the-art performance in various tasks including Text-To-Speech (TTS) and Neural Machine Translation (NMT). The standard training approach, teacher…

Computation and Language · Computer Science 2021-04-06 Qingyun Dou , Yiting Lu , Potsawee Manakul , Xixin Wu , Mark J. F. Gales

Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that…

Computation and Language · Computer Science 2016-11-22 Zhaopeng Tu , Yang Liu , Lifeng Shang , Xiaohua Liu , Hang Li

Neural machine translation (NMT) has been a new paradigm in machine translation, and the attention mechanism has become the dominant approach with the state-of-the-art records in many language pairs. While there are variants of the…

Computation and Language · Computer Science 2018-04-04 Heeyoul Choi , Kyunghyun Cho , Yoshua Bengio

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Neural Machine Translation (MT) has radically changed the way systems are developed. A major difference with the previous generation (Phrase-Based MT) is the way monolingual target data, which often abounds, is used in these two paradigms.…

Computation and Language · Computer Science 2019-03-28 Franck Burlot , François Yvon

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

Computation and Language · Computer Science 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

Neural machine translation (NMT) has recently achieved impressive results. A potential problem of the existing NMT algorithm, however, is that the decoding is conducted from left to right, without considering the right context. This paper…

Computation and Language · Computer Science 2017-10-06 Aodong Li , Shiyue Zhang , Dong Wang , Thomas Fang Zheng

In this work, we introduce instruction finetuning for Neural Machine Translation (NMT) models, which distills instruction following capabilities from Large Language Models (LLMs) into orders-of-magnitude smaller NMT models. Our…

Computation and Language · Computer Science 2024-10-10 Vikas Raunak , Roman Grundkiewicz , Marcin Junczys-Dowmunt

In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on…

Computation and Language · Computer Science 2017-07-25 Longyue Wang , Zhaopeng Tu , Andy Way , Qun Liu

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

Computation and Language · Computer Science 2016-03-24 Jiwei Li , Dan Jurafsky

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

Computation and Language · Computer Science 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

Neural Machine Translation (NMT) models are known to suffer from noisy inputs. To make models robust, we generate adversarial augmentation samples that attack the model and preserve the source-side semantic meaning at the same time. To…

Computation and Language · Computer Science 2021-10-13 Weiting Tan , Shuoyang Ding , Huda Khayrallah , Philipp Koehn
‹ Prev 1 3 4 5 6 7 10 Next ›