English
Related papers

Related papers: OpenNMT: Open-source Toolkit for Neural Machine Tr…

200 papers

We introduce MT-LENS, a framework designed to evaluate Machine Translation (MT) systems across a variety of tasks, including translation quality, gender bias detection, added toxicity, and robustness to misspellings. While several toolkits…

Computation and Language · Computer Science 2024-12-17 Javier García Gilabert , Carlos Escolano , Audrey Mash , Xixian Liao , Maite Melero

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to…

Neural machine translation~(NMT) is ineffective for zero-resource languages. Recent works exploring the possibility of unsupervised neural machine translation (UNMT) with only monolingual data can achieve promising results. However, there…

Computation and Language · Computer Science 2021-04-02 Mingxuan Wang , Hongxiao Bai , Hai Zhao , Lei Li

Neural models have drastically advanced state of the art for machine translation (MT) between high-resource languages. Traditionally, these models rely on large amounts of training data, but many language pairs lack these resources.…

Computation and Language · Computer Science 2023-06-13 Manuel Mager , Rajat Bhatnagar , Graham Neubig , Ngoc Thang Vu , Katharina Kann

Neural Machine Translation (NMT) is resource intensive. We design a quantization procedure to compress NMT models better for devices with limited hardware capability. Because most neural network parameters are near zero, we employ…

Computation and Language · Computer Science 2019-09-23 Alham Fikri Aji , Kenneth Heafield

SGNMT is a decoding platform for machine translation which allows paring various modern neural models of translation with different kinds of constraints and symbolic models. In this paper, we describe three use cases in which SGNMT is…

Computation and Language · Computer Science 2018-03-21 Felix Stahlberg , Danielle Saunders , Gonzalo Iglesias , Bill Byrne

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

Computation and Language · Computer Science 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

Since the first online demonstration of Neural Machine Translation (NMT) by LISA, NMT development has recently moved from laboratory to production systems as demonstrated by several entities announcing roll-out of NMT engines to replace…

This tutorial introduces a new and powerful set of techniques variously called "neural machine translation" or "neural sequence-to-sequence models". These techniques have been used in a number of tasks regarding the handling of human…

Computation and Language · Computer Science 2017-03-07 Graham Neubig

In this paper, we describe a tool for debugging the output and attention weights of neural machine translation (NMT) systems and for improved estimations of confidence about the output based on the attention. The purpose of the tool is to…

Computation and Language · Computer Science 2018-08-09 Matīss Rikters

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

Computation and Language · Computer Science 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

We present MT-DNN, an open-source natural language understanding (NLU) toolkit that makes it easy for researchers and developers to train customized deep learning models. Built upon PyTorch and Transformers, MT-DNN is designed to facilitate…

Computation and Language · Computer Science 2020-05-19 Xiaodong Liu , Yu Wang , Jianshu Ji , Hao Cheng , Xueyun Zhu , Emmanuel Awa , Pengcheng He , Weizhu Chen , Hoifung Poon , Guihong Cao , Jianfeng Gao

The last decade has witnessed enormous improvements in science and technology, stimulating the growing demand for economic and cultural exchanges in various countries. Building a neural machine translation (NMT) system has become an urgent…

Computation and Language · Computer Science 2025-03-26 Bin Li , Yixuan Weng , Fei Xia , Hanjun Deng

We introduce Generative Neural Machine Translation (GNMT), a latent variable architecture which is designed to model the semantics of the source and target sentences. We modify an encoder-decoder translation model by adding a latent…

Computation and Language · Computer Science 2018-06-14 Harshil Shah , David Barber

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Derek F. Wong , Yikai Zhou , Lidia S. Chao , Haibo Zhang , Boxing Chen

Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models…

Computation and Language · Computer Science 2021-04-08 Hassan S. Shavarani , Anoop Sarkar

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

This paper describes SYSTRAN's systems submitted to the WMT 2017 shared news translation task for English-German, in both translation directions. Our systems are built using OpenNMT, an open-source neural machine translation system,…

Computation and Language · Computer Science 2017-09-13 Yongchao Deng , Jungi Kim , Guillaume Klein , Catherine Kobus , Natalia Segal , Christophe Servan , Bo Wang , Dakun Zhang , Josep Crego , Jean Senellart

Multilingual Neural Machine Translation (NMT) enables one model to serve all translation directions, including ones that are unseen during training, i.e. zero-shot translation. Despite being theoretically attractive, current models often…

Computation and Language · Computer Science 2022-01-20 Yilin Yang , Akiko Eriguchi , Alexandre Muzio , Prasad Tadepalli , Stefan Lee , Hany Hassan