English
Related papers

Related papers: Auto-Encoding Variational Neural Machine Translati…

200 papers

Word embedding is central to neural machine translation (NMT), which has attracted intensive research interest in recent years. In NMT, the source embedding plays the role of the entrance while the target embedding acts as the terminal.…

Computation and Language · Computer Science 2019-06-10 Xuebo Liu , Derek F. Wong , Yang Liu , Lidia S. Chao , Tong Xiao , Jingbo Zhu

Multilingual neural machine translation models are trained to maximize the likelihood of a mix of examples drawn from multiple language pairs. The dominant inductive bias applied to these models is a shared vocabulary and a shared set of…

Computation and Language · Computer Science 2022-03-16 Yong Cheng , Ankur Bapna , Orhan Firat , Yuan Cao , Pidong Wang , Wolfgang Macherey

The goal of universal machine translation is to learn to translate between any pair of languages, given a corpus of paired translated documents for \emph{a small subset} of all pairs of languages. Despite impressive empirical results and an…

Machine Learning · Computer Science 2020-08-12 Han Zhao , Junjie Hu , Andrej Risteski

Multilingual neural machine translation (NMT) has recently been investigated from different aspects (e.g., pivot translation, zero-shot translation, fine-tuning, or training from scratch) and in different settings (e.g., rich resource and…

Computation and Language · Computer Science 2019-12-30 Xu Tan , Yichong Leng , Jiale Chen , Yi Ren , Tao Qin , Tie-Yan Liu

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

Computation and Language · Computer Science 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

We propose an interactive-predictive neural machine translation framework for easier model personalization using reinforcement and imitation learning. During the interactive translation process, the user is asked for feedback on uncertain…

Computation and Language · Computer Science 2019-07-08 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length…

Computation and Language · Computer Science 2014-10-08 Kyunghyun Cho , Bart van Merrienboer , Dzmitry Bahdanau , Yoshua Bengio

Multilingual Neural Machine Translation (MNMT) enables one system to translate sentences from multiple source languages to multiple target languages, greatly reducing deployment costs compared with conventional bilingual systems. The MNMT…

Computation and Language · Computer Science 2022-07-01 Akiko Eriguchi , Shufang Xie , Tao Qin , Hany Hassan Awadalla

This paper presents a novel neural machine translation model which jointly learns translation and source-side latent graph representations of sentences. Unlike existing pipelined approaches using syntactic parsers, our end-to-end model…

Computation and Language · Computer Science 2017-07-25 Kazuma Hashimoto , Yoshimasa Tsuruoka

Multilingual semantic parsing is a cost-effective method that allows a single model to understand different languages. However, researchers face a great imbalance of availability of training data, with English being resource rich, and other…

Computation and Language · Computer Science 2021-06-15 Menglin Xia , Emilio Monti

Neural machine translation (NMT) has arguably achieved human level parity when trained and evaluated at the sentence-level. Document-level neural machine translation has received less attention and lags behind its sentence-level…

Computation and Language · Computer Science 2020-03-12 Elman Mansimov , Gábor Melis , Lei Yu

Recent work has shown how to learn better visual-semantic embeddings by leveraging image descriptions in more than one language. Here, we investigate in detail which conditions affect the performance of this type of grounded language…

Computation and Language · Computer Science 2018-09-21 Ákos Kádár , Desmond Elliott , Marc-Alexandre Côté , Grzegorz Chrupała , Afra Alishahi

In this paper, we improve the attention or alignment accuracy of neural machine translation by utilizing the alignments of training sentence pairs. We simply compute the distance between the machine attentions and the "true" alignments, and…

Computation and Language · Computer Science 2016-08-02 Haitao Mi , Zhiguo Wang , Abe Ittycheriah

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

Computation and Language · Computer Science 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

Multilingual Neural Machine Translation (NMT) models are capable of translating between multiple source and target languages. Despite various approaches to train such models, they have difficulty with zero-shot translation: translating…

Computation and Language · Computer Science 2019-03-19 Naveen Arivazhagan , Ankur Bapna , Orhan Firat , Roee Aharoni , Melvin Johnson , Wolfgang Macherey

We present an unsupervised word segmentation model, in which the learning objective is to maximize the generation probability of a sentence given its all possible segmentation. Such generation probability can be factorized into the…

Computation and Language · Computer Science 2021-03-03 Lihao Wang , Zongyi Li , Xiaoqing Zheng

Machine translation has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale parallel corpora. There have been numerous attempts to extend these successes to low-resource…

Computation and Language · Computer Science 2018-04-16 Guillaume Lample , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Simultaneous translation involves translating a sentence before the speaker's utterance is completed in order to realize real-time understanding in multiple languages. This task is significantly more challenging than the general full…

Computation and Language · Computer Science 2020-10-26 Aizhan Imankulova , Masahiro Kaneko , Tosho Hirasawa , Mamoru Komachi

Tying the weights of the target word embeddings with the target word classifiers of neural machine translation models leads to faster training and often to better translation quality. Given the success of this parameter sharing, we…

Computation and Language · Computer Science 2018-09-03 Nikolaos Pappas , Lesly Miculicich Werlen , James Henderson

As a sequence-to-sequence generation task, neural machine translation (NMT) naturally contains intrinsic uncertainty, where a single sentence in one language has multiple valid counterparts in the other. However, the dominant methods for…

Computation and Language · Computer Science 2020-10-12 Xiangpeng Wei , Heng Yu , Yue Hu , Rongxiang Weng , Luxi Xing , Weihua Luo