English
Related papers

Related papers: One Sentence One Model for Neural Machine Translat…

200 papers

Neural machine translation models have shown to achieve high quality when trained and fed with well structured and punctuated input texts. Unfortunately, the latter condition is not met in spoken language translation, where the input is…

Computation and Language · Computer Science 2019-10-24 Mattia Antonino Di Gangi , Robert Enyedi , Alessandra Brusadin , Marcello Federico

Variational Neural Machine Translation (VNMT) is an attractive framework for modeling the generation of target translations, conditioned not only on the source sentence but also on some latent random variables. The latent variable modeling…

Computation and Language · Computer Science 2020-05-29 Hendra Setiawan , Matthias Sperber , Udhay Nallasamy , Matthias Paulik

Neural machine translation (NMT) models learn representations containing substantial linguistic information. However, it is not clear if such information is fully distributed or if some of it can be attributed to individual neurons. We…

Computation and Language · Computer Science 2018-11-06 Anthony Bau , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

Multi-source translation systems translate from multiple languages to a single target language. By using information from these multiple sources, these systems achieve large gains in accuracy. To train these systems, it is necessary to have…

Computation and Language · Computer Science 2018-11-09 Yuta Nishimura , Katsuhito Sudoh , Graham Neubig , Satoshi Nakamura

Machine translation systems are conventionally trained on textual resources that do not model phenomena that occur in spoken language. While the evaluation of neural machine translation systems on textual inputs is actively researched in…

Computation and Language · Computer Science 2019-04-26 Nicholas Ruiz , Mattia Antonino Di Gangi , Nicola Bertoldi , Marcello Federico

In this paper, we study a new learning paradigm for Neural Machine Translation (NMT). Instead of maximizing the likelihood of the human translation as in previous works, we minimize the distinction between human translation and the…

Computation and Language · Computer Science 2018-10-02 Lijun Wu , Yingce Xia , Li Zhao , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Without real bilingual corpus available, unsupervised Neural Machine Translation (NMT) typically requires pseudo parallel data generated with the back-translation method for the model training. However, due to weak supervision, the pseudo…

Computation and Language · Computer Science 2019-01-15 Shuo Ren , Zhirui Zhang , Shujie Liu , Ming Zhou , Shuai Ma

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Within the field of Statistical Machine Translation (SMT), the neural approach (NMT) has recently emerged as the first technology able to challenge the long-standing dominance of phrase-based approaches (PBMT). In particular, at the IWSLT…

Computation and Language · Computer Science 2016-10-11 Luisa Bentivogli , Arianna Bisazza , Mauro Cettolo , Marcello Federico

We present META-MT, a meta-learning approach to adapt Neural Machine Translation (NMT) systems in a few-shot setting. META-MT provides a new approach to make NMT models easily adaptable to many target domains with the minimal amount of…

Computation and Language · Computer Science 2020-04-07 Amr Sharaf , Hany Hassan , Hal Daumé

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

Text simplification aims at reducing the lexical, grammatical and structural complexity of a text while keeping the same meaning. In the context of machine translation, we introduce the idea of simplified translations in order to boost the…

Computation and Language · Computer Science 2016-12-20 Josep Crego , Jean Senellart

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

Computation and Language · Computer Science 2016-03-24 Jiwei Li , Dan Jurafsky

State-of-the-art Transformer-based neural machine translation (NMT) systems still follow a standard encoder-decoder framework, in which source sentence representation can be well done by an encoder with self-attention mechanism. Though…

Computation and Language · Computer Science 2019-12-30 Zuchao Li , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Zhuosheng Zhang , Hai Zhao

Neural machine translation (NMT) models typically operate with a fixed vocabulary, but translation is an open-vocabulary problem. Previous work addresses the translation of out-of-vocabulary words by backing off to a dictionary. In this…

Computation and Language · Computer Science 2016-06-13 Rico Sennrich , Barry Haddow , Alexandra Birch

Simultaneous neural machine translation(SNMT) models start emitting the target sequence before they have processed the source sequence. The recent adaptive policies for SNMT use monotonic attention to perform read/write decisions based on…

Computation and Language · Computer Science 2021-09-08 Mohd Abbas Zaidi , Sathish Indurthi , Beomseok Lee , Nikhil Kumar Lakumarapu , Sangha Kim

Recurrent neural networks (RNNs) have represented for years the state of the art in neural machine translation. Recently, new architectures have been proposed, which can leverage parallel computation on GPUs better than classical RNNs.…

Computation and Language · Computer Science 2018-05-14 Mattia Antonino Di Gangi , Marcello Federico

Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models…

Computation and Language · Computer Science 2021-04-08 Hassan S. Shavarani , Anoop Sarkar

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

Computation and Language · Computer Science 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Self-training has proven effective for improving NMT performance by augmenting model training with synthetic parallel data. The common practice is to construct synthetic data based on a randomly sampled subset of large-scale monolingual…

Computation and Language · Computer Science 2021-06-03 Wenxiang Jiao , Xing Wang , Zhaopeng Tu , Shuming Shi , Michael R. Lyu , Irwin King