English
Related papers

Related papers: Dynamic Past and Future for Neural Machine Transla…

200 papers

In Neural Machine Translation (NMT), each token prediction is conditioned on the source sentence and the target prefix (what has been previously translated at a decoding step). However, previous work on interpretability in NMT has mainly…

Computation and Language · Computer Science 2022-11-08 Javier Ferrando , Gerard I. Gállego , Belen Alastruey , Carlos Escolano , Marta R. Costa-jussà

We introduce Generative Neural Machine Translation (GNMT), a latent variable architecture which is designed to model the semantics of the source and target sentences. We modify an encoder-decoder translation model by adding a latent…

Computation and Language · Computer Science 2018-06-14 Harshil Shah , David Barber

Despite the growing variety of languages supported by existing multilingual neural machine translation (MNMT) models, most of the world's languages are still being left behind. We aim to extend large-scale MNMT models to incorporate a new…

Computation and Language · Computer Science 2025-12-02 Wen Lai , Viktor Hangya , Yingli Shen , Alexander Fraser

Neural machine translation (NMT) is a deep learning based approach for machine translation, which yields the state-of-the-art translation performance in scenarios where large-scale parallel corpora are available. Although the high-quality…

Computation and Language · Computer Science 2018-06-04 Chenhui Chu , Rui Wang

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

A neural multimodal machine translation (MMT) system is one that aims to perform better translation by extending conventional text-only translation models with multimodal information. Many recent studies report improvements when equipping…

Computation and Language · Computer Science 2021-06-01 Zhiyong Wu , Lingpeng Kong , Wei Bi , Xiang Li , Ben Kao

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Machine translation systems are very sensitive to the domains they were trained on. Several domain adaptation techniques have been deeply studied. We propose a new technique for neural machine translation (NMT) that we call domain control…

Computation and Language · Computer Science 2017-09-13 Catherine Kobus , Josep Crego , Jean Senellart

Neural Machine Translation (NMT) is a predominant machine translation technology nowadays because of its end-to-end trainable flexibility. However, NMT still struggles to translate properly in low-resource settings specifically on distant…

Computation and Language · Computer Science 2021-09-28 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal

While neural machine translation (NMT) has become the new paradigm, the parameter optimization requires large-scale parallel data which is scarce in many domains and language pairs. In this paper, we address a new translation scenario in…

Computation and Language · Computer Science 2017-11-06 Yining Wang , Yang Zhao , Jiajun Zhang , Chengqing Zong , Zhengshan Xue

In recent years, natural language processing (NLP) has got great development with deep learning techniques. In the sub-field of machine translation, a new approach named Neural Machine Translation (NMT) has emerged and got massive attention…

Computation and Language · Computer Science 2020-02-19 Shuoheng Yang , Yuxin Wang , Xiaowen Chu

With the advent of the Transformer architecture, Neural Machine Translation (NMT) results have shown great improvement lately. However, results in low-resource conditions still lag behind in both bilingual and multilingual setups, due to…

Computation and Language · Computer Science 2023-12-04 Isidora Chara Tourni , Derry Wijaya

In the encoder-decoder architecture for neural machine translation (NMT), the hidden states of the recurrent structures in the encoder and decoder carry the crucial information about the sentence.These vectors are generated by parameters…

Computation and Language · Computer Science 2017-08-08 Rongxiang Weng , Shujian Huang , Zaixiang Zheng , Xinyu Dai , Jiajun Chen

Simultaneous machine translation (SimulMT) speeds up the translation process by starting to translate before the source sentence is completely available. It is difficult due to limited context and word order difference between languages.…

Computation and Language · Computer Science 2022-05-05 Chih-Chiang Chang , Shun-Po Chuang , Hung-yi Lee

Recent work achieved remarkable results in training neural machine translation (NMT) systems in a fully unsupervised way, with new and dedicated architectures that rely on monolingual corpora only. In this work, we propose to define…

Computation and Language · Computer Science 2018-10-31 Benjamin Marie , Atsushi Fujita

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

Recently, neural machine translation has achieved remarkable progress by introducing well-designed deep neural networks into its encoder-decoder framework. From the optimization perspective, residual connections are adopted to improve…

Computation and Language · Computer Science 2018-07-03 Yanyao Shen , Xu Tan , Di He , Tao Qin , Tie-Yan Liu

Most modern neural machine translation (NMT) systems rely on presegmented inputs. Segmentation granularity importantly determines the input and output sequence lengths, hence the modeling depth, and source and target vocabularies, which in…

Computation and Language · Computer Science 2018-11-06 Julia Kreutzer , Artem Sokolov

Neural Machine Translation (NMT) generates target words sequentially in the way of predicting the next word conditioned on the context words. At training time, it predicts with the ground truth words as context while at inference it has to…

Computation and Language · Computer Science 2019-06-18 Wen Zhang , Yang Feng , Fandong Meng , Di You , Qun Liu