English
Related papers

Related papers: Balancing Training for Multilingual Neural Machine…

200 papers

While neural machine translation (NMT) has become the new paradigm, the parameter optimization requires large-scale parallel data which is scarce in many domains and language pairs. In this paper, we address a new translation scenario in…

Computation and Language · Computer Science 2017-11-06 Yining Wang , Yang Zhao , Jiajun Zhang , Chengqing Zong , Zhengshan Xue

Neural machine translation (NMT) systems amplify lexical biases present in their training data, leading to artificially impoverished language in output translations. These language-level characteristics render automatic translations…

Computation and Language · Computer Science 2025-06-02 Huiyuan Lai , Esther Ploeger , Rik van Noord , Antonio Toral

Recently, token-level adaptive training has achieved promising improvement in machine translation, where the cross-entropy loss function is adjusted by assigning different training weights to different tokens, in order to alleviate the…

Computation and Language · Computer Science 2021-05-28 Yangyifan Xu , Yijin Liu , Fandong Meng , Jiajun Zhang , Jinan Xu , Jie Zhou

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Although Neural Machine Translation (NMT) models have advanced state-of-the-art performance in machine translation, they face problems like the inadequate translation. We attribute this to that the standard Maximum Likelihood Estimation…

Computation and Language · Computer Science 2018-11-22 Xiang Kong , Zhaopeng Tu , Shuming Shi , Eduard Hovy , Tong Zhang

In this paper, we propose an effective way for biasing the attention mechanism of a sequence-to-sequence neural machine translation (NMT) model towards the well-studied statistical word alignment models. We show that our novel guided…

Computation and Language · Computer Science 2016-07-07 Wenhu Chen , Evgeny Matusov , Shahram Khadivi , Jan-Thorsten Peter

To mitigate the negative effect of low quality training data on the performance of neural machine translation models, most existing strategies focus on filtering out harmful data before training starts. In this paper, we explore strategies…

Computation and Language · Computer Science 2021-03-01 Xinyi Wang , Ankur Bapna , Melvin Johnson , Orhan Firat

Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation parallel data is an…

Computation and Language · Computer Science 2024-06-19 Shimao Zhang , Changjiang Gao , Wenhao Zhu , Jiajun Chen , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Shujian Huang

Existing neural machine translation (NMT) studies mainly focus on developing dataset-specific models based on data from different tasks (e.g., document translation and chat translation). Although the dataset-specific models have achieved…

Computation and Language · Computer Science 2023-05-19 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

We introduce negative space learning machine translation (NSL-MT), a training method for underresourced languages, that augments limited parallel data with synthetically generated violations of the target language's grammar and explicitly…

Machine Learning · Computer Science 2026-05-07 Mamadou K. Keita , Christopher Homan , Huy Le

While achieving state-of-the-art results in multiple tasks and languages, translation-based cross-lingual transfer is often overlooked in favour of massively multilingual pre-trained encoders. Arguably, this is due to its main limitations:…

Computation and Language · Computer Science 2021-07-26 Edoardo Maria Ponti , Julia Kreutzer , Ivan Vulić , Siva Reddy

Multilingual Neural Machine Translation (MNMT) trains a single NMT model that supports translation between multiple languages, rather than training separate models for different languages. Learning a single model can enhance the…

Computation and Language · Computer Science 2021-10-18 Fahimeh Saleh , Wray Buntine , Gholamreza Haffari , Lan Du

We present a three-pronged approach to improving Statistical Machine Translation (SMT), building on recent success in the application of neural networks to SMT. First, we propose new features based on neural networks to model various…

Computation and Language · Computer Science 2015-06-03 Hendra Setiawan , Zhongqiang Huang , Jacob Devlin , Thomas Lamar , Rabih Zbib , Richard Schwartz , John Makhoul

This paper demonstrates that multilingual pretraining and multilingual fine-tuning are both critical for facilitating cross-lingual transfer in zero-shot translation, where the neural machine translation (NMT) model is tested on source…

Computation and Language · Computer Science 2022-04-14 Guanhua Chen , Shuming Ma , Yun Chen , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

Neural machine translation benefits from semantically rich representations. Considerable progress in learning such representations has been achieved by language modelling and mutual information maximization objectives using contrastive…

Computation and Language · Computer Science 2024-01-09 Kshitij Ambilduke , Aneesh Shetye , Diksha Bagade , Rishika Bhagwatkar , Khurshed Fitter , Prasad Vagdargi , Shital Chiddarwar

Multilingual neural machine translation can translate unseen language pairs during training, i.e. zero-shot translation. However, the zero-shot translation is always unstable. Although prior works attributed the instability to the…

Computation and Language · Computer Science 2022-09-12 Zhi Qu , Taro Watanabe

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

Computation and Language · Computer Science 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

While multilingual training is now an essential ingredient in machine translation (MT) systems, recent work has demonstrated that it has different effects in different multilingual settings, such as many-to-one, one-to-many, and…

Computation and Language · Computer Science 2022-04-06 Ting-Rui Chiang , Yi-Pei Chen , Yi-Ting Yeh , Graham Neubig

Despite the growing variety of languages supported by existing multilingual neural machine translation (MNMT) models, most of the world's languages are still being left behind. We aim to extend large-scale MNMT models to incorporate a new…

Computation and Language · Computer Science 2025-12-02 Wen Lai , Viktor Hangya , Yingli Shen , Alexander Fraser

Machine Translation (MT) system generally aims at automatic representation of source language into target language retaining the originality of context using various Natural Language Processing (NLP) techniques. Among various NLP methods,…

Computation and Language · Computer Science 2026-03-04 Sudhansu Bala Das , Divyajoti Panda , Tapas Kumar Mishra , Bidyut Kr. Patra