English
Related papers

Related papers: Bilingual Dictionary-based Language Model Pretrain…

200 papers

We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of…

Computation and Language · Computer Science 2021-11-30 Garry Kuwanto , Afra Feyza Akyürek , Isidora Chara Tourni , Siyang Li , Alexander Gregory Jones , Derry Wijaya

We introduce negative space learning machine translation (NSL-MT), a training method for underresourced languages, that augments limited parallel data with synthetically generated violations of the target language's grammar and explicitly…

Machine Learning · Computer Science 2026-05-07 Mamadou K. Keita , Christopher Homan , Huy Le

Neural Machine Translation (NMT) has obtained state-of-the art performance for several language pairs, while only using parallel data for training. Target-side monolingual data plays an important role in boosting fluency for phrase-based…

Computation and Language · Computer Science 2016-06-06 Rico Sennrich , Barry Haddow , Alexandra Birch

Massively multilingual pre-trained language models (MMPLMs) are developed in recent years demonstrating superpowers and the pre-knowledge they acquire for downstream tasks. This work investigates whether MMPLMs can be applied to clinical…

Computation and Language · Computer Science 2023-06-06 Lifeng Han , Gleb Erofeev , Irina Sorokina , Serge Gladkoff , Goran Nenadic

Recently, token-level adaptive training has achieved promising improvement in machine translation, where the cross-entropy loss function is adjusted by assigning different training weights to different tokens, in order to alleviate the…

Computation and Language · Computer Science 2021-05-28 Yangyifan Xu , Yijin Liu , Fandong Meng , Jiajun Zhang , Jinan Xu , Jie Zhou

Language models based on deep neural networks have facilitated great advances in natural language processing and understanding tasks in recent years. While models covering a large number of languages have been introduced, their…

Computation and Language · Computer Science 2020-10-23 Li-Hsin Chang , Sampo Pyysalo , Jenna Kanerva , Filip Ginter

While recent advances in deep learning led to significant improvements in machine translation, neural machine translation is often still not able to continuously adapt to the environment. For humans, as well as for machine translation,…

Computation and Language · Computer Science 2021-02-15 Jan Niehues

Neural machine translation (NMT) has achieved great successes with large datasets, so NMT is more premised on high-resource languages. This continuously underpins the low resource languages such as Luganda due to the lack of high-quality…

Computation and Language · Computer Science 2023-01-10 Richard Kimera , Daniela N. Rim , Heeyoul Choi

Pre-trained multilingual language models show significant performance gains for zero-shot cross-lingual model transfer on a wide range of natural language understanding (NLU) tasks. Previously, for zero-shot cross-lingual evaluation,…

Computation and Language · Computer Science 2022-12-14 Lifu Tu , Caiming Xiong , Yingbo Zhou

Pretrained character-level and byte-level language models have been shown to be competitive with popular subword models across a range of Natural Language Processing (NLP) tasks. However, there has been little research on their…

Computation and Language · Computer Science 2024-05-24 Lukas Edman , Gabriele Sarti , Antonio Toral , Gertjan van Noord , Arianna Bisazza

Multilingual NMT has become an attractive solution for MT deployment in production. But to match bilingual quality, it comes at the cost of larger and slower models. In this work, we consider several ways to make multilingual NMT faster at…

Computation and Language · Computer Science 2021-11-09 Alexandre Berard , Dain Lee , Stéphane Clinchant , Kweonwoo Jung , Vassilina Nikoulina

Pretrained language models (PLMs) trained on large-scale unlabeled corpus are typically fine-tuned on task-specific downstream datasets, which have produced state-of-the-art results on various NLP tasks. However, the data discrepancy issue…

Computation and Language · Computer Science 2022-03-23 Jiali Zeng , Yufan Jiang , Shuangzhi Wu , Yongjing Yin , Mu Li

Intelligent selection of training data has proven a successful technique to simultaneously increase training efficiency and translation performance for phrase-based machine translation (PBMT). With the recent increase in popularity of…

Computation and Language · Computer Science 2017-08-03 Marlies van der Wees , Arianna Bisazza , Christof Monz

Applying Reinforcement learning (RL) following maximum likelihood estimation (MLE) pre-training is a versatile method for enhancing neural machine translation (NMT) performance. However, recent work has argued that the gains produced by RL…

Computation and Language · Computer Science 2022-10-07 Asaf Yehudai , Leshem Choshen , Lior Fox , Omri Abend

The fine-tuning of open-source large language models (LLMs) for machine translation has recently received considerable attention, marking a shift towards data-centric research from traditional neural machine translation. However, the area…

Computation and Language · Computer Science 2024-10-28 Yongjing Yin , Jiali Zeng , Yafu Li , Fandong Meng , Yue Zhang

Neural machine translation (NMT) is one of the best methods for understanding the differences in semantic rules between two languages. Especially for Indo-European languages, subword-level models have achieved impressive results. However,…

Computation and Language · Computer Science 2019-11-11 Wei Zhang , Feifei Lin , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

Trained on the large corpus, pre-trained language models (PLMs) can capture different levels of concepts in context and hence generate universal language representations. They can benefit multiple downstream natural language processing…

Computation and Language · Computer Science 2021-10-15 Nankai Lin , Yingwen Fu , Chuwei Chen , Ziyu Yang , Shengyi Jiang

Large language models (LLMs) have showcased profound capabilities in language understanding and generation, facilitating a wide array of applications. However, there is a notable paucity of detailed, open-sourced methodologies on…

As neural machine translation (NMT) is not easily amenable to explicit correction of errors, incorporating pre-specified translations into NMT is widely regarded as a non-trivial challenge. In this paper, we propose and explore three…

Computation and Language · Computer Science 2019-12-03 Tao Wang , Shaohui Kuang , Deyi Xiong , António Branco

Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarely or never seen in…

Computation and Language · Computer Science 2016-10-25 Jiajun Zhang , Chengqing Zong