English
Related papers

Related papers: Low-Resource Machine Translation Training Curricul…

200 papers

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

Neural Machine Translation (NMT) models are typically trained on heterogeneous data that are concatenated and randomly shuffled. However, not all of the training data are equally useful to the model. Curriculum training aims to present the…

Computation and Language · Computer Science 2022-03-29 Tasnim Mohiuddin , Philipp Koehn , Vishrav Chaudhary , James Cross , Shruti Bhosale , Shafiq Joty

Over the last few years two promising research directions in low-resource neural machine translation (NMT) have emerged. The first focuses on utilizing high-resource languages to improve the quality of low-resource languages via…

Computation and Language · Computer Science 2020-05-12 Aditya Siddhant , Ankur Bapna , Yuan Cao , Orhan Firat , Mia Chen , Sneha Kudugunta , Naveen Arivazhagan , Yonghui Wu

The advent of deep learning has led to a significant gain in machine translation. However, most of the studies required a large parallel dataset which is scarce and expensive to construct and even unavailable for some languages. This paper…

Computation and Language · Computer Science 2023-04-04 Viet H. Pham , Thang M. Pham , Giang Nguyen , Long Nguyen , Dien Dinh

The last decade has witnessed enormous improvements in science and technology, stimulating the growing demand for economic and cultural exchanges in various countries. Building a neural machine translation (NMT) system has become an urgent…

Computation and Language · Computer Science 2025-03-26 Bin Li , Yixuan Weng , Fei Xia , Hanjun Deng

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Multilingual NMT is a viable solution for translating low-resource languages (LRLs) when data from high-resource languages (HRLs) from the same language family is available. However, the training schedule, i.e. the order of presentation of…

Computation and Language · Computer Science 2025-06-03 Alexis Allemann , Àlex R. Atrio , Andrei Popescu-Belis

Neural Machine Translation (NMT) models have been effective on large bilingual datasets. However, the existing methods and techniques show that the model's performance is highly dependent on the number of examples in training data. For many…

Computation and Language · Computer Science 2022-06-10 Nalin Kumar , Deepak Kumar , Subhankar Mishra

Even with the latest developments in deep learning and large-scale language modeling, the task of machine translation (MT) of low-resource languages remains a challenge. Neural MT systems can be trained in an unsupervised way without any…

Computation and Language · Computer Science 2023-10-24 Ivana Kvapilíková , Ondřej Bojar

This paper proposes a novel multilingual multistage fine-tuning approach for low-resource neural machine translation (NMT), taking a challenging Japanese--Russian pair for benchmarking. Although there are many solutions for low-resource…

Computation and Language · Computer Science 2019-07-09 Aizhan Imankulova , Raj Dabre , Atsushi Fujita , Kenji Imamura

For most language combinations, parallel data is either scarce or simply unavailable. To address this, unsupervised machine translation (UMT) exploits large amounts of monolingual data by using synthetic data generation techniques such as…

Computation and Language · Computer Science 2021-07-20 Dana Ruiter , Dietrich Klakow , Josef van Genabith , Cristina España-Bonet

Despite impressive empirical successes of neural machine translation (NMT) on standard benchmarks, limited parallel data impedes the application of NMT models to many language pairs. Data augmentation methods such as back-translation make…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Xuezhe Ma , Junjie Hu , Graham Neubig

Numerous recent work on unsupervised machine translation (UMT) implies that competent unsupervised translations of low-resource and unrelated languages, such as Nepali or Sinhala, are only possible if the model is trained in a massive…

Computation and Language · Computer Science 2022-10-04 Xuan-Phi Nguyen , Shafiq Joty , Wu Kui , Ai Ti Aw

In the current machine translation (MT) landscape, the Transformer architecture stands out as the gold standard, especially for high-resource language pairs. This research delves into its efficacy for low-resource language pairs including…

Computation and Language · Computer Science 2024-03-05 Séamus Lankford

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

Computation and Language · Computer Science 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

Computation and Language · Computer Science 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

In this paper,we explore the application of Back translation (BT) as a semi-supervised technique to enhance Neural Machine Translation(NMT) models for the English-Luganda language pair, specifically addressing the challenges faced by…

Computation and Language · Computer Science 2025-05-06 Richard Kimera , Dongnyeong Heo , Daniela N. Rim , Heeyoul Choi

No-resource languages - those with minimal or no digital representation - pose unique challenges for machine translation (MT). Unlike low-resource languages, which rely on limited but existent corpora, no-resource languages often have fewer…

Computation and Language · Computer Science 2025-06-03 Madhavendra Thakur

Low-resource machine translation (MT) has gained increasing attention as parallel data from low-resource language communities is collected, but many approaches for improving low-resource MT remain underexplored. We investigate a…

Computation and Language · Computer Science 2026-03-19 Ahmed Attia , Alham Fikri Aji

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

Computation and Language · Computer Science 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann