English
Related papers

Related papers: Revisiting Low-Resource Neural Machine Translation…

200 papers

Unsupervised machine translation, which utilizes unpaired monolingual corpora as training data, has achieved comparable performance against supervised machine translation. However, it still suffers from data-scarce domains. To address this…

Computation and Language · Computer Science 2021-05-10 Cheonbok Park , Yunwon Tae , Taehee Kim , Soyoung Yang , Mohammad Azam Khan , Eunjeong Park , Jaegul Choo

Multilingual Neural Machine Translation (MNMT) for low-resource languages (LRL) can be enhanced by the presence of related high-resource languages (HRL), but the relatedness of HRL usually relies on predefined linguistic assumptions about…

Computation and Language · Computer Science 2019-10-31 Surafel M. Lakew , Alina Karakanta , Marcello Federico , Matteo Negri , Marco Turchi

Multilingual neural machine translation (MNMT) trained in multiple language pairs has attracted considerable attention due to fewer model parameters and lower training costs by sharing knowledge among multiple languages. Nonetheless,…

Computation and Language · Computer Science 2022-07-21 Jian Yang , Yuwei Yin , Shuming Ma , Dongdong Zhang , Zhoujun Li , Furu Wei

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

Computation and Language · Computer Science 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann

Neural Machine Translation (NMT) approaches employing monolingual data are showing steady improvements in resource rich conditions. However, evaluations using real-world low-resource languages still result in unsatisfactory performance.…

Computation and Language · Computer Science 2021-03-11 Surafel M. Lakew , Matteo Negri , Marco Turchi

To improve low-resource Neural Machine Translation (NMT) with multilingual corpora, training on the most related high-resource language only is often more effective than using all data available (Neubig and Hu, 2018). However, it is…

Computation and Language · Computer Science 2019-05-21 Xinyi Wang , Graham Neubig

While modern machine translation has relied on large parallel corpora, a recent line of work has managed to train Neural Machine Translation (NMT) systems from monolingual corpora only (Artetxe et al., 2018c; Lample et al., 2018). Despite…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

In this paper,we explore the application of Back translation (BT) as a semi-supervised technique to enhance Neural Machine Translation(NMT) models for the English-Luganda language pair, specifically addressing the challenges faced by…

Computation and Language · Computer Science 2025-05-06 Richard Kimera , Dongnyeong Heo , Daniela N. Rim , Heeyoul Choi

We aim to better exploit the limited amounts of parallel text available in low-resource settings by introducing a differentiable reconstruction loss for neural machine translation (NMT). This loss compares original inputs to reconstructed…

Computation and Language · Computer Science 2019-04-05 Xing Niu , Weijia Xu , Marine Carpuat

Prior works have demonstrated that a low-resource language pair can benefit from multilingual machine translation (MT) systems, which rely on many language pairs' joint training. This paper proposes two simple strategies to address the rare…

Computation and Language · Computer Science 2021-07-13 Thi-Vinh Ngo , Phuong-Thai Nguyen , Thanh-Le Ha , Khac-Quy Dinh , Le-Minh Nguyen

In the current machine translation (MT) landscape, the Transformer architecture stands out as the gold standard, especially for high-resource language pairs. This research delves into its efficacy for low-resource language pairs including…

Computation and Language · Computer Science 2024-03-05 Séamus Lankford

We aim to investigate the performance of current OCR systems on low resource languages and low resource scripts. We introduce and make publicly available a novel benchmark, OCR4MT, consisting of real and synthetic data, enriched with noise,…

Computation and Language · Computer Science 2022-03-15 Oana Ignat , Jean Maillard , Vishrav Chaudhary , Francisco Guzmán

LLMs are predominantly trained on English data, which leads to a significant drop in performance on low-resource languages. Understanding how LLMs handle these languages is crucial for improving their effectiveness. This study focuses on…

Computation and Language · Computer Science 2025-02-04 Taaha Saleem Bajwa

While Transformer-based neural machine translation (NMT) is very effective in high-resource settings, many languages lack the necessary large parallel corpora to benefit from it. In the context of low-resource (LR) MT between two…

Computation and Language · Computer Science 2024-06-19 Niyati Bafna , Philipp Koehn , David Yarowsky

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Linguistic resources such as part-of-speech (POS) tags have been extensively used in statistical machine translation (SMT) frameworks and have yielded better performances. However, usage of such linguistic annotations in neural machine…

Computation and Language · Computer Science 2017-08-04 Jan Niehues , Eunah Cho

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Although neural machine translation (NMT) has achieved impressive progress recently, it is usually trained on the clean parallel data set and hence cannot work well when the input sentence is the production of the automatic speech…

Computation and Language · Computer Science 2018-11-05 Xiang Li , Haiyang Xue , Wei Chen , Yang Liu , Yang Feng , Qun Liu

Despite the recent popularity of Large Language Models (LLMs) in Machine Translation (MT), their performance in low-resource languages (LRLs) still lags significantly behind Neural Machine Translation (NMT) models. In this work, we explore…

Computation and Language · Computer Science 2024-10-07 Vivek Iyer , Bhavitvya Malik , Pavel Stepachev , Pinzhen Chen , Barry Haddow , Alexandra Birch

Machine translation (MT) has benefited from using synthetic training data originating from translating monolingual corpora, a technique known as backtranslation. Combining backtranslated data from different sources has led to better results…

Computation and Language · Computer Science 2020-05-04 Xabier Soto , Dimitar Shterionov , Alberto Poncelas , Andy Way