English
Related papers

Related papers: Evaluating Machine Translation Datasets for Low-We…

200 papers

Neural machine translation (NMT) for low-resource local languages in Indonesia faces significant challenges, including the need for a representative benchmark and limited data availability. This work addresses these challenges by…

Computation and Language · Computer Science 2023-11-03 Lucky Susanto , Ryandito Diandaru , Adila Krisnadhi , Ayu Purwarianti , Derry Wijaya

Low-resource languages present unique challenges to (neural) machine translation. We discuss the case of Bambara, a Mande language for which training data is scarce and requires significant amounts of pre-processing. More than the…

Neural approaches have achieved state-of-the-art accuracy on machine translation but suffer from the high cost of collecting large scale parallel data. Thus, a lot of research has been conducted for neural machine translation (NMT) with…

Computation and Language · Computer Science 2021-07-12 Rui Wang , Xu Tan , Renqian Luo , Tao Qin , Tie-Yan Liu

The reliance on translated or adapted datasets from English or multilingual resources introduces challenges regarding linguistic and cultural suitability. This study addresses the need for robust and culturally appropriate benchmarks by…

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

Computation and Language · Computer Science 2017-08-22 Robert Östling , Jörg Tiedemann

Neural Machine Translation (NMT) has seen a tremendous spurt of growth in less than ten years, and has already entered a mature phase. While considered as the most widely used solution for Machine Translation, its performance on…

Computation and Language · Computer Science 2021-06-30 Surangika Ranathunga , En-Shiun Annie Lee , Marjana Prifti Skenduli , Ravi Shekhar , Mehreen Alam , Rishemjit Kaur

Transfer learning has led to large gains in performance for nearly all NLP tasks while making downstream models easier and faster to train. This has also been extended to low-resourced languages, with some success. We investigate the…

Computation and Language · Computer Science 2023-09-12 Michael Beukman , Manuel Fokam

Most social media users come from the Global South, where harmful content usually appears in local languages. Yet, AI-driven moderation systems struggle with low-resource languages spoken in these regions. Through semi-structured interviews…

Computation and Language · Computer Science 2025-08-06 Farhana Shahid , Mona Elswah , Aditya Vashistha

Multilingual transformer models like mBERT and XLM-RoBERTa have obtained great improvements for many NLP tasks on a variety of languages. However, recent works also showed that results from high-resource languages could not be easily…

Computation and Language · Computer Science 2020-10-08 Michael A. Hedderich , David Adelani , Dawei Zhu , Jesujoba Alabi , Udia Markus , Dietrich Klakow

Recent studies in the field of Machine Translation (MT) and Natural Language Processing (NLP) have shown that existing models amplify biases observed in the training data. The amplification of biases in language technology has mainly been…

Computation and Language · Computer Science 2021-02-02 Eva Vanmassenhove , Dimitar Shterionov , Matthew Gwilliam

Multilingual machine translation (MT) benchmarks play a central role in evaluating the capabilities of modern MT systems. Among them, the FLORES+ benchmark is widely used, offering English-to-many translation data for over 200 languages,…

Computation and Language · Computer Science 2025-08-29 Chihiro Taguchi , Seng Mai , Keita Kurabe , Yusuke Sakai , Georgina Agyei , Soudabeh Eslami , David Chiang

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, often requiring large amounts of auxiliary data to achieve competitive results. An effective method of generating auxiliary…

Computation and Language · Computer Science 2021-04-06 Lidia Kidane , Sachin Kumar , Yulia Tsvetkov

In this paper,we explore the application of Back translation (BT) as a semi-supervised technique to enhance Neural Machine Translation(NMT) models for the English-Luganda language pair, specifically addressing the challenges faced by…

Computation and Language · Computer Science 2025-05-06 Richard Kimera , Dongnyeong Heo , Daniela N. Rim , Heeyoul Choi

Large Language Models (LLMs) like GPT-4 and LLaMA have shown incredible proficiency at natural language processing tasks and have even begun to excel at tasks across other modalities such as vision and audio. Despite their success, LLMs…

Computation and Language · Computer Science 2024-03-12 Michael Andersland

Transformers have shown great promise as an approach to Neural Machine Translation (NMT) for low-resource languages. However, at the same time, transformer models remain difficult to optimize and require careful tuning of hyper-parameters…

Computation and Language · Computer Science 2020-04-16 Elan van Biljon , Arnu Pretorius , Julia Kreutzer

The landscape of extremely low-resource machine translation (MT) is characterized by perplexing variability in reported performance, often making results across different language pairs difficult to contextualize. For researchers focused on…

Computation and Language · Computer Science 2026-03-27 Danlu Chen , Ka Sing He , Jiahe Tian , Chenghao Xiao , Zhaofeng Wu , Taylor Berg-Kirkpatrick , Freda Shi

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, underperforming phrase-based statistical machine translation (PBSMT) and requiring large amounts of auxiliary data to…

Computation and Language · Computer Science 2019-05-29 Rico Sennrich , Biao Zhang

Machine translation in low-resource language pairs faces significant challenges due to the scarcity of parallel corpora and linguistic resources. This study focuses on the case of English-Marathi language pairs, where existing datasets are…

Computation and Language · Computer Science 2024-09-05 Nidhi Kowtal , Tejas Deshpande , Raviraj Joshi

With the advent of the Transformer architecture, Neural Machine Translation (NMT) results have shown great improvement lately. However, results in low-resource conditions still lag behind in both bilingual and multilingual setups, due to…

Computation and Language · Computer Science 2023-12-04 Isidora Chara Tourni , Derry Wijaya

Despite the recent popularity of Large Language Models (LLMs) in Machine Translation (MT), their performance in low-resource languages (LRLs) still lags significantly behind Neural Machine Translation (NMT) models. In this work, we explore…

Computation and Language · Computer Science 2024-10-07 Vivek Iyer , Bhavitvya Malik , Pavel Stepachev , Pinzhen Chen , Barry Haddow , Alexandra Birch