English
Related papers

Related papers: Improving Statistical Machine Translation for a Re…

200 papers

Manually annotated corpora for low-resource languages are usually small in quantity (gold), or large but distantly supervised (silver). Inspired by recent progress of injecting pre-trained language model (LM) on many Natural Language…

Computation and Language · Computer Science 2026-05-01 Fariz Ikhwantri

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

Computation and Language · Computer Science 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Language pairs with limited amounts of parallel data, also known as low-resource languages, remain a challenge for neural machine translation. While the Transformer model has achieved significant improvements for many language pairs and has…

Computation and Language · Computer Science 2020-11-05 Ali Araabi , Christof Monz

Large Language Models (LLMs) have demonstrated remarkable success across a wide range of tasks and domains. However, their performance in low-resource language translation, particularly when translating into these languages, remains…

Natural Language Processing (NLP) research has made great advancements in recent years with major breakthroughs that have established new benchmarks. However, these advances have mainly benefited a certain group of languages commonly…

Computation and Language · Computer Science 2023-05-02 Derguene Mbaye , Moussa Diallo , Thierno Ibrahima Diop

We tackle the task of automatically discriminating between human and machine translations. As opposed to most previous work, we perform experiments in a multilingual setting, considering multiple languages and multilingual pretrained…

Computation and Language · Computer Science 2023-06-01 Malina Chichirau , Rik van Noord , Antonio Toral

With the advent of Deep Learning based Artificial Neural Networks models, Natural Language Processing (NLP) has witnessed significant improvements in textual data processing in terms of its efficiency and accuracy. However, the research is…

Computation and Language · Computer Science 2023-10-05 Mubashir Munaf , Hammad Afzal , Naima Iltaf , Khawir Mahmood

Linguistic resources such as part-of-speech (POS) tags have been extensively used in statistical machine translation (SMT) frameworks and have yielded better performances. However, usage of such linguistic annotations in neural machine…

Computation and Language · Computer Science 2017-08-04 Jan Niehues , Eunah Cho

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

Multilingual neural machine translation (NMT) has recently been investigated from different aspects (e.g., pivot translation, zero-shot translation, fine-tuning, or training from scratch) and in different settings (e.g., rich resource and…

Computation and Language · Computer Science 2019-12-30 Xu Tan , Yichong Leng , Jiale Chen , Yi Ren , Tao Qin , Tie-Yan Liu

We participated in the WMT 2022 Large-Scale Machine Translation Evaluation for the African Languages Shared Task. This work describes our approach, which is based on filtering the given noisy data using a sentence-pair classifier that was…

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

What can pre-trained multilingual sequence-to-sequence models like mBART contribute to translating low-resource languages? We conduct a thorough empirical experiment in 10 languages to ascertain this, considering five factors: (1) the…

Self-training has proven effective for improving NMT performance by augmenting model training with synthetic parallel data. The common practice is to construct synthetic data based on a randomly sampled subset of large-scale monolingual…

Computation and Language · Computer Science 2021-06-03 Wenxiang Jiao , Xing Wang , Zhaopeng Tu , Shuming Shi , Michael R. Lyu , Irwin King

Extractive Reading Comprehension (ERC) has made tremendous advances enabled by the availability of large-scale high-quality ERC training data. Despite of such rapid progress and widespread application, the datasets in languages other than…

Computation and Language · Computer Science 2021-09-29 Gaochen Wu , Bin Xu , Yuxin Qin , Fei Kong , Bangchang Liu , Hongwen Zhao , Dejie Chang

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

Computation and Language · Computer Science 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann

Machine translation is the process of translating text from one language to another. In this paper, Statistical Machine Translation is done on Assamese and English language by taking their respective parallel corpus. A statistical phrase…

Computation and Language · Computer Science 2014-07-09 Kalyanee Kanchan Baruah , Pranjal Das , Abdul Hannan , Shikhar Kr. Sarma

The "massively-multilingual" training of multilingual models is known to limit their utility in any one language, and they perform particularly poorly on low-resource languages. However, there is evidence that low-resource languages can…

Computation and Language · Computer Science 2024-05-22 C. M. Downey , Terra Blevins , Dhwani Serai , Dwija Parikh , Shane Steinert-Threlkeld

In this work, we present an extensive study of statistical machine translation involving languages of the Indian subcontinent. These languages are related by genetic and contact relationships. We describe the similarities between Indic…

Computation and Language · Computer Science 2020-03-20 Anoop Kunchukuttan , Pushpak Bhattacharyya

Previous work has shown that for low-resource source languages, automatic speech-to-text translation (AST) can be improved by pretraining an end-to-end model on automatic speech recognition (ASR) data from a high-resource language. However,…

Computation and Language · Computer Science 2020-02-11 Mihaela C. Stoian , Sameer Bansal , Sharon Goldwater