English
Related papers

Related papers: High-Quality Data Augmentation for Low-Resource NM…

200 papers

Pivot-based neural machine translation (NMT) is commonly used in low-resource setups, especially for translation between non-English language pairs. It benefits from using high resource source-pivot and pivot-target language pairs and an…

Computation and Language · Computer Science 2021-09-28 Evgeniia Tokarchuk , Jan Rosendahl , Weiyue Wang , Pavel Petrushkov , Tomer Lancewicki , Shahram Khadivi , Hermann Ney

We aim to better exploit the limited amounts of parallel text available in low-resource settings by introducing a differentiable reconstruction loss for neural machine translation (NMT). This loss compares original inputs to reconstructed…

Computation and Language · Computer Science 2019-04-05 Xing Niu , Weijia Xu , Marine Carpuat

While end-to-end neural machine translation (NMT) has made remarkable progress recently, it still suffers from the data scarcity problem for low-resource language pairs and domains. In this paper, we propose a method for zero-resource NMT…

Computation and Language · Computer Science 2017-05-03 Yun Chen , Yang Liu , Yong Cheng , Victor O. K. Li

Recent advances in neural methods have led to substantial improvement in the quality of Neural Machine Translation (NMT) systems. However, these systems frequently produce translations with inaccurate gender (Stanovsky et al., 2019), which…

Computation and Language · Computer Science 2023-11-29 Ranjita Naik , Spencer Rarrick , Vishal Chowdhary

Neural Machine Translation (NMT) has been proven to achieve impressive results. The NMT system translation results depend strongly on the size and quality of parallel corpora. Nevertheless, for many language pairs, no rich-resource parallel…

Computation and Language · Computer Science 2019-05-23 Jinyi Zhang , Tadahiro Matsumoto

In Neural Machine Translation (NMT), data augmentation methods such as back-translation have proven their effectiveness in improving translation performance. In this paper, we propose a novel data augmentation approach for NMT, which is…

Computation and Language · Computer Science 2022-05-11 Chang Jin , Shigui Qiu , Nini Xiao , Hao Jia

We propose a neural machine translation (NMT) approach that, instead of pursuing adequacy and fluency ("human-oriented" quality criteria), aims to generate translations that are best suited as input to a natural language processing…

Computation and Language · Computer Science 2019-10-02 Amirhossein Tebbifakhr , Luisa Bentivogli , Matteo Negri , Marco Turchi

Retrieval-augmented Neural Machine Translation models have been successful in many translation scenarios. Different from previous works that make use of mutually similar but redundant translation memories~(TMs), we propose a new…

Computation and Language · Computer Science 2022-12-07 Xin Cheng , Shen Gao , Lemao Liu , Dongyan Zhao , Rui Yan

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

Computation and Language · Computer Science 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

Even with the latest developments in deep learning and large-scale language modeling, the task of machine translation (MT) of low-resource languages remains a challenge. Neural MT systems can be trained in an unsupervised way without any…

Computation and Language · Computer Science 2023-10-24 Ivana Kvapilíková , Ondřej Bojar

In this paper, we study a new learning paradigm for Neural Machine Translation (NMT). Instead of maximizing the likelihood of the human translation as in previous works, we minimize the distinction between human translation and the…

Computation and Language · Computer Science 2018-10-02 Lijun Wu , Yingce Xia , Li Zhao , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Numerous domain-specific machine learning tasks struggle with data scarcity and class imbalance. This paper systematically explores data augmentation methods for NLP, particularly through large language models like GPT. The purpose of this…

Computation and Language · Computer Science 2025-07-22 Łukasz Radliński , Mateusz Guściora , Jan Kocoń

Low-resource indigenous languages often lack the parallel corpora required for effective neural machine translation (NMT). Synthetic data generation offers a practical strategy for mitigating this limitation in data-scarce settings. In this…

Computation and Language · Computer Science 2026-05-21 Aashish Dhawan , Christopher Driggers-Ellis , Christan Grant , Daisy Zhe Wang

While neural networks have been used extensively to make substantial progress in the machine translation task, they are known for being heavily dependent on the availability of large amounts of training data. Recent efforts have tried to…

Computation and Language · Computer Science 2019-02-26 Diego Moussallem , Mihael Arčan , Axel-Cyrille Ngonga Ngomo , Paul Buitelaar

Unsupervised neural machine translation (NMT) is a recently proposed approach for machine translation which aims to train the model without using any labeled data. The models proposed for unsupervised NMT often use only one shared encoder…

Computation and Language · Computer Science 2018-04-25 Zhen Yang , Wei Chen , Feng Wang , Bo Xu

Back translation (BT) is one of the most significant technologies in NMT research fields. Existing attempts on BT share a common characteristic: they employ either beam search or random sampling to generate synthetic data with a backward…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Yubin Ruan , Wei Bi , Guoping Huang , Shuming Shi , Lihui Chen , Lemao Liu

The principal task in supervised neural machine translation (NMT) is to learn to generate target sentences conditioned on the source inputs from a set of parallel sentence pairs, and thus produce a model capable of generalizing to unseen…

Computation and Language · Computer Science 2022-04-15 Xiangpeng Wei , Heng Yu , Yue Hu , Rongxiang Weng , Weihua Luo , Jun Xie , Rong Jin

Back-translation is a critical component of Unsupervised Neural Machine Translation (UNMT), which generates pseudo parallel data from target monolingual data. A UNMT model is trained on the pseudo parallel data with translated source, and…

Computation and Language · Computer Science 2022-03-24 Zhiwei He , Xing Wang , Rui Wang , Shuming Shi , Zhaopeng Tu

Machine translation systems for high resource languages perform exceptionally well and produce high quality translations. Unfortunately, the vast majority of languages are not considered high resource and lack the quantity of parallel…

Computation and Language · Computer Science 2024-10-22 Jonathan Hus , Antonios Anastasopoulos

When the amount of parallel sentences available to train a neural machine translation is scarce, a common practice is to generate new synthetic training samples from them. A number of approaches have been proposed to produce synthetic…

Computation and Language · Computer Science 2024-01-30 Víctor M. Sánchez-Cartagena , Miquel Esplà-Gomis , Juan Antonio Pérez-Ortiz , Felipe Sánchez-Martínez