中文
相关论文

相关论文: Dynamic Data Selection and Weighting for Iterative…

200 篇论文

Despite the known limitations, most machine translation systems today still operate on the sentence-level. One reason for this is, that most parallel training data is only sentence-level aligned, without document-level meta information…

计算与语言 · 计算机科学 2023-10-20 Frithjof Petrick , Christian Herold , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

In Neural Machine Translation (NMT), data augmentation methods such as back-translation have proven their effectiveness in improving translation performance. In this paper, we propose a novel data augmentation approach for NMT, which is…

计算与语言 · 计算机科学 2022-05-11 Chang Jin , Shigui Qiu , Nini Xiao , Hao Jia

In this paper, we propose an effective way for biasing the attention mechanism of a sequence-to-sequence neural machine translation (NMT) model towards the well-studied statistical word alignment models. We show that our novel guided…

计算与语言 · 计算机科学 2016-07-07 Wenhu Chen , Evgeny Matusov , Shahram Khadivi , Jan-Thorsten Peter

While back-translation is simple and effective in exploiting abundant monolingual corpora to improve low-resource neural machine translation (NMT), the synthetic bilingual corpora generated by NMT models trained on limited authentic…

计算与语言 · 计算机科学 2019-09-04 Shuo Wang , Yang Liu , Chao Wang , Huanbo Luan , Maosong Sun

We propose a method to transfer knowledge across neural machine translation (NMT) models by means of a shared dynamic vocabulary. Our approach allows to extend an initial model for a given language pair to cover new languages by adapting…

计算与语言 · 计算机科学 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Matteo Negri , Marcello Federico , Marco Turchi

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

计算与语言 · 计算机科学 2021-06-23 Junjie Hu , Graham Neubig

Self-training has proven effective for improving NMT performance by augmenting model training with synthetic parallel data. The common practice is to construct synthetic data based on a randomly sampled subset of large-scale monolingual…

计算与语言 · 计算机科学 2021-06-03 Wenxiang Jiao , Xing Wang , Zhaopeng Tu , Shuming Shi , Michael R. Lyu , Irwin King

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

计算与语言 · 计算机科学 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann

Conventional retrieval-augmented neural machine translation (RANMT) systems leverage bilingual corpora, e.g., translation memories (TMs). Yet, in many settings, monolingual corpora in the target language are often available. This work…

计算与语言 · 计算机科学 2025-10-02 Maxime Bouthors , Josep Crego , François Yvon

Traditional Neural machine translation (NMT) involves a fixed training procedure where each sentence is sampled once during each epoch. In reality, some sentences are well-learned during the initial few epochs; however, using this approach,…

计算与语言 · 计算机科学 2019-10-04 Rui Wang , Masao Utiyama , Eiichiro Sumita

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, often requiring large amounts of auxiliary data to achieve competitive results. An effective method of generating auxiliary…

计算与语言 · 计算机科学 2021-04-06 Lidia Kidane , Sachin Kumar , Yulia Tsvetkov

One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previously seen…

计算与语言 · 计算机科学 2018-04-10 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

计算与语言 · 计算机科学 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Most data selection research in machine translation focuses on improving a single domain. We perform data selection for multiple domains at once. This is achieved by carefully introducing instance-level domain-relevance features and…

计算与语言 · 计算机科学 2020-05-05 Wei Wang , Ye Tian , Jiquan Ngiam , Yinfei Yang , Isaac Caswell , Zarana Parekh

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

机器学习 · 计算机科学 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

In this paper,we explore the application of Back translation (BT) as a semi-supervised technique to enhance Neural Machine Translation(NMT) models for the English-Luganda language pair, specifically addressing the challenges faced by…

计算与语言 · 计算机科学 2025-05-06 Richard Kimera , Dongnyeong Heo , Daniela N. Rim , Heeyoul Choi

Language models (LMs) pretrained on a large text corpus and fine-tuned on a downstream text corpus and fine-tuned on a downstream task becomes a de facto training strategy for several natural language processing (NLP) tasks. Recently, an…

计算与语言 · 计算机科学 2021-07-23 Junghoon Lee , Jounghee Kim , Pilsung Kang

Even with the latest developments in deep learning and large-scale language modeling, the task of machine translation (MT) of low-resource languages remains a challenge. Neural MT systems can be trained in an unsupervised way without any…

计算与语言 · 计算机科学 2023-10-24 Ivana Kvapilíková , Ondřej Bojar

The overreliance on large parallel corpora significantly limits the applicability of machine translation systems to the majority of language pairs. Back-translation has been dominantly used in previous approaches for unsupervised neural…

计算与语言 · 计算机科学 2019-04-05 Jiawei Wu , Xin Wang , William Yang Wang

Noise and domain are important aspects of data quality for neural machine translation. Existing research focus separately on domain-data selection, clean-data selection, or their static combination, leaving the dynamic interaction across…

计算与语言 · 计算机科学 2019-06-05 Wei Wang , Isaac Caswell , Ciprian Chelba