中文
相关论文

相关论文: Neural Machine Translation Training in a Multi-Dom…

200 篇论文

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

计算与语言 · 计算机科学 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

计算与语言 · 计算机科学 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of…

计算与语言 · 计算机科学 2016-01-07 Orhan Firat , Kyunghyun Cho , Yoshua Bengio

This paper proposes a novel method to inject custom terminology into neural machine translation at run time. Previous works have mainly proposed modifications to the decoding algorithm in order to constrain the output to include…

计算与语言 · 计算机科学 2019-06-26 Georgiana Dinu , Prashant Mathur , Marcello Federico , Yaser Al-Onaizan

We propose a neural machine translation architecture that models the surrounding text in addition to the source sentence. These models lead to better performance, both in terms of general translation quality and pronoun prediction, when…

机器学习 · 统计学 2017-04-19 Sebastien Jean , Stanislas Lauly , Orhan Firat , Kyunghyun Cho

Machine translation (MT) has benefited from using synthetic training data originating from translating monolingual corpora, a technique known as backtranslation. Combining backtranslated data from different sources has led to better results…

计算与语言 · 计算机科学 2020-05-04 Xabier Soto , Dimitar Shterionov , Alberto Poncelas , Andy Way

Accurate terminology translation is crucial for ensuring the practicality and reliability of neural machine translation (NMT) systems. To address this, lexically constrained NMT explores various methods to ensure pre-specified words and…

计算与语言 · 计算机科学 2021-08-13 Gyubok Lee , Seongjun Yang , Edward Choi

Translating in real-time, a.k.a. simultaneous translation, outputs translation words before the input sentence ends, which is a challenging problem for conventional machine translation methods. We propose a neural machine translation (NMT)…

计算与语言 · 计算机科学 2017-01-12 Jiatao Gu , Graham Neubig , Kyunghyun Cho , Victor O. K. Li

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

计算与语言 · 计算机科学 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Previous studies on the domain adaptation for neural machine translation (NMT) mainly focus on the one-pass transferring out-of-domain translation knowledge to in-domain NMT model. In this paper, we argue that such a strategy fails to fully…

计算与语言 · 计算机科学 2019-12-17 Jiali Zeng , Yang Liu , Jinsong Su , Yubin Ge , Yaojie Lu , Yongjing Yin , Jiebo Luo

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

机器学习 · 计算机科学 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Neural machine translation requires large amounts of parallel training text to learn a reasonable-quality translation model. This is particularly inconvenient for language pairs for which enough parallel text is not available. In this…

计算与语言 · 计算机科学 2018-05-14 Poorya Zaremoodi , Gholamreza Haffari

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

计算与语言 · 计算机科学 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

The effectiveness of Neural Machine Translation (NMT) models largely depends on the vocabulary used at training; small vocabularies can lead to out-of-vocabulary problems -- large ones, to memory issues. Subword (SW) tokenization has been…

计算与语言 · 计算机科学 2023-03-02 J. Pourmostafa Roshan Sharami , D. Shterionov , P. Spronck

Neural Machine Translation (NMT) models achieve state-of-the-art performance on many translation benchmarks. As an active research field in NMT, knowledge distillation is widely applied to enhance the model's performance by transferring…

计算与语言 · 计算机科学 2021-05-28 Fusheng Wang , Jianhao Yan , Fandong Meng , Jie Zhou

Neural machine translation often adopts the fine-tuning approach to adapt to specific domains. However, nonrestricted fine-tuning can easily degrade on the general domain and over-fit to the target domain. To mitigate the issue, we propose…

计算与语言 · 计算机科学 2021-03-29 Jianze Liang , Chengqi Zhao , Mingxuan Wang , Xipeng Qiu , Lei Li

The key challenge of multi-domain translation lies in simultaneously encoding both the general knowledge shared across domains and the particular knowledge distinctive to each domain in a unified model. Previous work shows that the standard…

计算与语言 · 计算机科学 2019-11-25 Yong Wang , Longyue Wang , Shuming Shi , Victor O. K. Li , Zhaopeng Tu

Meta-learning has been sufficiently validated to be beneficial for low-resource neural machine translation (NMT). However, we find that meta-trained NMT fails to improve the translation performance of the domain unseen at the meta-training…

计算与语言 · 计算机科学 2021-03-04 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

Most uses of machine learning today involve training a model from scratch for a particular task, or sometimes starting with a model pretrained on a related task and then fine-tuning on a downstream task. Both approaches offer limited…

机器学习 · 计算机科学 2022-05-26 Andrea Gesmundo , Jeff Dean

Weight-space model merging combines independently fine-tuned models without accessing original training data, offering a practical alternative to joint training. While merging succeeds in multitask settings, its behavior in multilingual…

计算与语言 · 计算机科学 2026-04-06 Baban Gain , Asif Ekbal , Trilok Nath Singh