中文
相关论文

相关论文: Exploiting Out-of-Domain Parallel Data through Mul…

200 篇论文

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

计算与语言 · 计算机科学 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

NMT systems trained on Pre-trained Multilingual Sequence-Sequence (PMSS) models flounder when sufficient amounts of parallel data is not available for fine-tuning. This specifically holds for languages missing/under-represented in these…

Adapter layers are lightweight, learnable units inserted between transformer layers. Recent work explores using such layers for neural machine translation (NMT), to adapt pre-trained models to new domains or language pairs, training only a…

计算与语言 · 计算机科学 2021-10-20 Asa Cooper Stickland , Alexandre Bérard , Vassilina Nikoulina

We introduce negative space learning machine translation (NSL-MT), a training method for underresourced languages, that augments limited parallel data with synthetically generated violations of the target language's grammar and explicitly…

机器学习 · 计算机科学 2026-05-07 Mamadou K. Keita , Christopher Homan , Huy Le

We present effective pre-training strategies for neural machine translation (NMT) using parallel corpora involving a pivot language, i.e., source-pivot and pivot-target, leading to a significant improvement in source-target translation. We…

计算与语言 · 计算机科学 2019-09-23 Yunsu Kim , Petre Petrov , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

Neural machine translation~(NMT) is ineffective for zero-resource languages. Recent works exploring the possibility of unsupervised neural machine translation (UNMT) with only monolingual data can achieve promising results. However, there…

计算与语言 · 计算机科学 2021-04-02 Mingxuan Wang , Hongxiao Bai , Hai Zhao , Lei Li

Large language models have significantly advanced Multilingual Machine Translation (MMT), yet scaling to many languages while keeping quality robust across directions remains challenging. In this paper, we identify a failure mode of…

An effective method to improve extremely low-resource neural machine translation is multilingual training, which can be improved by leveraging monolingual data to create synthetic bilingual corpora using the back-translation method. This…

计算与语言 · 计算机科学 2021-05-28 Maali Tars , Andre Tättar , Mark Fišel

Even with the latest developments in deep learning and large-scale language modeling, the task of machine translation (MT) of low-resource languages remains a challenge. Neural MT systems can be trained in an unsupervised way without any…

计算与语言 · 计算机科学 2023-10-24 Ivana Kvapilíková , Ondřej Bojar

In this paper, we focus on the domain-specific translation with low resources, where in-domain parallel corpora are scarce or nonexistent. One common and effective strategy for this case is exploiting in-domain monolingual data with the…

计算与语言 · 计算机科学 2020-10-07 Hao-Ran Wei , Zhirui Zhang , Boxing Chen , Weihua Luo

Neural machine translation (NMT) is a deep learning based approach for machine translation, which yields the state-of-the-art translation performance in scenarios where large-scale parallel corpora are available. Although the high-quality…

计算与语言 · 计算机科学 2018-06-04 Chenhui Chu , Rui Wang

Massively multilingual models for neural machine translation (NMT) are theoretically attractive, but often underperform bilingual models and deliver poor zero-shot translations. In this paper, we explore ways to improve them. We argue that…

计算与语言 · 计算机科学 2020-04-27 Biao Zhang , Philip Williams , Ivan Titov , Rico Sennrich

Previous studies on the domain adaptation for neural machine translation (NMT) mainly focus on the one-pass transferring out-of-domain translation knowledge to in-domain NMT model. In this paper, we argue that such a strategy fails to fully…

计算与语言 · 计算机科学 2019-12-17 Jiali Zeng , Yang Liu , Jinsong Su , Yubin Ge , Yaojie Lu , Yongjing Yin , Jiebo Luo

$k$-Nearest neighbor machine translation ($k$NN-MT) has attracted increasing attention due to its ability to non-parametrically adapt to new translation domains. By using an upstream NMT model to traverse the downstream training corpus, it…

计算与语言 · 计算机科学 2023-05-29 Zhiwei Cao , Baosong Yang , Huan Lin , Suhang Wu , Xiangpeng Wei , Dayiheng Liu , Jun Xie , Min Zhang , Jinsong Su

Neural Machine Translation (NMT) is a new approach for Machine Translation (MT), and due to its success, it has absorbed the attention of many researchers in the field. In this paper, we study NMT model on Persian-English language pairs, to…

计算与语言 · 计算机科学 2017-01-10 Mohaddeseh Bastan , Shahram Khadivi , Mohammad Mehdi Homayounpour

Multilingual neural machine translation (MNMT) trained in multiple language pairs has attracted considerable attention due to fewer model parameters and lower training costs by sharing knowledge among multiple languages. Nonetheless,…

计算与语言 · 计算机科学 2022-07-21 Jian Yang , Yuwei Yin , Shuming Ma , Dongdong Zhang , Zhoujun Li , Furu Wei

The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new…

计算与语言 · 计算机科学 2022-03-23 Danielle Saunders

Neural networks have demonstrated significant advancements in Neural Machine Translation (NMT) compared to conventional phrase-based approaches. However, Multilingual Neural Machine Translation (MNMT) in extremely low-resource settings…

计算与语言 · 计算机科学 2024-12-19 Vageesh Saxena , Sharid Loáiciga , Nils Rethmeier

Neural Machine Translation (NMT) has obtained state-of-the art performance for several language pairs, while only using parallel data for training. Target-side monolingual data plays an important role in boosting fluency for phrase-based…

计算与语言 · 计算机科学 2016-06-06 Rico Sennrich , Barry Haddow , Alexandra Birch

Neural machine translation is the current state-of-the-art in machine translation. Although it is successful in a resource-rich setting, its applicability for low-resource language pairs is still debatable. In this paper, we explore the…

计算与语言 · 计算机科学 2019-10-02 Aidar Valeev , Ilshat Gibadullin , Albina Khusainova , Adil Khan