中文
相关论文

相关论文: Zero-Resource Neural Machine Translation with Mult…

200 篇论文

Unsupervised neural machine translation (NMT) is a recently proposed approach for machine translation which aims to train the model without using any labeled data. The models proposed for unsupervised NMT often use only one shared encoder…

计算与语言 · 计算机科学 2018-04-25 Zhen Yang , Wei Chen , Feng Wang , Bo Xu

Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e.g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding in the opposite…

计算与语言 · 计算机科学 2019-09-04 Tianchi Bi , Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

计算与语言 · 计算机科学 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

This paper demonstrates that multilingual pretraining and multilingual fine-tuning are both critical for facilitating cross-lingual transfer in zero-shot translation, where the neural machine translation (NMT) model is tested on source…

计算与语言 · 计算机科学 2022-04-14 Guanhua Chen , Shuming Ma , Yun Chen , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

The data scarcity in low-resource languages has become a bottleneck to building robust neural machine translation systems. Fine-tuning a multilingual pre-trained model (e.g., mBART (Liu et al., 2020)) on the translation task is a good…

计算与语言 · 计算机科学 2021-05-11 Zihan Liu , Genta Indra Winata , Pascale Fung

We introduce an open-source toolkit for neural machine translation (NMT) to support research into model architectures, feature representations, and source modalities, while maintaining competitive performance, modularity and reasonable…

计算与语言 · 计算机科学 2017-09-13 Guillaume Klein , Yoon Kim , Yuntian Deng , Josep Crego , Jean Senellart , Alexander M. Rush

Although the multilingual Neural Machine Translation(NMT), which extends Google's multilingual NMT, has ability to perform zero-shot translation and the iterative self-learning algorithm can improve the quality of zero-shot translation, it…

计算与语言 · 计算机科学 2021-10-05 Chenyang Li , Gongxu Luo

Multilingual neural machine translation can translate unseen language pairs during training, i.e. zero-shot translation. However, the zero-shot translation is always unstable. Although prior works attributed the instability to the…

计算与语言 · 计算机科学 2022-09-12 Zhi Qu , Taro Watanabe

The multilingual neural machine translation (NMT) model has a promising capability of zero-shot translation, where it could directly translate between language pairs unseen during training. For good transfer performance from supervised…

计算与语言 · 计算机科学 2023-05-15 Pengzhi Gao , Liwen Zhang , Zhongjun He , Hua Wu , Haifeng Wang

We present effective pre-training strategies for neural machine translation (NMT) using parallel corpora involving a pivot language, i.e., source-pivot and pivot-target, leading to a significant improvement in source-target translation. We…

计算与语言 · 计算机科学 2019-09-23 Yunsu Kim , Petre Petrov , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

Existing multilingual neural machine translation (MNMT) approaches mainly focus on improving models with the encoder-decoder architecture to translate multiple languages. However, decoder-only architecture has been explored less in MNMT due…

计算与语言 · 计算机科学 2024-12-04 Zhi Qu , Yiran Wang , Chenchen Ding , Hideki Tanaka , Masao Utiyama , Taro Watanabe

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

计算与语言 · 计算机科学 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

计算与语言 · 计算机科学 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Multilingual neural machine translation has shown the capability of directly translating between language pairs unseen in training, i.e. zero-shot translation. Despite being conceptually attractive, it often suffers from low output quality.…

计算与语言 · 计算机科学 2021-07-02 Danni Liu , Jan Niehues , James Cross , Francisco Guzmán , Xian Li

Document-level neural machine translation (DocNMT) achieves coherent translations by incorporating cross-sentence context. However, for most language pairs there's a shortage of parallel documents, although parallel sentences are readily…

计算与语言 · 计算机科学 2022-05-18 Biao Zhang , Ankur Bapna , Melvin Johnson , Ali Dabirmoghaddam , Naveen Arivazhagan , Orhan Firat

Despite the success of neural machine translation (NMT), simultaneous neural machine translation (SNMT), the task of translating in real time before a full sentence has been observed, remains challenging due to the syntactic structure…

计算与语言 · 计算机科学 2020-10-06 Yun Chen , Liangyou Li , Xin Jiang , Xiao Chen , Qun Liu

Neural Machine Translation (NMT) is a predominant machine translation technology nowadays because of its end-to-end trainable flexibility. However, NMT still struggles to translate properly in low-resource settings specifically on distant…

计算与语言 · 计算机科学 2021-09-28 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal

Multilingual Neural Machine Translation approaches are based on the use of task-specific models and the addition of one more language can only be done by retraining the whole system. In this work, we propose a new training schedule that…

计算与语言 · 计算机科学 2019-07-12 Carlos Escolano , Marta R. Costa-Jussà , José A. R. Fonollosa

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

计算与语言 · 计算机科学 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

Perfect machine translation (MT) would render cross-lingual transfer (XLT) by means of multilingual language models (mLMs) superfluous. Given, on the one hand, the large body of work on improving XLT with mLMs and, on the other hand, recent…

计算与语言 · 计算机科学 2024-07-11 Benedikt Ebing , Goran Glavaš