中文
相关论文

相关论文: Multilingual Non-Autoregressive Machine Translatio…

200 篇论文

Non-autoregressive machine translation (NAT) has recently made great progress. However, most works to date have focused on standard translation tasks, even though some edit-based NAT models, such as the Levenshtein Transformer (LevT), seem…

计算与语言 · 计算机科学 2023-02-21 Jitao Xu , Josep Crego , François Yvon

Unsupervised neural machine translation (UNMT) has recently achieved remarkable results for several language pairs. However, it can only translate between a single language pair and cannot produce translation results for multiple language…

计算与语言 · 计算机科学 2020-04-22 Haipeng Sun , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

计算与语言 · 计算机科学 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

A common scenario of Multilingual Neural Machine Translation (MNMT) is that each translation task arrives in a sequential manner, and the training data of previous tasks is unavailable. In this scenario, the current methods suffer heavily…

计算与语言 · 计算机科学 2022-12-07 Yang Zhao , Junnan Zhu , Lu Xiang , Jiajun Zhang , Yu Zhou , Feifei Zhai , Chengqing Zong

Past works on multimodal machine translation (MMT) elevate bilingual setup by incorporating additional aligned vision information. However, an image-must requirement of the multimodal dataset largely hinders MMT's development -- namely that…

计算与语言 · 计算机科学 2023-04-24 Ru Peng , Yawen Zeng , Junbo Zhao

Despite the fact that multilingual agreement (MA) has shown its importance for multilingual neural machine translation (MNMT), current methodologies in the field have two shortages: (i) require parallel data between multiple language pairs,…

计算与语言 · 计算机科学 2023-05-16 Hongyuan Lu , Haoyang Huang , Shuming Ma , Dongdong Zhang , Furu Wei , Wai Lam

Knowledge distillation (KD) is essential for training non-autoregressive translation (NAT) models by reducing the complexity of the raw data with an autoregressive teacher model. In this study, we empirically show that as a side effect of…

计算与语言 · 计算机科学 2021-01-28 Liang Ding , Longyue Wang , Xuebo Liu , Derek F. Wong , Dacheng Tao , Zhaopeng Tu

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

计算与语言 · 计算机科学 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee

We aim to better exploit the limited amounts of parallel text available in low-resource settings by introducing a differentiable reconstruction loss for neural machine translation (NMT). This loss compares original inputs to reconstructed…

计算与语言 · 计算机科学 2019-04-05 Xing Niu , Weijia Xu , Marine Carpuat

In recent years, Neural Machine Translation (NMT) has achieved notable results in various translation tasks. However, the word-by-word generation manner determined by the autoregressive mechanism leads to high translation latency of the NMT…

计算与语言 · 计算机科学 2021-09-02 Chenze Shao , Yang Feng , Jinchao Zhang , Fandong Meng , Jie Zhou

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

计算与语言 · 计算机科学 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

计算与语言 · 计算机科学 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

计算与语言 · 计算机科学 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Unsupervised neural machine translation (UNMT) has recently achieved remarkable results with only large monolingual corpora in each language. However, the uncertainty of associating target with source sentences makes UNMT theoretically an…

计算机视觉与模式识别 · 计算机科学 2019-05-28 Yuanhang Su , Kai Fan , Nguyen Bach , C. -C. Jay Kuo , Fei Huang

Massively multilingual models for neural machine translation (NMT) are theoretically attractive, but often underperform bilingual models and deliver poor zero-shot translations. In this paper, we explore ways to improve them. We argue that…

计算与语言 · 计算机科学 2020-04-27 Biao Zhang , Philip Williams , Ivan Titov , Rico Sennrich

Non-autoregressive neural machine translation (NAT) generates each target word in parallel and has achieved promising inference acceleration. However, existing NAT models still have a big gap in translation quality compared to…

计算与语言 · 计算机科学 2020-12-17 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

计算与语言 · 计算机科学 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

Multilingual machine translation (MMT) benefits from cross-lingual transfer but is a challenging multitask optimization problem. This is partly because there is no clear framework to systematically learn language-specific parameters.…

计算与语言 · 计算机科学 2023-02-13 Haoran Xu , Jean Maillard , Vedanuj Goswami

Machine translation (MT) is a technique that leverages computers to translate human languages automatically. Nowadays, neural machine translation (NMT) which models direct mapping between source and target languages with deep neural…

计算与语言 · 计算机科学 2020-04-14 Jiajun Zhang , Chengqing Zong

Multimodal machine translation (MMT) aims to improve translation quality by incorporating information from other modalities, such as vision. Previous MMT systems mainly focus on better access and use of visual information and tend to…

计算与语言 · 计算机科学 2023-09-06 Yaoming Zhu , Zewei Sun , Shanbo Cheng , Luyang Huang , Liwei Wu , Mingxuan Wang