中文
相关论文

相关论文: Transfer Learning for Low-Resource Neural Machine …

200 篇论文

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

计算与语言 · 计算机科学 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

Neural machine translation (NMT) has significantly improved the quality of automatic translation models. One of the main challenges in current systems is the translation of rare words. We present a generic approach to address this weakness…

计算与语言 · 计算机科学 2018-09-11 Ngoc-Quan Pham , Jan Niehues , Alex Waibel

Machine Translation System (MTS) serves as an effective tool for communication by translating text or speech from one language to another language. The need of an efficient translation system becomes obvious in a large multilingual…

计算与语言 · 计算机科学 2024-03-18 Sudhansu Bala Das , Atharv Biradar , Tapas Kumar Mishra , Bidyut Kumar Patra

This paper demonstrates that multilingual pretraining and multilingual fine-tuning are both critical for facilitating cross-lingual transfer in zero-shot translation, where the neural machine translation (NMT) model is tested on source…

计算与语言 · 计算机科学 2022-04-14 Guanhua Chen , Shuming Ma , Yun Chen , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

Transferring representations from large supervised tasks to downstream tasks has shown promising results in AI fields such as Computer Vision and Natural Language Processing (NLP). In parallel, the recent progress in Machine Translation…

计算与语言 · 计算机科学 2018-09-14 Akiko Eriguchi , Melvin Johnson , Orhan Firat , Hideto Kazawa , Wolfgang Macherey

Recent studies have shown effectiveness in using neural networks for Chinese word segmentation. However, these models rely on large-scale data and are less effective for low-resource datasets because of insufficient training data. We…

计算与语言 · 计算机科学 2017-09-15 Jingjing Xu , Xu Sun

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

计算与语言 · 计算机科学 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Pivot-based neural machine translation (NMT) is commonly used in low-resource setups, especially for translation between non-English language pairs. It benefits from using high resource source-pivot and pivot-target language pairs and an…

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

计算与语言 · 计算机科学 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

We investigate transfer learning based on pre-trained neural machine translation models to translate between (low-resource) similar languages. This work is part of our contribution to the WMT 2021 Similar Languages Translation Shared Task…

人工智能 · 计算机科学 2021-10-08 Ife Adebara , Muhammad Abdul-Mageed

Machine translation (MT) for low-resource languages such as Ge'ez, an ancient language that is no longer the native language of any community, faces challenges such as out-of-vocabulary words, domain mismatches, and lack of sufficient…

计算与语言 · 计算机科学 2024-04-16 Aman Kassahun Wassie

Neural networks have demonstrated significant advancements in Neural Machine Translation (NMT) compared to conventional phrase-based approaches. However, Multilingual Neural Machine Translation (MNMT) in extremely low-resource settings…

计算与语言 · 计算机科学 2024-12-19 Vageesh Saxena , Sharid Loáiciga , Nils Rethmeier

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

计算与语言 · 计算机科学 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

We introduce Generative Neural Machine Translation (GNMT), a latent variable architecture which is designed to model the semantics of the source and target sentences. We modify an encoder-decoder translation model by adding a latent…

计算与语言 · 计算机科学 2018-06-14 Harshil Shah , David Barber

Neural encoder-decoder models of machine translation have achieved impressive results, while learning linguistic knowledge of both the source and target languages in an implicit end-to-end manner. We propose a framework in which our model…

计算与语言 · 计算机科学 2018-04-26 Eliyahu Kiperwasser , Miguel Ballesteros

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

Multilingual Neural Machine Translation (MNMT) trains a single NMT model that supports translation between multiple languages, rather than training separate models for different languages. Learning a single model can enhance the…

计算与语言 · 计算机科学 2021-10-18 Fahimeh Saleh , Wray Buntine , Gholamreza Haffari , Lan Du

Neural Machine Translation (NMT) remains a formidable challenge, especially when dealing with low-resource languages. Pre-trained sequence-to-sequence (seq2seq) multi-lingual models, such as mBART-50, have demonstrated impressive…

计算与语言 · 计算机科学 2024-07-10 Aniruddha Roy , Pretam Ray , Ayush Maheshwari , Sudeshna Sarkar , Pawan Goyal

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation performance on low…

计算与语言 · 计算机科学 2019-11-13 Aditya Siddhant , Melvin Johnson , Henry Tsai , Naveen Arivazhagan , Jason Riesa , Ankur Bapna , Orhan Firat , Karthik Raman

With the recent developments in the field of Natural Language Processing, there has been a rise in the use of different architectures for Neural Machine Translation. Transformer architectures are used to achieve state-of-the-art accuracy,…

计算与语言 · 计算机科学 2021-11-30 Aditya Mandke , Onkar Litake , Dipali Kadam