中文
相关论文

相关论文: Trivial Transfer Learning for Low-Resource Neural …

200 篇论文

Neural machine translation is known to require large numbers of parallel training sentences, which generally prevent it from excelling on low-resource language pairs. This thesis explores the use of cross-lingual transfer learning on neural…

计算与语言 · 计算机科学 2020-01-07 Tom Kocmi

Transfer learning from a high-resource language pair `parent' has been proven to be an effective way to improve neural machine translation quality for low-resource language pairs `children.' However, previous approaches build a custom…

计算与语言 · 计算机科学 2019-09-23 Mozhdeh Gheini , Jonathan May

We present a simple method to improve neural translation of a low-resource language pair using parallel data from a related, also low-resource, language pair. The method is based on the transfer method of Zoph et al., but whereas their…

计算与语言 · 计算机科学 2017-09-22 Toan Q. Nguyen , David Chiang

The encoder-decoder framework for neural machine translation (NMT) has been shown effective in large data scenarios, but is much less effective for low-resource languages. We present a transfer learning method that significantly improves…

计算与语言 · 计算机科学 2016-04-11 Barret Zoph , Deniz Yuret , Jonathan May , Kevin Knight

This study examines the cross-linguistic effectiveness of transfer learning for low-resource machine translation by fine-tuning models initially trained on typologically similar high-resource languages, using limited data from the target…

计算与语言 · 计算机科学 2025-09-03 Saughmon Boujkian

Recent progress in neural machine translation is directed towards larger neural networks trained on an increasing amount of hardware resources. As a result, NMT models are costly to train, both financially, due to the electricity and…

计算与语言 · 计算机科学 2020-05-19 Tom Kocmi , Ondřej Bojar

Neural machine translation has become the state-of-the-art for language pairs with large parallel corpora. However, the quality of machine translation for low-resource languages leaves much to be desired. There are several approaches to…

计算与语言 · 计算机科学 2019-10-02 Ilshat Gibadullin , Aidar Valeev , Albina Khusainova , Adil Khan

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

计算与语言 · 计算机科学 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

In this work, we investigate methods for the challenging task of translating between low-resource language pairs that exhibit some level of similarity. In particular, we consider the utility of transfer learning for translating between…

计算与语言 · 计算机科学 2021-10-04 Wei-Rui Chen , Muhammad Abdul-Mageed

How to achieve neural machine translation with limited parallel data? Existing techniques often rely on large-scale monolingual corpora, which is impractical for some low-resource languages. In this paper, we turn to connect several…

计算与语言 · 计算机科学 2022-10-14 Zhe Yang , Qingkai Fang , Yang Feng

Language pairs with limited amounts of parallel data, also known as low-resource languages, remain a challenge for neural machine translation. While the Transformer model has achieved significant improvements for many language pairs and has…

计算与语言 · 计算机科学 2020-11-05 Ali Araabi , Christof Monz

Cross-lingual model transfer is a compelling and popular method for predicting annotations in a low-resource language, whereby parallel corpora provide a bridge to a high-resource language and its associated annotated corpora. However,…

计算与语言 · 计算机科学 2017-05-02 Meng Fang , Trevor Cohn

Transfer learning between different language pairs has shown its effectiveness for Neural Machine Translation (NMT) in low-resource scenario. However, existing transfer methods involving a common target language are far from success in the…

计算与语言 · 计算机科学 2019-12-04 Baijun Ji , Zhirui Zhang , Xiangyu Duan , Min Zhang , Boxing Chen , Weihua Luo

Transfer learning is a simple and powerful method that can be used to boost model performance of low-resource neural machine translation (NMT). Existing transfer learning methods for NMT are static, which simply transfer knowledge from a…

计算与语言 · 计算机科学 2022-12-09 Zhaocong Li , Xuebo Liu , Derek F. Wong , Lidia S. Chao , Min Zhang

Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. Many works have…

计算与语言 · 计算机科学 2021-11-23 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa , Habeebah Adamu Kakudi , Ismaila Idris Sinan

There are several approaches for improving neural machine translation for low-resource languages: Monolingual data can be exploited via pretraining or data augmentation; Parallel corpora on related language pairs can be used via parameter…

计算与语言 · 计算机科学 2020-12-10 Stig-Arne Grönroos , Sami Virpioja , Mikko Kurimo

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

计算与语言 · 计算机科学 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

计算与语言 · 计算机科学 2017-08-22 Robert Östling , Jörg Tiedemann

Multilingual machine translation has recently been in vogue given its potential for improving machine translation performance for low-resource languages via transfer learning. Empirical examinations demonstrating the success of existing…

计算与语言 · 计算机科学 2020-05-13 Ion Madrazo Azpiazu , Maria Soledad Pera

In cross-lingual transfer, NLP models over one or more source languages are applied to a low-resource target language. While most prior work has used a single source model or a few carefully selected models, here we consider a `massive'…

计算与语言 · 计算机科学 2019-06-06 Afshin Rahimi , Yuan Li , Trevor Cohn
‹ 上一页 1 2 3 10 下一页 ›