中文
相关论文

相关论文: Joint Dropout: Improving Generalizability in Low-R…

200 篇论文

Despite the improvement of translation quality, neural machine translation (NMT) often suffers from the lack of diversity in its generation. In this paper, we propose to generate diverse translations by deriving a large number of possible…

计算与语言 · 计算机科学 2020-10-19 Xuanfu Wu , Yang Feng , Chenze Shao

k-Nearest-Neighbor Machine Translation (kNN-MT) has been recently proposed as a non-parametric solution for domain adaptation in neural machine translation (NMT). It aims to alleviate the performance degradation of advanced MT systems in…

计算与语言 · 计算机科学 2022-05-04 Dexin Wang , Kai Fan , Boxing Chen , Deyi Xiong

Pronouns are frequently omitted in pro-drop languages, such as Chinese, generally leading to significant challenges with respect to the production of complete translations. Recently, Wang et al. (2018) proposed a novel reconstruction-based…

计算与语言 · 计算机科学 2018-10-16 Longyue Wang , Zhaopeng Tu , Andy Way , Qun Liu

Multimodal machine translation is an attractive application of neural machine translation (NMT). It helps computers to deeply understand visual objects and their relations with natural languages. However, multimodal NMT systems suffer from…

计算与语言 · 计算机科学 2019-04-02 Tosho Hirasawa , Hayahide Yamagishi , Yukio Matsumura , Mamoru Komachi

Neural machine translation is known to require large numbers of parallel training sentences, which generally prevent it from excelling on low-resource language pairs. This thesis explores the use of cross-lingual transfer learning on neural…

计算与语言 · 计算机科学 2020-01-07 Tom Kocmi

Recurrent neural networks (RNNs) with Long Short-Term memory cells currently hold the best known results in unconstrained handwriting recognition. We show that their performance can be greatly improved using dropout - a recently proposed…

计算机视觉与模式识别 · 计算机科学 2014-03-11 Vu Pham , Théodore Bluche , Christopher Kermorvant , Jérôme Louradour

Neural machine translation (NMT) from Chinese to low-resource Southeast Asian languages remains severely constrained by the extreme scarcity of clean parallel corpora and the pervasive noise in existing mined data. This chronic shortage not…

计算与语言 · 计算机科学 2026-04-07 Zhixiang Lu , Chong Zhang , Chenyu Xue , Angelos Stefanidis , Chong Li , Jionglong Su , Zhengyong Jiang

Scarcity of parallel sentence pairs is a major challenge for training high quality neural machine translation (NMT) models in bilingually low-resource scenarios, as NMT is data-hungry. Multi-task learning is an elegant approach to inject…

计算与语言 · 计算机科学 2020-01-13 Poorya Zaremoodi , Gholamreza Haffari

Dropout is a very effective way of regularizing neural networks. Stochastically "dropping out" units with a certain probability discourages over-specific co-adaptations of feature detectors, preventing overfitting and improving network…

神经与进化计算 · 计算机科学 2017-08-04 Pietro Morerio , Jacopo Cavazza , Riccardo Volpi , Rene Vidal , Vittorio Murino

Recent literature has demonstrated the potential of multilingual Neural Machine Translation (mNMT) models. However, the most efficient models are not well suited to specialized industries. In these cases, internal data is scarce and…

计算与语言 · 计算机科学 2022-10-28 Mathieu Grosso , Pirashanth Ratnamogan , Alexis Mathey , William Vanhuffel , Michael Fotso Fotso

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

计算与语言 · 计算机科学 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

The multilingual neural machine translation (NMT) model has a promising capability of zero-shot translation, where it could directly translate between language pairs unseen during training. For good transfer performance from supervised…

计算与语言 · 计算机科学 2023-05-15 Pengzhi Gao , Liwen Zhang , Zhongjun He , Hua Wu , Haifeng Wang

One of the significant challenges of Machine Translation (MT) is the scarcity of large amounts of data, mainly parallel sentence aligned corpora. If the evaluation is as rigorous as resource-rich languages, both Neural Machine Translation…

计算与语言 · 计算机科学 2023-03-06 Amit Kumar , Rupjyoti Baruah , Ajay Pratap , Mayank Swarnkar , Anil Kumar Singh

Lack of specialized data makes building a multi-domain neural machine translation tool challenging. Although emerging literature dealing with low resource languages starts to show promising results, most state-of-the-art models used…

计算与语言 · 计算机科学 2020-04-17 Idriss Mghabbar , Pirashanth Ratnamogan

Recurrent neural networks (RNNs) are important class of architectures among neural networks useful for language modeling and sequential prediction. However, optimizing RNNs is known to be harder compared to feed-forward neural networks. A…

机器学习 · 统计学 2018-03-29 Konrad Zolna , Devansh Arpit , Dendi Suhubdy , Yoshua Bengio

As neural machine translation (NMT) is not easily amenable to explicit correction of errors, incorporating pre-specified translations into NMT is widely regarded as a non-trivial challenge. In this paper, we propose and explore three…

计算与语言 · 计算机科学 2019-12-03 Tao Wang , Shaohui Kuang , Deyi Xiong , António Branco

Nearly all previous work on neural machine translation (NMT) has used quite restricted vocabularies, perhaps with a subsequent method to patch in unknown words. This paper presents a novel word-character solution to achieving open…

计算与语言 · 计算机科学 2016-06-24 Minh-Thang Luong , Christopher D. Manning

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users. Given the expensive training cost and the…

计算与语言 · 计算机科学 2024-03-22 Yuzhuang Xu , Shuo Wang , Peng Li , Xuebo Liu , Xiaolong Wang , Weidong Liu , Yang Liu

Successful application processing sequential data, such as text and speech, requires an improved generalization performance of recurrent neural networks (RNNs). Dropout techniques for RNNs were introduced to respond to these demands, but we…

机器学习 · 计算机科学 2019-04-23 Sungrae Park , Kyungwoo Song , Mingi Ji , Wonsung Lee , Il-Chul Moon

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

计算与语言 · 计算机科学 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann