中文
相关论文

相关论文: A Preordered RNN Layer Boosts Neural Machine Trans…

200 篇论文

State-of-the-art results on neural machine translation often use attentional sequence-to-sequence models with some form of convolution or recursion. Vaswani et al. (2017) propose a new architecture that avoids recurrence and convolution…

人工智能 · 计算机科学 2017-11-08 Karim Ahmed , Nitish Shirish Keskar , Richard Socher

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

计算与语言 · 计算机科学 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to…

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

计算与语言 · 计算机科学 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on…

计算与语言 · 计算机科学 2017-07-25 Longyue Wang , Zhaopeng Tu , Andy Way , Qun Liu

Document-level context for neural machine translation (NMT) is crucial to improve the translation consistency and cohesion, the translation of ambiguous inputs, as well as several other linguistic phenomena. Many works have been published…

计算与语言 · 计算机科学 2023-06-09 Christian Herold , Hermann Ney

We propose a neural machine translation architecture that models the surrounding text in addition to the source sentence. These models lead to better performance, both in terms of general translation quality and pronoun prediction, when…

机器学习 · 统计学 2017-04-19 Sebastien Jean , Stanislas Lauly , Orhan Firat , Kyunghyun Cho

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

计算与语言 · 计算机科学 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Nearest Neighbor Machine Translation (kNNMT) is a simple and effective method of augmenting neural machine translation (NMT) with a token-level nearest neighbor retrieval mechanism. The effectiveness of kNNMT directly depends on the quality…

计算与语言 · 计算机科学 2022-12-20 Jiahuan Li , Shanbo Cheng , Zewei Sun , Mingxuan Wang , Shujian Huang

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

计算与语言 · 计算机科学 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Multimodal machine translation is an attractive application of neural machine translation (NMT). It helps computers to deeply understand visual objects and their relations with natural languages. However, multimodal NMT systems suffer from…

计算与语言 · 计算机科学 2019-04-02 Tosho Hirasawa , Hayahide Yamagishi , Yukio Matsumura , Mamoru Komachi

Neural Machine Translation (NMT) models are typically trained on heterogeneous data that are concatenated and randomly shuffled. However, not all of the training data are equally useful to the model. Curriculum training aims to present the…

计算与语言 · 计算机科学 2022-03-29 Tasnim Mohiuddin , Philipp Koehn , Vishrav Chaudhary , James Cross , Shruti Bhosale , Shafiq Joty

In this study, a human evaluation is carried out on how hyperparameter settings impact the quality of Transformer-based Neural Machine Translation (NMT) for the low-resourced English--Irish pair. SentencePiece models using both Byte Pair…

计算与语言 · 计算机科学 2024-03-06 Séamus Lankford , Haithem Afli , Andy Way

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

计算与语言 · 计算机科学 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Neural networks have demonstrated significant advancements in Neural Machine Translation (NMT) compared to conventional phrase-based approaches. However, Multilingual Neural Machine Translation (MNMT) in extremely low-resource settings…

计算与语言 · 计算机科学 2024-12-19 Vageesh Saxena , Sharid Loáiciga , Nils Rethmeier

Neural machine translation (NMT) from Chinese to low-resource Southeast Asian languages remains severely constrained by the extreme scarcity of clean parallel corpora and the pervasive noise in existing mined data. This chronic shortage not…

计算与语言 · 计算机科学 2026-04-07 Zhixiang Lu , Chong Zhang , Chenyu Xue , Angelos Stefanidis , Chong Li , Jionglong Su , Zhengyong Jiang

Neural Machine Translation (NMT) is resource intensive. We design a quantization procedure to compress NMT models better for devices with limited hardware capability. Because most neural network parameters are near zero, we employ…

计算与语言 · 计算机科学 2019-09-23 Alham Fikri Aji , Kenneth Heafield

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of "domain" adaption to noise. The…

计算与语言 · 计算机科学 2019-11-12 Zhenhao Li , Lucia Specia

Language models often pre-train on large unsupervised text corpora, then fine-tune on additional task-specific data. However, typical fine-tuning schemes do not prioritize the examples that they tune on. We show that, if you can prioritize…

计算与语言 · 计算机科学 2023-05-12 Ian Osband , Seyed Mohammad Asghari , Benjamin Van Roy , Nat McAleese , John Aslanides , Geoffrey Irving

Attention-based models have shown significant improvement over traditional algorithms in several NLP tasks. The Transformer, for instance, is an illustrative example that generates abstract representations of tokens inputted to an encoder…

计算与语言 · 计算机科学 2019-11-15 Dhanasekar Sundararaman , Vivek Subramanian , Guoyin Wang , Shijing Si , Dinghan Shen , Dong Wang , Lawrence Carin