中文
相关论文

相关论文: Addressing the Rare Word Problem in Neural Machine…

200 篇论文

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

计算与语言 · 计算机科学 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele

While most neural machine translation (NMT) systems are still trained using maximum likelihood estimation, recent work has demonstrated that optimizing systems to directly improve evaluation metrics such as BLEU can substantially improve…

计算与语言 · 计算机科学 2019-09-17 John Wieting , Taylor Berg-Kirkpatrick , Kevin Gimpel , Graham Neubig

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

计算与语言 · 计算机科学 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

The effectiveness of Neural Machine Translation (NMT) models largely depends on the vocabulary used at training; small vocabularies can lead to out-of-vocabulary problems -- large ones, to memory issues. Subword (SW) tokenization has been…

计算与语言 · 计算机科学 2023-03-02 J. Pourmostafa Roshan Sharami , D. Shterionov , P. Spronck

The performance of Neural Machine Translation (NMT) systems often suffers in low-resource scenarios where sufficiently large-scale parallel corpora cannot be obtained. Pre-trained word embeddings have proven to be invaluable for improving…

计算与语言 · 计算机科学 2018-04-19 Ye Qi , Devendra Singh Sachan , Matthieu Felix , Sarguna Janani Padmanabhan , Graham Neubig

A neural machine translation (NMT) system is expensive to train, especially with high-resource settings. As the NMT architectures become deeper and wider, this issue gets worse and worse. In this paper, we aim to improve the efficiency of…

计算与语言 · 计算机科学 2020-06-04 Xuebo Liu , Houtim Lai , Derek F. Wong , Lidia S. Chao

Without real bilingual corpus available, unsupervised Neural Machine Translation (NMT) typically requires pseudo parallel data generated with the back-translation method for the model training. However, due to weak supervision, the pseudo…

计算与语言 · 计算机科学 2019-01-15 Shuo Ren , Zhirui Zhang , Shujie Liu , Ming Zhou , Shuai Ma

In spite of the recent success of neural machine translation (NMT) in standard benchmarks, the lack of large parallel corpora poses a major practical problem for many language pairs. There have been several proposals to alleviate this issue…

计算与语言 · 计算机科学 2018-02-27 Mikel Artetxe , Gorka Labaka , Eneko Agirre , Kyunghyun Cho

OpenNMT is an open-source toolkit for neural machine translation (NMT). The system prioritizes efficiency, modularity, and extensibility with the goal of supporting NMT research into model architectures, feature representations, and source…

计算与语言 · 计算机科学 2018-05-30 Guillaume Klein , Yoon Kim , Yuntian Deng , Vincent Nguyen , Jean Senellart , Alexander M. Rush

As neural machine translation (NMT) is not easily amenable to explicit correction of errors, incorporating pre-specified translations into NMT is widely regarded as a non-trivial challenge. In this paper, we propose and explore three…

计算与语言 · 计算机科学 2019-12-03 Tao Wang , Shaohui Kuang , Deyi Xiong , António Branco

Although unsupervised neural machine translation (UNMT) has achieved success in many language pairs, the copying problem, i.e., directly copying some parts of the input sentence as the translation, is common among distant language pairs,…

计算与语言 · 计算机科学 2023-06-06 Yihong Liu , Alexandra Chronopoulou , Hinrich Schütze , Alexander Fraser

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

计算与语言 · 计算机科学 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

计算与语言 · 计算机科学 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Morphological modeling in neural machine translation (NMT) is a promising approach to achieving open-vocabulary machine translation for morphologically-rich languages. However, existing methods such as sub-word tokenization and…

计算与语言 · 计算机科学 2024-04-04 Antoine Nzeyimana

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

计算与语言 · 计算机科学 2018-12-19 Markus Freitag , Yaser Al-Onaizan

We introduce a powerful approach for Neural Machine Translation (NMT), whereby, during training and testing, together with the input we provide its phonetic encoding and the variants of such an encoding. This way we obtain very significant…

计算与语言 · 计算机科学 2019-11-12 Abdul Rafae Khan , Jia Xu

Neural machine translation~(NMT) is ineffective for zero-resource languages. Recent works exploring the possibility of unsupervised neural machine translation (UNMT) with only monolingual data can achieve promising results. However, there…

计算与语言 · 计算机科学 2021-04-02 Mingxuan Wang , Hongxiao Bai , Hai Zhao , Lei Li

The encoder-decoder framework for neural machine translation (NMT) has been shown effective in large data scenarios, but is much less effective for low-resource languages. We present a transfer learning method that significantly improves…

计算与语言 · 计算机科学 2016-04-11 Barret Zoph , Deniz Yuret , Jonathan May , Kevin Knight

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

计算与语言 · 计算机科学 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

In simultaneous machine translation, the objective is to determine when to produce a partial translation given a continuous stream of source words, with a trade-off between latency and quality. We propose a neural machine translation (NMT)…

计算与语言 · 计算机科学 2020-06-01 Patrick Wilken , Tamer Alkhouli , Evgeny Matusov , Pavel Golik