English
Related papers

Related papers: Improving Neural Machine Translation with Pre-trai…

200 papers

In this paper, we extend an attention-based neural machine translation (NMT) model by allowing it to access an entire training set of parallel sentence pairs even after training. The proposed approach consists of two stages. In the first…

Computation and Language · Computer Science 2018-03-09 Jiatao Gu , Yong Wang , Kyunghyun Cho , Victor O. K. Li

Multilingual semantic parsing is a cost-effective method that allows a single model to understand different languages. However, researchers face a great imbalance of availability of training data, with English being resource rich, and other…

Computation and Language · Computer Science 2021-06-15 Menglin Xia , Emilio Monti

Context-aware neural machine translation involves leveraging information beyond sentence-level context to resolve inter-sentential discourse dependencies and improve document-level translation quality, and has given rise to a number of…

Computation and Language · Computer Science 2023-10-25 Linghao Jin , Jacqueline He , Jonathan May , Xuezhe Ma

Homographs, words with different meanings but the same surface form, have long caused difficulty for machine translation systems, as it is difficult to select the correct translation based on the context. However, with the advent of neural…

Computation and Language · Computer Science 2018-03-29 Frederick Liu , Han Lu , Graham Neubig

Modern machine translation (MT) systems depend on large parallel corpora, often collected from the Internet. However, recent evidence indicates that (i) a substantial portion of these texts are machine-generated translations, and (ii) an…

Computation and Language · Computer Science 2025-11-06 Cristian García-Romero , Miquel Esplà-Gomis , Felipe Sánchez-Martínez

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-09-07 Zi Long , Ryuichiro Kimura , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

Computation and Language · Computer Science 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

While data augmentation is an important trick to boost the accuracy of deep learning methods in computer vision tasks, its study in natural language tasks is still very limited. In this paper, we present a novel data augmentation method for…

Computation and Language · Computer Science 2019-05-28 Jinhua Zhu , Fei Gao , Lijun Wu , Yingce Xia , Tao Qin , Wengang Zhou , Xueqi Cheng , Tie-Yan Liu

Unsupervised neural machine translation (UNMT) has recently achieved remarkable results with only large monolingual corpora in each language. However, the uncertainty of associating target with source sentences makes UNMT theoretically an…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Yuanhang Su , Kai Fan , Nguyen Bach , C. -C. Jay Kuo , Fei Huang

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further…

Computation and Language · Computer Science 2022-11-28 Pei Zhang , Baosong Yang , Haoran Wei , Dayiheng Liu , Kai Fan , Luo Si , Jun Xie

In this paper, we explore a simple solution to "Multi-Source Neural Machine Translation" (MSNMT) which only relies on preprocessing a N-way multilingual corpus without modifying the Neural Machine Translation (NMT) architecture or training…

Computation and Language · Computer Science 2019-03-05 Raj Dabre , Fabien Cromieres , Sadao Kurohashi

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

There are several approaches for improving neural machine translation for low-resource languages: Monolingual data can be exploited via pretraining or data augmentation; Parallel corpora on related language pairs can be used via parameter…

Computation and Language · Computer Science 2020-12-10 Stig-Arne Grönroos , Sami Virpioja , Mikko Kurimo

This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or target language in the new domain. We propose a cross-lingual…

Computation and Language · Computer Science 2021-09-10 Thuy-Trang Vu , Xuanli He , Dinh Phung , Gholamreza Haffari

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Neural Machine Translation (NMT) generates target words sequentially in the way of predicting the next word conditioned on the context words. At training time, it predicts with the ground truth words as context while at inference it has to…

Computation and Language · Computer Science 2019-06-18 Wen Zhang , Yang Feng , Fandong Meng , Di You , Qun Liu

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

Computation and Language · Computer Science 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2017-10-06 Francisco Guzmán , Shafiq R. Joty , Lluís Màrquez , Preslav Nakov

Multilingual neural machine translation (NMT) enables training a single model that supports translation from multiple source languages into multiple target languages. In this paper, we push the limits of multilingual NMT in terms of number…

Computation and Language · Computer Science 2019-07-03 Roee Aharoni , Melvin Johnson , Orhan Firat

Neural Machine Translation (NMT) has achieved notable success in recent years. Such a framework usually generates translations in isolation. In contrast, human translators often refer to reference data, either rephrasing the intricate…

Computation and Language · Computer Science 2019-08-28 Han Fu , Chenghao Liu , Jianling Sun
‹ Prev 1 8 9 10 Next ›