English
Related papers

Related papers: Incorporating Word and Subword Units in Unsupervis…

200 papers

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Neural machine translation (NMT) suffers a performance deficiency when a limited vocabulary fails to cover the source or target side adequately, which happens frequently when dealing with morphologically rich languages. To address this…

Computation and Language · Computer Science 2018-01-12 Kai Song , Yue Zhang , Min Zhang , Weihua Luo

We propose a language-independent approach for improving statistical machine translation for morphologically rich languages using a hybrid morpheme-word representation where the basic unit of translation is the morpheme, but word boundaries…

Computation and Language · Computer Science 2019-11-20 Minh-Thang Luong , Preslav Nakov , Min-Yen Kan

Machine translation (MT) post-editing and research data collection often rely on inefficient, disconnected workflows. We introduce TranslationCorrect, an integrated framework designed to streamline these tasks. TranslationCorrect combines…

Computation and Language · Computer Science 2025-06-24 Syed Mekael Wasti , Shou-Yi Hung , Christopher Collins , En-Shiun Annie Lee

We present a new approach to encourage neural machine translation to satisfy lexical constraints. Our method acts at the training step and thereby avoiding the introduction of any extra computational overhead at inference step. The proposed…

Computation and Language · Computer Science 2021-06-08 Melissa Ailem , Jinghsu Liu , Raheel Qader

Users of machine translation (MT) may want to ensure the use of specific lexical terminologies. While there exist techniques for incorporating terminology constraints during inference for MT, current APE approaches cannot ensure that they…

Computation and Language · Computer Science 2020-10-20 David Wan , Chris Kedzie , Faisal Ladhak , Marine Carpuat , Kathleen McKeown

The recently proposed BERT has shown great power on a variety of natural language understanding tasks, such as text classification, reading comprehension, etc. However, how to effectively apply BERT to neural machine translation (NMT) lacks…

Computation and Language · Computer Science 2020-02-18 Jinhua Zhu , Yingce Xia , Lijun Wu , Di He , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-09-07 Zi Long , Ryuichiro Kimura , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

We address for the first time unsupervised training for a translation task with hundreds of thousands of vocabulary words. We scale up the expectation-maximization (EM) algorithm to learn a large translation table without any parallel text…

Computation and Language · Computer Science 2019-01-08 Yunsu Kim , Julian Schamper , Hermann Ney

Multilingual neural machine translation (NMT), which translates multiple languages using a single model, is of great practical importance due to its advantages in simplifying the training process, reducing online maintenance costs, and…

Computation and Language · Computer Science 2019-08-27 Xu Tan , Jiale Chen , Di He , Yingce Xia , Tao Qin , Tie-Yan Liu

We introduce the Normalized Matching Transformer (NMT), a deep learning approach for efficient and accurate sparse semantic keypoint matching between image pairs. NMT consists of a strong visual backbone, geometric feature refinement via…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Abtin Pourhadi , Paul Swoboda

Neural machine translation (NMT) has recently become popular in the field of machine translation. However, NMT suffers from the problem of repeating or missing words in the translation. To address this problem, Tu et al. (2017) proposed an…

Computation and Language · Computer Science 2017-06-27 Yukio Matsumura , Takayuki Sato , Mamoru Komachi

We propose a novel discriminative model that learns embeddings from multilingual and multi-modal data, meaning that our model can take advantage of images and descriptions in multiple languages to improve embedding quality. To that end, we…

Computation and Language · Computer Science 2017-02-06 Iacer Calixto , Qun Liu , Nick Campbell

Neural machine translation (NMT) is one of the best methods for understanding the differences in semantic rules between two languages. Especially for Indo-European languages, subword-level models have achieved impressive results. However,…

Computation and Language · Computer Science 2019-11-11 Wei Zhang , Feifei Lin , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

This paper proposes a simple and effective algorithm for incorporating lexical constraints in neural machine translation. Previous work either required re-training existing models with the lexical constraints or incorporating them during…

Computation and Language · Computer Science 2020-04-28 Raymond Hendy Susanto , Shamil Chollampatt , Liling Tan

Subword tokenization is a common method for vocabulary building in Neural Machine Translation (NMT) models. However, increasingly complex tasks have revealed its disadvantages. First, a vocabulary cannot be modified once it is learned,…

Computation and Language · Computer Science 2024-08-13 Langlin Huang , Yang Feng

Large-scale cross-lingual language models (LM), such as mBERT, Unicoder and XLM, have achieved great success in cross-lingual representation learning. However, when applied to zero-shot cross-lingual transfer tasks, most existing methods…

Computation and Language · Computer Science 2020-12-16 Yuwei Fang , Shuohang Wang , Zhe Gan , Siqi Sun , Jingjing Liu

Neural Machine Translation (NMT) typically leverages monolingual data in training through backtranslation. We investigate an alternative simple method to use monolingual data for NMT training: We combine the scores of a pre-trained and…

Computation and Language · Computer Science 2019-01-25 Felix Stahlberg , James Cross , Veselin Stoyanov

State-of-the-art language models are autoregressive and operate on subword units known as tokens. Specifically, one must encode the conditioning string into a list of tokens before passing to the language models for next-token prediction.…

Computation and Language · Computer Science 2024-07-09 Buu Phan , Marton Havasi , Matthew Muckley , Karen Ullrich

Neural machine translation (NMT) has arguably achieved human level parity when trained and evaluated at the sentence-level. Document-level neural machine translation has received less attention and lags behind its sentence-level…

Computation and Language · Computer Science 2020-03-12 Elman Mansimov , Gábor Melis , Lei Yu