English
Related papers

Related papers: Pluggable Neural Machine Translation Models via Me…

200 papers

Previous studies have shown that neural machine translation (NMT) models can benefit from explicitly modeling translated (Past) and untranslated (Future) to groups of translated and untranslated contents through parts-to-wholes assignment.…

Computation and Language · Computer Science 2019-09-23 Zaixiang Zheng , Shujian Huang , Zhaopeng Tu , Xin-Yu Dai , Jiajun Chen

In principle, the design of transition-based dependency parsers makes it possible to experiment with any general-purpose classifier without other changes to the parsing algorithm. In practice, however, it often takes substantial software…

Computation and Language · Computer Science 2012-11-02 Alex Rudnick

Continual learning allows the system to learn and adapt to new tasks while retaining the knowledge acquired from previous tasks. However, deep learning models suffer from catastrophic forgetting of knowledge learned from earlier tasks while…

Machine Learning · Computer Science 2024-12-17 Dupati Srikar Chandra , P. K. Srijith , Dana Rezazadegan , Chris McCarthy

Morphological modeling in neural machine translation (NMT) is a promising approach to achieving open-vocabulary machine translation for morphologically-rich languages. However, existing methods such as sub-word tokenization and…

Computation and Language · Computer Science 2024-04-04 Antoine Nzeyimana

Several recent studies have reported dramatic performance improvements in neural machine translation (NMT) by augmenting translation at inference time with fuzzy-matches retrieved from a translation memory (TM). However, these studies all…

Computation and Language · Computer Science 2022-10-12 Cuong Hoang , Devendra Sachan , Prashant Mathur , Brian Thompson , Marcello Federico

Large language model (LLM) has achieved promising performance in multilingual machine translation tasks through zero/few-shot prompts or prompt-tuning. However, due to the mixture of multilingual data during the pre-training of LLM, the…

Computation and Language · Computer Science 2024-03-12 Shaojie Dai , Xin Liu , Ping Luo , Yue Yu

In this work, we introduce instruction finetuning for Neural Machine Translation (NMT) models, which distills instruction following capabilities from Large Language Models (LLMs) into orders-of-magnitude smaller NMT models. Our…

Computation and Language · Computer Science 2024-10-10 Vikas Raunak , Roman Grundkiewicz , Marcin Junczys-Dowmunt

Domain Adaptation is widely used in practical applications of neural machine translation, which aims to achieve good performance on both the general-domain and in-domain. However, the existing methods for domain adaptation usually suffer…

Computation and Language · Computer Science 2021-04-15 Shuhao Gu , Yang Feng , Wanying Xie

Large-scale training datasets lie at the core of the recent success of neural machine translation (NMT) models. However, the complex patterns and potential noises in the large-scale data make training NMT models difficult. In this work, we…

Computation and Language · Computer Science 2020-10-07 Wenxiang Jiao , Xing Wang , Shilin He , Irwin King , Michael R. Lyu , Zhaopeng Tu

Neural Machine translation is a challenging task due to the inherent complex nature and the fluidity that natural languages bring. Nonetheless, in recent years, it has achieved state-of-the-art performance in several language pairs.…

Computation and Language · Computer Science 2023-04-19 Vakul Goyle , Parvathy Krishnaswamy , Kannan Girija Ravikumar , Utsa Chattopadhyay , Kartikay Goyle

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

Computation and Language · Computer Science 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

We propose a novel model for Neural Machine Translation (NMT). Different from the conventional method, our model can predict the future text length and words at each decoding time step so that the generation can be helped with the…

Computation and Language · Computer Science 2018-09-05 Bingzhen Wei , Junyang Lin

In this paper, we propose a novel domain adaptation method named "mixed fine tuning" for neural machine translation (NMT). We combine two existing approaches namely fine tuning and multi domain NMT. We first train an NMT model on an…

Computation and Language · Computer Science 2017-02-07 Chenhui Chu , Raj Dabre , Sadao Kurohashi

Using translation memories (TMs) as prompts is a promising approach to in-context learning of machine translation models. In this work, we take a step towards prompting large language models (LLMs) with TMs and making them better…

Computation and Language · Computer Science 2023-05-30 Yongyu Mu , Abudurexiti Reheman , Zhiquan Cao , Yuchun Fan , Bei Li , Yinqiao Li , Tong Xiao , Chunliang Zhang , Jingbo Zhu

Machine translation systems are expected to cope with various types of constraints in many practical scenarios. While neural machine translation (NMT) has achieved strong performance in unconstrained cases, it is non-trivial to impose…

Computation and Language · Computer Science 2022-10-24 Shuo Wang , Peng Li , Zhixing Tan , Zhaopeng Tu , Maosong Sun , Yang Liu

Retrieval-Augmented Neural Machine Translation (RAMT) architectures retrieve examples from memory to guide the generation process. While most works in this trend explore new ways to exploit the retrieved examples, the upstream retrieval…

Computation and Language · Computer Science 2024-04-04 Maxime Bouthors , Josep Crego , Francois Yvon

In this paper, we enhance the attention-based neural machine translation (NMT) by adding explicit coverage embedding models to alleviate issues of repeating and dropping translations in NMT. For each source word, our model starts with a…

Computation and Language · Computer Science 2016-08-30 Haitao Mi , Baskaran Sankaran , Zhiguo Wang , Abe Ittycheriah

Large multilingual models trained with self-supervision achieve state-of-the-art results in a wide range of natural language processing tasks. Self-supervised pretrained models are often fine-tuned on parallel data from one or multiple…

Computation and Language · Computer Science 2023-03-31 Alexandra Chronopoulou , Dario Stojanovski , Alexander Fraser

The advantages of neural machine translation (NMT) have been extensively validated for offline translation of several language pairs for different domains of spoken and written language. However, research on interactive learning of NMT by…

Computation and Language · Computer Science 2018-09-19 Sariya Karimova , Patrick Simianer , Stefan Riezler