English
Related papers

Related papers: Multi-Domain Adaptation in Neural Machine Translat…

200 papers

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

Existing Neural Machine Translation (NMT) models mainly handle translation in the general domain, while overlooking domains with special writing formulas, such as e-commerce and legal documents. Taking e-commerce as an example, the texts…

Computation and Language · Computer Science 2024-04-09 Kaidi Chen , Ben Chen , Dehong Gao , Huangyu Dai , Wen Jiang , Wei Ning , Shanqing Yu , Libin Yang , Xiaoyan Cai

The advantages of neural machine translation (NMT) have been extensively validated for offline translation of several language pairs for different domains of spoken and written language. However, research on interactive learning of NMT by…

Computation and Language · Computer Science 2018-09-19 Sariya Karimova , Patrick Simianer , Stefan Riezler

A good translation should not only translate the original content semantically, but also incarnate personal traits of the original text. For a real-world neural machine translation (NMT) system, these user traits (e.g., topic preference,…

Computation and Language · Computer Science 2021-06-14 Huan Lin , Liang Yao , Baosong Yang , Dayiheng Liu , Haibo Zhang , Weihua Luo , Degen Huang , Jinsong Su

Unsupervised machine translation, which utilizes unpaired monolingual corpora as training data, has achieved comparable performance against supervised machine translation. However, it still suffers from data-scarce domains. To address this…

Computation and Language · Computer Science 2021-05-10 Cheonbok Park , Yunwon Tae , Taehee Kim , Soyoung Yang , Mohammad Azam Khan , Eunjeong Park , Jaegul Choo

The key challenge of multi-domain translation lies in simultaneously encoding both the general knowledge shared across domains and the particular knowledge distinctive to each domain in a unified model. Previous work shows that the standard…

Computation and Language · Computer Science 2019-11-25 Yong Wang , Longyue Wang , Shuming Shi , Victor O. K. Li , Zhaopeng Tu

This paper proposes a novel multilingual multistage fine-tuning approach for low-resource neural machine translation (NMT), taking a challenging Japanese--Russian pair for benchmarking. Although there are many solutions for low-resource…

Computation and Language · Computer Science 2019-07-09 Aizhan Imankulova , Raj Dabre , Atsushi Fujita , Kenji Imamura

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

Computation and Language · Computer Science 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

Computation and Language · Computer Science 2021-06-23 Junjie Hu , Graham Neubig

Machine translation models struggle when translating out-of-domain text, which makes domain adaptation a topic of critical importance. However, most domain adaptation methods focus on fine-tuning or training the entire or part of the model…

Computation and Language · Computer Science 2022-04-28 Pedro Henrique Martins , Zita Marinho , André F. T. Martins

Translating text that diverges from the training domain is a key challenge for machine translation. Domain robustness---the generalization of models to unseen test domains---is low for both statistical (SMT) and neural machine translation…

Computation and Language · Computer Science 2020-09-28 Mathias Müller , Annette Rios , Rico Sennrich

Nearest Neighbor Machine Translation ($k$NN-MT) has achieved great success in domain adaptation tasks by integrating pre-trained Neural Machine Translation (NMT) models with domain-specific token-level retrieval. However, the reasons…

Computation and Language · Computer Science 2023-10-25 Ruize Gao , Zhirui Zhang , Yichao Du , Lemao Liu , Rui Wang

Recent years have seen the rise of Deep Learning (DL) techniques applied to source code. Researchers have exploited DL to automate several development and maintenance tasks, such as writing commit messages, generating comments and detecting…

Software Engineering · Computer Science 2019-01-29 Michele Tufano , Jevgenija Pantiuchina , Cody Watson , Gabriele Bavota , Denys Poshyvanyk

Machine translation (MT) has become indispensable for cross-border communication in globalized industries like e-commerce, finance, and legal services, with recent advancements in large language models (LLMs) significantly enhancing…

Neural machine translation (NMT) has been accelerated by deep learning neural networks over statistical-based approaches, due to the plethora and programmability of commodity heterogeneous computing architectures such as FPGAs and GPUs and…

Computation and Language · Computer Science 2021-09-15 Robert Lim , Kenneth Heafield , Hieu Hoang , Mark Briers , Allen Malony

The training of topic models for a multilingual environment is a challenging task, requiring the use of sophisticated algorithms, topic-aligned corpora, and manual evaluation. These difficulties are further exacerbated when the developer…

Computation and Language · Computer Science 2025-09-03 Felix Engl , Andreas Henrich

Previous research for adapting a general neural machine translation (NMT) model into a specific domain usually neglects the diversity in translation within the same domain, which is a core problem for domain adaptation in real-world…

Computation and Language · Computer Science 2021-11-09 Wenhao Zhu , Shujian Huang , Tong Pu , Pingxuan Huang , Xu Zhang , Jian Yu , Wei Chen , Yanfeng Wang , Jiajun Chen

Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting…

Computation and Language · Computer Science 2022-02-08 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

Neural machine translation (NMT) has arguably achieved human level parity when trained and evaluated at the sentence-level. Document-level neural machine translation has received less attention and lags behind its sentence-level…

Computation and Language · Computer Science 2020-03-12 Elman Mansimov , Gábor Melis , Lei Yu