English
Related papers

Related papers: Word-based Domain Adaptation for Neural Machine Tr…

200 papers

Pretrained Language Models (PLM) have been greatly successful on a board range of natural language processing (NLP) tasks. However, it has just started being applied to the domain of recommendation systems. Traditional recommendation…

Machine Learning · Computer Science 2023-02-10 Nuofan Xu , Chenhui Hu

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

Computation and Language · Computer Science 2018-05-08 Sander Tars , Mark Fishel

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Training data for NLP tasks often exhibits gender bias in that fewer sentences refer to women than to men. In Neural Machine Translation (NMT) gender bias has been shown to reduce translation quality, particularly when the target language…

Computation and Language · Computer Science 2020-07-10 Danielle Saunders , Bill Byrne

Pre-training large language models has become a standard in the natural language processing community. Such models are pre-trained on generic data (e.g. BookCorpus and English Wikipedia) and often fine-tuned on tasks in the same domain.…

Computation and Language · Computer Science 2020-10-05 Kristjan Arumae , Qing Sun , Parminder Bhatia

Previous works mostly focus on either multilingual or multi-domain aspects of neural machine translation (NMT). This paper investigates whether the domain information can be transferred across languages on the composition of multi-domain…

Computation and Language · Computer Science 2022-10-24 Thuy-Trang Vu , Shahram Khadivi , Xuanli He , Dinh Phung , Gholamreza Haffari

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

A novel logographic subword model is proposed to reinterpret logograms as abstract subwords for neural machine translation. Our approach drastically reduces the size of an artificial neural network, while maintaining comparable BLEU scores…

Computation and Language · Computer Science 2018-09-10 Yihao Fang , Rong Zheng , Xiaodan Zhu

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Our work presented in this paper focuses on the translation of terminological expressions represented in semantically structured resources, like ontologies or knowledge graphs. The challenge of translating ontology labels or terminological…

Computation and Language · Computer Science 2019-08-01 Mihael Arcan , Daniel Torregrosa , Paul Buitelaar

Methods for adapting language models (LMs) to new tasks and domains have traditionally assumed white-box access to the model, and work by modifying its parameters. However, this is incompatible with a recent trend in the field, where the…

Computation and Language · Computer Science 2023-05-29 Aitor Ormazabal , Mikel Artetxe , Eneko Agirre

Popular Neural Machine Translation model training uses strategies like backtranslation to improve BLEU scores, requiring large amounts of additional data and training. We introduce a class of conditional generative-discriminative hybrid…

Computation and Language · Computer Science 2020-10-16 Prathyusha Jwalapuram , Shafiq Joty , Youlin Shen

Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting…

Computation and Language · Computer Science 2022-02-08 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

This work connects language model adaptation with concepts of machine learning theory. We consider a training setup with a large out-of-domain set and a small in-domain set. We derive how the benefit of training a model on either set…

Computation and Language · Computer Science 2022-03-23 David Grangier , Dan Iter

Most studies on word-level Quality Estimation (QE) of machine translation focus on language-specific models. The obvious disadvantages of these approaches are the need for labelled data for each language pair and the high cost required to…

Computation and Language · Computer Science 2021-06-02 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

Neural machine translation systems require large amounts of training data and resources. Even with this, the quality of the translations may be insufficient for some users or domains. In such cases, the output of the system must be revised…

Computation and Language · Computer Science 2019-04-09 Álvaro Peris , Francisco Casacuberta

The ambiguous annotation criteria lead to divergence of Chinese Word Segmentation (CWS) datasets in various granularities. Multi-criteria Chinese word segmentation aims to capture various annotation criteria among datasets and leverage…

Computation and Language · Computer Science 2020-10-12 Weipeng Huang , Xingyi Cheng , Kunlong Chen , Taifeng Wang , Wei Chu

Recent studies have demonstrated a perceivable improvement on the performance of neural machine translation by applying cross-lingual language model pretraining (Lample and Conneau, 2019), especially the Translation Language Modeling (TLM).…

Computation and Language · Computer Science 2021-03-15 Yusen Lin , Jiayong Lin , Shuaicheng Zhang , Haoying Dai

Previous research for adapting a general neural machine translation (NMT) model into a specific domain usually neglects the diversity in translation within the same domain, which is a core problem for domain adaptation in real-world…

Computation and Language · Computer Science 2021-11-09 Wenhao Zhu , Shujian Huang , Tong Pu , Pingxuan Huang , Xu Zhang , Jian Yu , Wei Chen , Yanfeng Wang , Jiajun Chen