English
Related papers

Related papers: A Simple Baseline to Semi-Supervised Domain Adapta…

200 papers

Many of the world's languages have insufficient data to train high-performing general neural machine translation (NMT) models, let alone domain-specific models, and often the only available parallel data are small amounts of religious…

Computation and Language · Computer Science 2025-02-24 Ali Marashian , Enora Rice , Luke Gessler , Alexis Palmer , Katharina von der Wense

Cross-lingual adaptation with multilingual pre-trained language models (mPTLMs) mainly consists of two lines of works: zero-shot approach and translation-based approach, which have been studied extensively on the sequence-level tasks. We…

Computation and Language · Computer Science 2021-06-23 Xin Li , Lidong Bing , Wenxuan Zhang , Zheng Li , Wai Lam

Neural Machine Translation (NMT) systems face significant challenges when working with low-resource languages, particularly in domain adaptation tasks. These difficulties arise due to limited training data and suboptimal model…

Computation and Language · Computer Science 2025-05-22 Pratik Rakesh Singh , Kritarth Prasad , Mohammadi Zaki , Pankaj Wasnik

$k$-Nearest neighbor machine translation ($k$NN-MT) has attracted increasing attention due to its ability to non-parametrically adapt to new translation domains. By using an upstream NMT model to traverse the downstream training corpus, it…

Computation and Language · Computer Science 2023-05-29 Zhiwei Cao , Baosong Yang , Huan Lin , Suhang Wu , Xiangpeng Wei , Dayiheng Liu , Jun Xie , Min Zhang , Jinsong Su

Achieving satisfying performance in machine translation on domains for which there is no training data is challenging. Traditional supervised domain adaptation is not suitable for addressing such zero-resource domains because it relies on…

Computation and Language · Computer Science 2021-04-20 Dario Stojanovski , Alexander Fraser

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

Recently, there has been a surge in research in multimodal machine translation (MMT), where additional modalities such as images are used to improve translation quality of textual systems. A particular use for such multimodal systems is the…

Computation and Language · Computer Science 2022-07-07 Veneta Haralampieva , Ozan Caglayan , Lucia Specia

We present a new semi-supervised domain adaptation framework that combines a novel auto-encoder-based domain adaptation model with a simultaneous learning scheme providing stable improvements over state-of-the-art domain adaptation models.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Md Mahmudur Rahman , Rameswar Panda , Mohammad Arif Ul Alam

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Previous research for adapting a general neural machine translation (NMT) model into a specific domain usually neglects the diversity in translation within the same domain, which is a core problem for domain adaptation in real-world…

Computation and Language · Computer Science 2021-11-09 Wenhao Zhu , Shujian Huang , Tong Pu , Pingxuan Huang , Xu Zhang , Jian Yu , Wei Chen , Yanfeng Wang , Jiajun Chen

Machine translation (MT) models used in industries with constantly changing topics, such as translation or news agencies, need to adapt to new data to maintain their performance over time. Our aim is to teach a pre-trained MT model to…

Computation and Language · Computer Science 2021-04-01 Farid Arthaud , Rachel Bawden , Alexandra Birch

We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks…

Machine Learning · Computer Science 2019-06-11 Woong-Gi Chang , Tackgeun You , Seonguk Seo , Suha Kwak , Bohyung Han

Unsupervised neural machine translation (UNMT) that relies solely on massive monolingual corpora has achieved remarkable results in several translation tasks. However, in real-world scenarios, massive monolingual corpora do not exist for…

Computation and Language · Computer Science 2021-05-25 Haipeng Sun , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Luke Melas-Kyriazi , Arjun K. Manrai

Training data for NLP tasks often exhibits gender bias in that fewer sentences refer to women than to men. In Neural Machine Translation (NMT) gender bias has been shown to reduce translation quality, particularly when the target language…

Computation and Language · Computer Science 2020-07-10 Danielle Saunders , Bill Byrne

Training mixed-domain translation models is a complex task that demands tailored architectures and costly data preparation techniques. In this work, we leverage federated learning (FL) in order to tackle the problem. Our investigation…

Computation and Language · Computer Science 2022-05-04 Peyman Passban , Tanya Roosta , Rahul Gupta , Ankit Chadha , Clement Chung

Improving neural machine translation (NMT) models using the back-translations of the monolingual target data (synthetic parallel data) is currently the state-of-the-art approach for training improved translation systems. The quality of the…

Computation and Language · Computer Science 2021-02-16 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa

Unsupervised domain adaptation aims to transfer the classifier learned from the source domain to the target domain in an unsupervised manner. With the help of target pseudo-labels, aligning class-level distributions and learning the…

Machine Learning · Computer Science 2019-06-11 Dong-Dong Chen , Yisen Wang , Jinfeng Yi , Zaiyi Chen , Zhi-Hua Zhou

We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of…

Computation and Language · Computer Science 2021-11-30 Garry Kuwanto , Afra Feyza Akyürek , Isidora Chara Tourni , Siyang Li , Alexander Gregory Jones , Derry Wijaya

In this paper, we introduce a hybrid search for attention-based neural machine translation (NMT). A target phrase learned with statistical MT models extends a hypothesis in the NMT beam search when the attention of the NMT model focuses on…

Computation and Language · Computer Science 2017-08-11 Leonard Dahlmann , Evgeny Matusov , Pavel Petrushkov , Shahram Khadivi