English
Related papers

Related papers: Revisiting Simple Domain Adaptation Methods in Uns…

200 papers

We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks…

Machine Learning · Computer Science 2019-06-11 Woong-Gi Chang , Tackgeun You , Seonguk Seo , Suha Kwak , Bohyung Han

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

Previous works mostly focus on either multilingual or multi-domain aspects of neural machine translation (NMT). This paper investigates whether the domain information can be transferred across languages on the composition of multi-domain…

Computation and Language · Computer Science 2022-10-24 Thuy-Trang Vu , Shahram Khadivi , Xuanli He , Dinh Phung , Gholamreza Haffari

Machine translation models struggle when translating out-of-domain text, which makes domain adaptation a topic of critical importance. However, most domain adaptation methods focus on fine-tuning or training the entire or part of the model…

Computation and Language · Computer Science 2022-04-28 Pedro Henrique Martins , Zita Marinho , André F. T. Martins

Multi-domain Neural Machine Translation (NMT) trains a single model with multiple domains. It is appealing because of its efficacy in handling multiple domains within one model. An ideal multi-domain NMT should learn distinctive domain…

Computation and Language · Computer Science 2022-10-25 Jiyoung Lee , Hantae Kim , Hyunchang Cho , Edward Choi , Cheonbok Park

We present META-MT, a meta-learning approach to adapt Neural Machine Translation (NMT) systems in a few-shot setting. META-MT provides a new approach to make NMT models easily adaptable to many target domains with the minimal amount of…

Computation and Language · Computer Science 2020-04-07 Amr Sharaf , Hany Hassan , Hal Daumé

Multilingual neural machine translation models (MNMT) yield state-of-the-art performance when evaluated on data from a domain and language pair seen at training time. However, when a MNMT model is used to translate under domain shift or to…

Computation and Language · Computer Science 2022-10-24 Wen Lai , Alexandra Chronopoulou , Alexander Fraser

General translation models often still struggle to generate accurate translations in specialized domains. To guide machine translation practitioners and characterize the effectiveness of domain adaptation methods under different data…

Computation and Language · Computer Science 2022-06-03 Virginia Adams , Sandeep Subramanian , Mike Chrzanowski , Oleksii Hrinchuk , Oleksii Kuchaiev

Unsupervised domain adaptation (UDA) aims to learn the unlabeled target domain by transferring the knowledge of the labeled source domain. To date, most of the existing works focus on the scenario of one source domain and one target domain…

Machine Learning · Computer Science 2018-09-18 Huanhuan Yu , Menglei Hu , Songcan Chen

Domain adaptation is one of the prominent strategies for handling both domain shift, that is widely encountered in large-scale land use/land cover map calculation, and the scarcity of pixel-level ground truth that is crucial for supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Sarmad F. Ismael , Koray Kayabol , Erchan Aptoula

Neural networks are known to be data hungry and domain sensitive, but it is nearly impossible to obtain large quantities of labeled data for every domain we are interested in. This necessitates the use of domain adaptation strategies. One…

Computation and Language · Computer Science 2019-10-08 Zi-Yi Dou , Xinyi Wang , Junjie Hu , Graham Neubig

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

The key challenge of multi-domain translation lies in simultaneously encoding both the general knowledge shared across domains and the particular knowledge distinctive to each domain in a unified model. Previous work shows that the standard…

Computation and Language · Computer Science 2019-11-25 Yong Wang , Longyue Wang , Shuming Shi , Victor O. K. Li , Zhaopeng Tu

While deep learning has led to significant advances in visual recognition over the past few years, such advances often require a lot of annotated data. Unsupervised domain adaptation has emerged as an alternative approach that does not…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yunhan Zhao , Haider Ali , Rene Vidal

While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is…

Computation and Language · Computer Science 2021-08-03 Emmanouil Stergiadis , Satendra Kumar , Fedor Kovalev , Pavel Levin

Deep neural networks excel at learning from labeled data and achieve state-of-the-art resultson a wide array of Natural Language Processing tasks. In contrast, learning from unlabeled data, especially under domain shift, remains a…

Computation and Language · Computer Science 2020-10-29 Alan Ramponi , Barbara Plank

Preservation of domain knowledge from the source to target is crucial in any translation workflow. It is common in the translation industry to receive highly specialized projects, where there is hardly any parallel in-domain data. In such…

Computation and Language · Computer Science 2022-09-15 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Unsupervised domain adaptation (UDA) with pre-trained language models (PrLM) has achieved promising results since these pre-trained models embed generic knowledge learned from various domains. However, fine-tuning all the parameters of the…

Computation and Language · Computer Science 2021-11-02 Rongsheng Zhang , Yinhe Zheng , Xiaoxi Mao , Minlie Huang

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan