English
Related papers

Related papers: Unsupervised Domain Adaptation using Lexical Trans…

200 papers

Automatic speech recognition models are often adapted to improve their accuracy in a new domain. A potential drawback of model adaptation to new domains is catastrophic forgetting, where the Word Error Rate on the original domain is…

Sound · Computer Science 2022-10-10 Somshubra Majumdar , Shantanu Acharya , Vitaly Lavrukhin , Boris Ginsburg

In this paper, we propose a novel domain adaptation method for the source-free setting. In this setting, we cannot access source data during adaptation, while unlabeled target data and a model pretrained with source data are given. Due to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Masato Ishii , Masashi Sugiyama

Current unsupervised domain adaptation methods can address many types of distribution shift, but they assume data from the source domain is freely available. As the use of pre-trained models becomes more prevalent, it is reasonable to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roshni Sahoo , Divya Shanmugam , John Guttag

We study an unsupervised domain adaptation problem where the source domain consists of subpopulations defined by the binary label $Y$ and a binary background (or environment) $A$. We focus on a challenging setting in which one such…

Machine Learning · Statistics 2026-04-14 Chao Ying , Jun Jin , Haotian Zhang , Qinglong Tian , Yanyuan Ma , Sharon Li , Jiwei Zhao

Conversational agents such as Alexa and Google Assistant constantly need to increase their language understanding capabilities by adding new domains. A massive amount of labeled data is required for training each new domain. While domain…

Computation and Language · Computer Science 2018-08-31 Sungjin Lee , Rahul Jha

Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain-invariant features to decrease the discrepancy between the feature distributions…

Machine Learning · Computer Science 2021-06-30 Yuntao Du , Yinghao Chen , Fengli Cui , Xiaowen Zhang , Chongjun Wang

Domain Adaptation methodologies have shown to effectively generalize from a labeled source domain to a label scarce target domain. Previous research has either focused on unlabeled domain adaptation without any target supervision or…

Machine Learning · Computer Science 2022-02-14 Jonas Sonntag , Gunnar Behrens , Lars Schmidt-Thieme

It has been previously noted that neural machine translation (NMT) is very sensitive to domain shift. In this paper, we argue that this is a dual effect of the highly lexicalized nature of NMT, resulting in failure for sentences with large…

Computation and Language · Computer Science 2019-06-04 Junjie Hu , Mengzhou Xia , Graham Neubig , Jaime Carbonell

Domain adaptation is important in sentiment analysis as sentiment-indicating words vary between domains. Recently, multi-domain adaptation has become more pervasive, but existing approaches train on all available source domains including…

Computation and Language · Computer Science 2017-02-09 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Domain adaptation is an important challenge for neural machine translation. However, the traditional fine-tuning solution requires multiple extra training and yields a high cost. In this paper, we propose a non-tuning paradigm, resolving…

Computation and Language · Computer Science 2022-09-26 Zewei Sun , Qingnan Jiang , Shujian Huang , Jun Cao , Shanbo Cheng , Mingxuan Wang

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Online adaptation to distribution shifts in satellite image segmentation stands as a crucial yet underexplored problem. In this paper, we address source-free and online domain adaptation, i.e., test-time adaptation (TTA), for satellite…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fahim Faisal Niloy , Kishor Kumar Bhaumik , Simon S. Woo

Unsupervised Domain Adaptation aims to learn a model on a source domain with labeled data in order to perform well on unlabeled data of a target domain. Current approaches focus on learning \textit{Domain Invariant Representations}. It…

Machine Learning · Computer Science 2019-07-30 Victor Bouvier , Philippe Very , Céline Hudelot , Clément Chastagnol

Domain adaptation is often hampered by exceedingly small target datasets and inaccessible source data. These conditions are prevalent in speech verification, where privacy policies and/or languages with scarce speech resources limit the…

Sound · Computer Science 2024-06-11 Shlomo Salo Elia , Aviad Malachi , Vered Aharonson , Gadi Pinkas

The most advanced abstractive dialogue summarizers lack generalization ability on new domains and the existing researches for domain adaptation in summarization generally rely on large-scale pre-trainings. To explore the lightweight…

Computation and Language · Computer Science 2022-04-12 Lulu Zhao , Fujia Zheng , Weihao Zeng , Keqing He , Weiran Xu , Huixing Jiang , Wei Wu , Yanan Wu

Unsupervised domain adaptation for semantic segmentation aims to make models trained on synthetic data (source domain) adapt to real images (target domain). Previous feature-level adversarial learning methods only consider adapting models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Hongruixuan Chen , Chen Wu , Yonghao Xu , Bo Du

Norwegian Twitter data poses an interesting challenge for Natural Language Processing (NLP) tasks. These texts are difficult for models trained on standardized text in one of the two Norwegian written forms (Bokm{\aa}l and Nynorsk), as they…

Computation and Language · Computer Science 2022-10-13 Petter Mæhlum , Andre Kåsen , Samia Touileb , Jeremy Barnes

Existing Question Answering (QA) systems limited by the capability of answering questions from unseen domain or any out-of-domain distributions making them less reliable for deployment to real scenarios. Most importantly all the existing QA…

Computation and Language · Computer Science 2023-05-10 Anant Khandelwal

Deep neural networks excel at learning from labeled data and achieve state-of-the-art resultson a wide array of Natural Language Processing tasks. In contrast, learning from unlabeled data, especially under domain shift, remains a…

Computation and Language · Computer Science 2020-10-29 Alan Ramponi , Barbara Plank