English
Related papers

Related papers: Frustratingly Easy Domain Adaptation

200 papers

Large pre-trained models have achieved great success in many natural language processing tasks. However, when they are applied in specific domains, these models suffer from domain shift and bring challenges in fine-tuning and online serving…

Computation and Language · Computer Science 2021-06-30 Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei

State-of-the-art abstractive summarization models generally rely on extensive labeled data, which lowers their generalization ability on domains where such data are not available. In this paper, we present a study of domain adaptation for…

Computation and Language · Computer Science 2021-04-23 Tiezheng Yu , Zihan Liu , Pascale Fung

In this paper, we invest the domain transfer learning problem with multi-instance data. We assume we already have a well-trained multi-instance dictionary and its corresponding classifier from the source domain, which can be used to…

Computer Vision and Pattern Recognition · Computer Science 2016-05-27 Ke Wang , Jiayong Liu , Daniel González

In this paper, we propose a novel domain adaptation method for the source-free setting. In this setting, we cannot access source data during adaptation, while unlabeled target data and a model pretrained with source data are given. Due to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Masato Ishii , Masashi Sugiyama

Over the past decade, domain adaptation has become a widely studied branch of transfer learning that aims to improve performance on target domains by leveraging knowledge from the source domain. Conventional domain adaptation methods often…

Machine Learning · Computer Science 2023-02-24 Zhiqi Yu , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

Domain adaptive pretraining, i.e. the continued unsupervised pretraining of a language model on domain-specific text, improves the modelling of text for downstream tasks within the domain. Numerous real-world applications are based on…

Computation and Language · Computer Science 2021-09-15 Rasmus Kær Jørgensen , Mareike Hartmann , Xiang Dai , Desmond Elliott

Domain adaptation assumes that samples from source and target domains are freely accessible during a training phase. However, such an assumption is rarely plausible in the real-world and possibly causes data-privacy issues, especially when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Youngeun Kim , Donghyeon Cho , Kyeongtak Han , Priyadarshini Panda , Sungeun Hong

Transfer learning techniques are particularly useful in NLP tasks where a sizable amount of high-quality annotated data is difficult to obtain. Current approaches directly adapt a pre-trained language model (LM) on in-domain text before…

Domain adaptation for sentiment analysis is challenging due to the fact that supervised classifiers are very sensitive to changes in domain. The two most prominent approaches to this problem are structural correspondence learning and…

Computation and Language · Computer Science 2018-06-15 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

Domain adaptation becomes more challenging with increasing gaps between source and target domains. Motivated from an empirical analysis on the reliability of labeled source data for the use of distancing target domains, we propose…

Machine Learning · Computer Science 2021-06-21 Yabin Zhang , Bin Deng , Kui Jia , Lei Zhang

Top-performing deep architectures are trained on massive amounts of labeled data. In the absence of labeled data for a certain task, domain adaptation often provides an attractive option given that labeled data of similar nature but from a…

Machine Learning · Statistics 2015-03-02 Yaroslav Ganin , Victor Lempitsky

In this paper, we address the problem of unsupervised Domain Adaptation. The need for such an adaptation arises when the distribution of the target data differs from that which is used to develop the model and the ground truth information…

Machine Learning · Computer Science 2022-10-04 Siddharth Roheda , Ashkan Panahi , Hamid Krim

Over the last years, dictionary learning method has been extensively applied to deal with various computer vision recognition applications, and produced state-of-the-art results. However, when the data instances of a target domain have a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Zhun Zhong , Zongmin Li , Runlin Li , Xiaoxia Sun

Domain adaptation framework of GANs has achieved great progress in recent years as a main successful approach of training contemporary GANs in the case of very limited training data. In this work, we significantly improve this framework by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Aibek Alanov , Vadim Titov , Dmitry Vetrov

We revisit domain adaptation for parsers in the neural era. First we show that recent advances in word representations greatly diminish the need for domain adaptation when the target domain is syntactically similar to the source domain. As…

Computation and Language · Computer Science 2018-05-18 Vidur Joshi , Matthew Peters , Mark Hopkins

Machine translation models struggle when translating out-of-domain text, which makes domain adaptation a topic of critical importance. However, most domain adaptation methods focus on fine-tuning or training the entire or part of the model…

Computation and Language · Computer Science 2022-04-28 Pedro Henrique Martins , Zita Marinho , André F. T. Martins

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

Machine Learning · Computer Science 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

The rapid expansion of texts' volume and diversity presents formidable challenges in multi-domain settings. These challenges are also visible in the Persian name entity recognition (NER) settings. Traditional approaches, either employing a…

Computation and Language · Computer Science 2024-04-04 Parham Abed Azad , Hamid Beigy

Domain Adaptation is the process of alleviating distribution gaps between data from different domains. In this paper, we show that Domain Adaptation methods using pair-wise relationships between source and target domain data can be…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard , Omar Ali Sheikh-Omar , Alexandros Iosifidis

In information retrieval (IR), domain adaptation is the process of adapting a retrieval model to a new domain whose data distribution is different from the source domain. Existing methods in this area focus on unsupervised domain adaptation…

Information Retrieval · Computer Science 2023-07-07 Helia Hashemi , Yong Zhuang , Sachith Sri Ram Kothur , Srivas Prasad , Edgar Meij , W. Bruce Croft