English
Related papers

Related papers: Cost-effective Framework for Gradual Domain Adapta…

200 papers

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We…

Computation and Language · Computer Science 2021-09-08 Haoran Xu , Seth Ebner , Mahsa Yarmohammadi , Aaron Steven White , Benjamin Van Durme , Kenton Murray

Domain adaptation (DA) aims to transfer knowledge from a label-rich source domain to a related but label-scarce target domain. The conventional DA strategy is to align the feature distributions of the two domains. Recently, increasing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Yixin Zhang , Junjie Li , Zilei Wang

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Unsupervised Domain adaptation methods solve the adaptation problem for an unlabeled target set, assuming that the source dataset is available with all labels. However, the availability of actual source samples is not always possible in…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Vinod K Kurmi , Venkatesh K Subramanian , Vinay P Namboodiri

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two…

Machine Learning · Computer Science 2019-11-20 Qian Wang , Toby P. Breckon

The goal of domain adaptation is to adapt models learned on a source domain to a particular target domain. Most methods for unsupervised domain adaptation proposed in the literature to date, assume that the set of classes present in the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Ayush Mittal , Anant Raj , Vinay P. Namboodiri , Tinne Tuytelaars

Domain adaptation has become a widely adopted approach in machine learning due to the high costs associated with labeling data. It is typically applied when access to a labeled source domain is available. However, in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Amirfarhad Farhadi , Naser Mozayani , Azadeh Zamanifar

Multi-source unsupervised domain adaptation aims to leverage labeled data from multiple source domains for training a machine learning model to generalize well on a target domain without labels. Source domain selection plays a crucial role…

Machine Learning · Computer Science 2024-11-12 Yao Ma , Samuel Louvan , Zhunxuan Wang

We present a novel instance-based approach to handle regression tasks in the context of supervised domain adaptation under an assumption of covariate shift. The approach developed in this paper is based on the assumption that the task on…

Machine Learning · Computer Science 2021-09-16 Antoine de Mathelin , Guillaume Richard , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Domain adaptation (DA) aims to transfer the knowledge learned from a source domain to an unlabeled target domain. Some recent works tackle source-free domain adaptation (SFDA) where only a source pre-trained model is available for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Shiqi Yang , Yaxing Wang , Joost van de Weijer , Luis Herranz , Shangling Jui

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Existing domain adaptation methods aim at learning features that can be generalized among domains. These methods commonly require to update source classifier to adapt to the target domain and do not properly handle the trade off between the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Shaokai Ye , Kailu Wu , Mu Zhou , Yunfei Yang , Sia huat Tan , Kaidi Xu , Jiebo Song , Chenglong Bao , Kaisheng Ma

We consider the problem of domain adaptation in LiDAR-based 3D object detection. Towards this, we propose a simple yet effective training strategy called Gradual Batch Alternation that can adapt from a large labeled source domain to an…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Mrigank Rochan , Xingxin Chen , Alaap Grandhi , Eduardo R. Corral-Soto , Bingbing Liu

Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is a lack of research on how uDA algorithms, particularly those…

Machine Learning · Computer Science 2021-12-28 Shaoduo Gan , Akhil Mathur , Anton Isopoussu , Fahim Kawsar , Nadia Berthouze , Nicholas Lane

Domain adaption (DA) and domain generalization (DG) are two closely related methods which are both concerned with the task of assigning labels to an unlabeled data set. The only dissimilarity between these approaches is that DA can access…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

The performance of a classifier trained on data coming from a specific domain typically degrades when applied to a related but different one. While annotating many samples from the new domain would address this issue, it is often too…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee