English
Related papers

Related papers: Gradual Fine-Tuning with Graph Routing for Multi-S…

200 papers

Domain adaptation aims to generalize a model from a source domain to tackle tasks in a related but different target domain. Traditional domain adaptation algorithms assume that enough labeled data, which are treated as the prior knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Jinfeng Li , Weifeng Liu , Yicong Zhou , Jun Yu , Dapeng Tao

Domain adaptation considers the problem of generalising a model learnt using data from a particular source domain to a different target domain. Often it is difficult to find a suitable single source to adapt from, and one must consider…

Computation and Language · Computer Science 2020-04-20 Xia Cui , Danushka Bollegala

Large pre-trained models have demonstrated extensive applications across various fields. However, fine-tuning these models for specific downstream tasks demands significant computational resources and storage. One fine-tuning method,…

Machine Learning · Computer Science 2025-07-02 Xuanbo Liu , Liu Liu , Fuxiang Wu , Fusheng Hao , Xianglong Liu

Source-free domain adaptation (SFDA) aims to adapt a well-trained source model to an unlabelled target domain without accessing the source dataset, making it applicable in a variety of real-world scenarios. Existing SFDA methods ONLY assess…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Longxiang Tang , Kai Li , Chunming He , Yulun Zhang , Xiu Li

Unsupervised Graph Domain Adaptation (UGDA) has emerged as a practical solution to transfer knowledge from a label-rich source graph to a completely unlabelled target graph. However, most methods require a labelled source graph to provide…

Machine Learning · Computer Science 2024-03-05 Zhen Zhang , Meihan Liu , Anhui Wang , Hongyang Chen , Zhao Li , Jiajun Bu , Bingsheng He

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performance under distribution shifts. Current approaches to robust…

Machine Learning · Computer Science 2024-03-15 Caroline Choi , Yoonho Lee , Annie Chen , Allan Zhou , Aditi Raghunathan , Chelsea Finn

Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We…

Computation and Language · Computer Science 2021-09-08 Haoran Xu , Seth Ebner , Mahsa Yarmohammadi , Aaron Steven White , Benjamin Van Durme , Kenton Murray

Domain adaptation becomes more challenging with increasing gaps between source and target domains. Motivated from an empirical analysis on the reliability of labeled source data for the use of distancing target domains, we propose…

Machine Learning · Computer Science 2021-06-21 Yabin Zhang , Bin Deng , Kui Jia , Lei Zhang

In this paper, we propose a new method called Gradual Domain Osmosis, which aims to solve the problem of smooth knowledge migration from source domain to target domain in Gradual Domain Adaptation (GDA). Traditional Gradual Domain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zixi Wang , Yubo Huang

Standard domain adaptation methods do not work well when a large gap exists between the source and target domains. Gradual domain adaptation is one of the approaches used to address the problem. It involves leveraging the intermediate…

Machine Learning · Statistics 2024-01-24 Shogo Sagawa , Hideitsu Hino

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

Semi-supervised domain adaptation (SSDA) aims to achieve high predictive performance in the target domain with limited labeled target data by exploiting abundant source and unlabeled target data. Despite its significance in numerous…

Machine Learning · Statistics 2025-07-22 Wooseok Ha , Yuansi Chen

Deep neural networks, trained with large amount of labeled data, can fail to generalize well when tested with examples from a \emph{target domain} whose distribution differs from the training data distribution, referred as the \emph{source…

We focus on the problem of domain adaptation when the goal is shifting the model towards the target distribution, rather than learning domain invariant representations. It has been shown that under the following two assumptions: (a) access…

Machine Learning · Computer Science 2021-07-14 Samira Abnar , Rianne van den Berg , Golnaz Ghiasi , Mostafa Dehghani , Nal Kalchbrenner , Hanie Sedghi

Graph Domain Adaptation (GDA) aims to bridge distribution shifts between domains by transferring knowledge from well-labeled source graphs to given unlabeled target graphs. One promising recent approach addresses graph transfer by…

Machine Learning · Computer Science 2026-02-12 Wei Chen , Xingyu Guo , Shuang Li , Yan Zhong , Zhao Zhang , Fuzhen Zhuang , Hongrui Liu , Libang Zhang , Guo Ye , Huimei He

Most domain adaptation methods focus on single-source-single-target adaptation settings. Multi-target domain adaptation is a powerful extension in which a single classifier is learned for multiple unlabeled target domains. To build a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Sudipan Saha , Shan Zhao , Nasrullah Sheikh , Xiao Xiang Zhu

Domain adaptation (DA) aims to transfer the knowledge learned from a source domain to an unlabeled target domain. Some recent works tackle source-free domain adaptation (SFDA) where only a source pre-trained model is available for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Shiqi Yang , Yaxing Wang , Joost van de Weijer , Luis Herranz , Shangling Jui

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao