English
Related papers

Related papers: UDApter -- Efficient Domain Adaptation Using Adapt…

200 papers

A pre-trained language model, BERT, has brought significant performance improvements across a range of natural language processing tasks. Since the model is trained on a large corpus of diverse topics, it shows robust performance for domain…

Computation and Language · Computer Science 2020-10-26 Minho Ryu , Kichun Lee

Fine-tuning and Domain Adaptation emerged as effective strategies for efficiently transferring deep learning models to new target tasks. However, target domain labels are not accessible in many real-world scenarios. This led to the…

Machine Learning · Computer Science 2023-02-13 Andrea Maracani , Raffaello Camoriano , Elisa Maiettini , Davide Talon , Lorenzo Rosasco , Lorenzo Natale

Semantic segmentation networks, which are essential for robotic perception, often suffer from performance degradation when the visual distribution of the deployment environment differs from that of the source dataset on which they were…

Robotics · Computer Science 2026-02-17 Michele Antonazzi , Lorenzo Signorelli , Matteo Luperto , Nicola Basilico

Extensive Unsupervised Domain Adaptation (UDA) studies have shown great success in practice by learning transferable representations across a labeled source domain and an unlabeled target domain with deep models. However, previous works…

Machine Learning · Computer Science 2021-09-03 Muhammad Awais , Fengwei Zhou , Hang Xu , Lanqing Hong , Ping Luo , Sung-Ho Bae , Zhenguo Li

Neural networks are known to be data hungry and domain sensitive, but it is nearly impossible to obtain large quantities of labeled data for every domain we are interested in. This necessitates the use of domain adaptation strategies. One…

Computation and Language · Computer Science 2019-10-08 Zi-Yi Dou , Xinyi Wang , Junjie Hu , Graham Neubig

Recent breakthroughs in scale have enabled the emergence of powerful generative language models, and the ability to fine-tune these models on various tasks by casting them into prompts or instructions. In this landscape, the problem of…

Computation and Language · Computer Science 2025-03-04 Rheeya Uppaal , Yixuan Li , Junjie Hu

Domain shift poses a fundamental challenge in time series analysis, where models trained on source domain often fail dramatically when applied in target domain with different yet similar distributions. While current unsupervised domain…

Machine Learning · Computer Science 2025-08-07 Rongyao Cai , Ming Jin , Qingsong Wen , Kexin Zhang

Pre-trained Language Models (PLMs) exhibit good accuracy and generalization ability across various tasks using self-supervision, but their large size results in high inference latency. Early Exit (EE) strategies handle the issue by allowing…

Computation and Language · Computer Science 2024-10-08 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Feature alignment between domains is one of the mainstream methods for Unsupervised Domain Adaptation (UDA) semantic segmentation. Existing feature alignment methods for semantic segmentation learn domain-invariant features by adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Shuang Wang , Dong Zhao , Yi Li , Chi Zhang , Yuwei Guo , Qi Zang , Biao Hou , Licheng Jiao

Unsupervised domain adaptation (UDA) aims at adapting the model trained on a labeled source-domain dataset to an unlabeled target-domain dataset. The task of UDA on open-set person re-identification (re-ID) is even more challenging as the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yixiao Ge , Feng Zhu , Dapeng Chen , Rui Zhao , Xiaogang Wang , Hongsheng Li

Adapter layers are lightweight, learnable units inserted between transformer layers. Recent work explores using such layers for neural machine translation (NMT), to adapt pre-trained models to new domains or language pairs, training only a…

Computation and Language · Computer Science 2021-10-20 Asa Cooper Stickland , Alexandre Bérard , Vassilina Nikoulina

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

Unsupervised domain adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain. Existing self-training based UDA approaches assign pseudo labels for target data and treat them as ground…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Xiaoqing Guo , Chen Yang , Baopu Li , Yixuan Yuan

In this paper, we propose a simple model referred as Contradistinguisher (CTDR) for unsupervised domain adaptation whose objective is to jointly learn to contradistinguish on unlabeled target domain in a fully unsupervised manner along with…

Machine Learning · Computer Science 2020-06-12 Sourabh Balgi , Ambedkar Dukkipati

Conventional unsupervised domain adaptation (UDA) studies the knowledge transfer between a limited number of domains. This neglects the more practical scenario where data are distributed in numerous different domains in the real world. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xingchao Peng , Yichen Li , Kate Saenko

Recently, anatomical landmark detection has achieved great progresses on single-domain data, which usually assumes training and test sets are from the same domain. However, such an assumption is not always true in practice, which can cause…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Haibo Jin , Haoxuan Che , Hao Chen

We address the Unsupervised Domain Adaptation (UDA) problem in image classification from a new perspective. In contrast to most existing works which either align the data distributions or learn domain-invariant features, we directly learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Qian Wang , Fanlin Meng , Toby P. Breckon

In the absence of labeled target data, unsupervised domain adaptation approaches seek to align the marginal distributions of the source and target domains in order to train a classifier for the target. Unsupervised domain alignment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

Unsupervised domain adaptation (UDA) methods have been broadly utilized to improve the models' adaptation ability in general computer vision. However, different from the natural images, there exist huge semantic gaps for the nuclei from…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Canran Li , Dongnan Liu , Haoran Li , Zheng Zhang , Guangming Lu , Xiaojun Chang , Weidong Cai

This paper addresses unsupervised domain adaptation, the setting where labeled training data is available on a source domain, but the goal is to have good performance on a target domain with only unlabeled data. Like much of previous work,…

Machine Learning · Computer Science 2019-10-01 Yu Sun , Eric Tzeng , Trevor Darrell , Alexei A. Efros