English
Related papers

Related papers: IDANI: Inference-time Domain Adaptation via Neuron…

200 papers

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Youshan Zhang , Brian D. Davison

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Domain adaptation techniques have contributed to the success of deep learning. Leveraging knowledge from an auxiliary source domain for learning in labeled data-scarce target domain is fundamental to domain adaptation. While these…

Machine Learning · Computer Science 2022-05-25 Vidhya Kamakshi , Narayanan C Krishnan

Active domain adaptation (ADA) aims to improve the model adaptation performance by incorporating active learning (AL) techniques to label a maximally-informative subset of target samples. Conventional AL methods do not consider the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Duojun Huang , Jichang Li , Weikai Chen , Junshi Huang , Zhenhua Chai , Guanbin Li

We propose two methods to make unsupervised domain adaptation (UDA) more parameter efficient using adapters, small bottleneck layers interspersed with every layer of the large-scale pre-trained language model (PLM). The first method…

Computation and Language · Computer Science 2023-02-17 Bhavitvya Malik , Abhinav Ramesh Kashyap , Min-Yen Kan , Soujanya Poria

Catastrophic forgetting makes neural network models unstable when learning visual domains consecutively. The neural network model drifts to catastrophic forgetting-induced low performance of previously learnt domains when training with new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sayan Rakshit , Hmrishav Bandyopadhyay , Nibaran Das , Biplab Banerjee

(Unsupervised) Domain Adaptation (DA) seeks for classifying target instances when solely provided with source labeled and target unlabeled examples for training. Learning domain-invariant features helps to achieve this goal, whereas it…

Machine Learning · Computer Science 2019-07-09 Ziliang Chen , Jingyu Zhuang , Xiaodan Liang , Liang Lin

Unsupervised domain adaptive object detection aims to adapt detectors from a labelled source domain to an unlabelled target domain. Most existing works take a two-stage strategy that first generates region proposals and then detects objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Dayan Guan , Jiaxing Huang , Aoran Xiao , Shijian Lu , Yanpeng Cao

We develop an algorithm to improve the performance of a pre-trained model under concept shift without retraining the model from scratch when only unannotated samples of initial concepts are accessible. We model this problem as a domain…

Machine Learning · Computer Science 2022-11-22 Mohammad Rostami , Aram Galstyan

Domain adaptation (DA) has drawn high interests for its capacity to adapt a model trained on labeled source data to perform well on unlabeled or weakly labeled target data from a different domain. Most common DA techniques require the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Mathilde Bateson , Hoel Kervadec , Jose Dolz , Herve Lombaert , Ismail Ben Ayed

Domain adaptation is an active area of research driven by the growing demand for robust machine learning models that perform well on real-world data. Adversarial learning for deep neural networks (DNNs) has emerged as a promising approach…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Eugene Choi , Julian Rodriguez , Edmund Young

By injecting adversarial examples into training data, adversarial training is promising for improving the robustness of deep learning models. However, most existing adversarial training approaches are based on a specific type of adversarial…

Machine Learning · Computer Science 2019-03-18 Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

Annotating large scale datasets to train modern convolutional neural networks is prohibitively expensive and time-consuming for many real tasks. One alternative is to train the model on labeled synthetic datasets and apply it in the real…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yuhu Shan , Wen Feng Lu , Chee Meng Chew

Deep Learning (DL) models proved themselves to perform extremely well on a wide variety of learning tasks, as they can learn useful patterns from large data sets. However, purely data-driven models might struggle when very difficult…

Machine Learning · Computer Science 2020-05-22 Andrea Borghesi , Federico Baldo , Michela Milano

Continuous appearance shifts such as changes in weather and lighting conditions can impact the performance of deployed machine learning models. While unsupervised domain adaptation aims to address this challenge, current approaches do not…

Machine Learning · Statistics 2018-02-27 Markus Wulfmeier , Alex Bewley , Ingmar Posner

Unsupervised Domain Adaptation (UDA) aims to harness labeled source data to train models for unlabeled target data. Despite extensive research in domains like computer vision and natural language processing, UDA remains underexplored for…

Machine Learning · Computer Science 2025-07-29 Hassan Ismail Fawaz , Ganesh Del Grosso , Tanguy Kerdoncuff , Aurelie Boisbunon , Illyyne Saffar

Large language models (LLMs) have showcased their capability with few-shot inference known as in-context learning. However, in-domain demonstrations are not always readily available in real scenarios, leading to cross-domain in-context…

Computation and Language · Computer Science 2023-11-21 Quanyu Long , Wenya Wang , Sinno Jialin Pan

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

Machine Learning · Computer Science 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

Unsupervised domain adaptation (UDA) aims at inferring class labels for unlabeled target domain given a related labeled source dataset. Intuitively, a model trained on source domain normally produces higher uncertainties for unseen data. In…

Machine Learning · Computer Science 2019-07-26 Ligong Han , Yang Zou , Ruijiang Gao , Lezi Wang , Dimitris Metaxas