English
Related papers

Related papers: Universal Domain Adaptation from Foundation Models…

200 papers

We address the problem of unsupervised domain adaptation (UDA) by learning a cross-domain agnostic embedding space, where the distance between the probability distributions of the two source and target visual domains is minimized. We use…

Machine Learning · Computer Science 2019-09-25 Alex Gabourie , Mohammad Rostami , Philip Pope , Soheil Kolouri , Kyungnam Kim

Recently, large-scale pre-trained vision-language models (e.g. CLIP and ALIGN) have demonstrated remarkable effectiveness in acquiring transferable visual representations. To leverage the valuable knowledge encoded within these models for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Yi Zhang , Ce Zhang , Xueting Hu , Zhihai He

Model compression and knowledge distillation have been successfully applied for cross-architecture and cross-domain transfer learning. However, a key requirement is that training examples are in correspondence across the domains. We show…

Computer Vision and Pattern Recognition · Computer Science 2017-08-30 Jong-Chyi Su , Subhransu Maji

Foundation object detectors such as GLIP and Grounding DINO excel on general-domain data but often degrade in specialized and data-scarce settings like underwater imagery or industrial defects. Typical cross-domain few-shot approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Xu Zhang , Zhe Chen , Jing Zhang , Dacheng Tao

Source-free domain adaptation (SFDA) aims to adapt a source model trained on a fully-labeled source domain to a related but unlabeled target domain. While the source model is a key avenue for acquiring target pseudolabels, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Wenyu Zhang , Li Shen , Chuan-Sheng Foo

Large language models (LLMs) have showcased their capability with few-shot inference known as in-context learning. However, in-domain demonstrations are not always readily available in real scenarios, leading to cross-domain in-context…

Computation and Language · Computer Science 2023-11-21 Quanyu Long , Wenya Wang , Sinno Jialin Pan

Domain adaptation is crucial in many real-world applications where the distribution of the training data differs from the distribution of the test data. Previous Deep Learning-based approaches to domain adaptation need to be trained jointly…

Computation and Language · Computer Science 2017-02-08 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

In recent years, researchers have been paying increasing attention to the threats brought by deep learning models to data security and privacy, especially in the field of domain adaptation. Existing unsupervised domain adaptation (UDA)…

Machine Learning · Computer Science 2021-08-31 Kunhong Wu , Yucheng Shi , Yahong Han , Yunfeng Shao , Bingshuai Li , Qi Tian

Deep neural networks suffer from performance decay when there is domain shift between the labeled source domain and unlabeled target domain, which motivates the research on domain adaptation (DA). Conventional DA methods usually assume that…

Machine Learning · Computer Science 2020-02-10 Sicheng Zhao , Guangzhi Wang , Shanghang Zhang , Yang Gu , Yaxian Li , Zhichao Song , Pengfei Xu , Runbo Hu , Hua Chai , Kurt Keutzer

We propose two methods to make unsupervised domain adaptation (UDA) more parameter efficient using adapters, small bottleneck layers interspersed with every layer of the large-scale pre-trained language model (PLM). The first method…

Computation and Language · Computer Science 2023-02-17 Bhavitvya Malik , Abhinav Ramesh Kashyap , Min-Yen Kan , Soujanya Poria

Unsupervised Domain Adaptation (UDA) aims to adapt a model trained on a labeled source domain to an unlabeled target domain by addressing the domain shift. Existing Unsupervised Domain Adaptation (UDA) methods often fall short in fully…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Junzhou Chen , Xuan Wen , Ronghui Zhang , Bingtao Ren , Di Wu , Zhigang Xu , Danwei Wang

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is to adapt a pre-trained model to novel domains using only…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Kowshik Thopalli , Pavan Turaga , Jayaraman J. Thiagarajan

Federated Learning (FL) offers a framework for training models collaboratively while preserving data privacy of each client. Recently, research has focused on Federated Source-Free Domain Adaptation (FFREEDA), a more realistic scenario…

Machine Learning · Computer Science 2026-03-16 Kosuke Kihara , Junki Mori , Taiki Miyagawa , Akinori F. Ebihara

Unsupervised Domain Adaptation~(UDA) has attracted a surge of interest over the past decade but is difficult to be used in real-world applications. Considering the privacy-preservation issues and security concerns, in this work, we study a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Jiexiang Wang , Chaoqi Chen

This paper introduces Unified Language-driven Zero-shot Domain Adaptation (ULDA), a novel task setting that enables a single model to adapt to diverse target domains without explicit domain-ID knowledge. We identify the constraints in the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Senqiao Yang , Zhuotao Tian , Li Jiang , Jiaya Jia

Universal Domain Adaptation (UniDA) deals with the problem of knowledge transfer between two datasets with domain-shift as well as category-shift. The goal is to categorize unlabeled target samples, either into one of the "known" categories…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Jogendra Nath Kundu , Suvaansh Bhambri , Akshay Kulkarni , Hiran Sarkar , Varun Jampani , R. Venkatesh Babu

Unsupervised domain adaptation (UDA) aims to mitigate the domain shift issue, where the distribution of training (source) data differs from that of testing (target) data. Many models have been developed to tackle this problem, and recently…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Ali Abedi , Q. M. Jonathan Wu , Ning Zhang , Farhad Pourpanah

Foundation models (FMs), that are trained on broad data at scale and are adaptable to a wide range of downstream tasks, have brought large interest in the research community. Benefiting from the diverse data sources such as different…

Computation and Language · Computer Science 2023-02-06 Bo Li , Dongseong Hwang , Zhouyuan Huo , Junwen Bai , Guru Prakash , Tara N. Sainath , Khe Chai Sim , Yu Zhang , Wei Han , Trevor Strohman , Francoise Beaufays

Unsupervised domain adaptation (UDA) is widely used to transfer knowledge from a labeled source domain to an unlabeled target domain with different data distribution. While extensive studies attested that deep learning models are vulnerable…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Jiajin Zhang , Hanqing Chao , Pingkun Yan