English
Related papers

Related papers: RLSbench: Domain Adaptation Under Relaxed Label Sh…

200 papers

Performance of a pre-trained semantic segmentation model is likely to substantially decrease on data from a new domain. We show a pre-trained model can be adapted to unlabelled target domain data by calculating soft-label prototypes under…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ondrej Bohdal , Da Li , Timothy Hospedales

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

Most research on domain adaptation has focused on the purely unsupervised setting, where no labeled examples in the target domain are available. However, in many real-world scenarios, a small amount of labeled target data is available and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Yu Zhang , Gongbo Liang , Nathan Jacobs

Many existing unsupervised domain adaptation (UDA) methods primarily focus on covariate shift, limiting their effectiveness in imbalanced domain adaptation (IDA) where both covariate shift and label shift coexist. Recent IDA methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Xiaona Sun , Zhenyu Wu , Zhiqiang Zhan , Yang Ji

Test-time domain adaptation aims to adapt the model trained on source domains to unseen target domains using a few unlabeled images. Emerging research has shown that the label and domain information is separately embedded in the weight…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yanan Wu , Zhixiang Chi , Yang Wang , Konstantinos N. Plataniotis , Songhe Feng

Unsupervised domain adaptation is critical to many real-world applications where label information is unavailable in the target domain. In general, without further assumptions, the joint distribution of the features and the label is not…

Machine Learning · Computer Science 2025-01-07 Lingjing Kong , Shaoan Xie , Weiran Yao , Yujia Zheng , Guangyi Chen , Petar Stojanov , Victor Akinwande , Kun Zhang

Deep neural network models have demonstrated their effectiveness in classifying multi-label data from various domains. Typically, they employ a training mode that combines mini-batches with optimizers, where each sample is randomly selected…

Machine Learning · Computer Science 2024-03-28 Ao Zhou , Bin Liu , Jin Wang , Grigorios Tsoumakas

Existing works typically treat cross-domain semantic segmentation (CDSS) as a data distribution mismatch problem and focus on aligning the marginal distribution or conditional distribution. However, the label shift issue is unfortunately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Yahao Liu , Jinhong Deng , Jiale Tao , Tong Chu , Lixin Duan , Wen Li

One of the primary challenges in Semi-supervised Domain Adaptation (SSDA) is the skewed ratio between the number of labeled source and target samples, causing the model to be biased towards the source domain. Recent works in SSDA show that…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Abhay Rawat , Isha Dua , Saurav Gupta , Rahul Tallamraju

Most current domain adaptation methods address either covariate shift or label shift, but are not applicable where they occur simultaneously and are confounded with each other. Domain adaptation approaches which do account for such…

Machine Learning · Statistics 2024-11-12 Calvin McCarter

Label shift refers to the phenomenon where the prior class probability p(y) changes between the training and test distributions, while the conditional probability p(x|y) stays fixed. Label shift arises in settings like medical diagnosis,…

Machine Learning · Computer Science 2020-06-30 Amr Alexandari , Anshul Kundaje , Avanti Shrikumar

In the absence of labeled target data, unsupervised domain adaptation approaches seek to align the marginal distributions of the source and target domains in order to train a classifier for the target. Unsupervised domain alignment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

3D human pose estimation is a key component of clinical monitoring systems. The clinical applicability of deep pose estimation models, however, is limited by their poor generalization under domain shifts along with their need for sufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Alexander Bigalke , Lasse Hansen , Jasper Diesel , Carlotta Hennigs , Philipp Rostalski , Mattias P. Heinrich

A central problem in unsupervised domain adaptation is determining what to transfer from labeled source domains to an unlabeled target domain. To handle high-dimensional observations (e.g., images), a line of approaches use deep learning to…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Yan Li , Zijian Li , Yujia Zheng , Guangyi Chen , Kun Zhang

For tabular datasets, the change in the relationship between the label and covariates ($Y|X$-shifts) is common due to missing variables (a.k.a. confounders). Since it is impossible to generalize to a completely new and unknown domain, we…

Machine Learning · Computer Science 2024-10-11 Yibo Zeng , Jiashuo Liu , Henry Lam , Hongseok Namkoong

Distribution shifts are all too common in real-world applications of machine learning. Domain adaptation (DA) aims to address this by providing various frameworks for adapting models to the deployment data without using labels. However, the…

Machine Learning · Computer Science 2023-09-08 Linus Ericsson , Da Li , Timothy M. Hospedales

This paper focuses on supervised and unsupervised online label shift, where the class marginals $Q(y)$ varies but the class-conditionals $Q(x|y)$ remain invariant. In the unsupervised setting, our goal is to adapt a learner, trained on some…

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the…

Machine Learning · Computer Science 2019-06-03 Rui Wang , Guoyin Wang , Ricardo Henao

Domain adaptation has received a lot of attention in recent years, and many algorithms have been proposed with impressive progress. However, it is still not fully explored concerning the joint probability distribution (P(X, Y)) distance for…

Machine Learning · Computer Science 2021-01-26 Wei Wang , Baopu Li , Shuhui Yang , Jing Sun , Zhengming Ding , Junyang Chen , Xiao Dong , Zhihui Wang , Haojie Li

Unsupervised domain adaptation (UDA) refers to a domain adaptation framework in which a learning model is trained based on the labeled samples on the source domain and unlabeled ones in the target domain. The dominant existing methods in…

Machine Learning · Computer Science 2024-12-31 Anh T Nguyen , Lam Tran , Anh Tong , Tuan-Duy H. Nguyen , Toan Tran