English
Related papers

Related papers: Efficient Inference under Label Shift in Unsupervi…

200 papers

Machine learning models are being increasingly used to automate decisions in almost every domain, and ensuring the performance of these models is crucial for ensuring high quality machine learning enabled services. Ensuring concept drift is…

Machine Learning · Statistics 2025-09-30 Nelvin Tan , Yu-Ching Shih , Dong Yang , Amol Salunkhe

Current unsupervised domain adaptation methods can address many types of distribution shift, but they assume data from the source domain is freely available. As the use of pre-trained models becomes more prevalent, it is reasonable to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roshni Sahoo , Divya Shanmugam , John Guttag

Generalising deep networks to novel domains without manual labels is challenging to deep learning. This problem is intrinsically difficult due to unpredictable changing nature of imagery data distributions in novel domains. Pre-learned…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Jiabo Huang , Shaogang Gong

An assumption often made in supervised learning is that the training and testing sets have the same label distribution. However, in real-life scenarios, this assumption rarely holds. For example, medical diagnosis result distributions…

Machine Learning · Computer Science 2026-04-03 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

The current trend in automatic speech recognition is to leverage large amounts of labeled data to train supervised neural network models. Unfortunately, obtaining data for a wide range of domains to train robust models can be costly.…

Computation and Language · Computer Science 2018-06-14 Wei-Ning Hsu , Hao Tang , James Glass

This paper addresses unsupervised domain adaptation, the setting where labeled training data is available on a source domain, but the goal is to have good performance on a target domain with only unlabeled data. Like much of previous work,…

Machine Learning · Computer Science 2019-10-01 Yu Sun , Eric Tzeng , Trevor Darrell , Alexei A. Efros

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

Unsupervised Domain Adaptation (DA) is used to automatize the task of labeling data: an unlabeled dataset (target) is annotated using a labeled dataset (source) from a related domain. We cast domain adaptation as the problem of finding…

Machine Learning · Statistics 2018-03-22 Twan van Laarhoven , Elena Marchiori

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain…

Machine Learning · Statistics 2016-03-28 Ozan Sener , Hyun Oh Song , Ashutosh Saxena , Silvio Savarese

Unsupervised pretraining has achieved great success and many recent works have shown unsupervised pretraining can achieve comparable or even slightly better transfer performance than supervised pretraining on downstream target datasets. But…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Suichan Li , Dongdong Chen , Yinpeng Chen , Lu Yuan , Lei Zhang , Qi Chu , Bin Liu , Nenghai Yu

Recently there has been a surge of interest to deploy confidence set predictions rather than point predictions in machine learning. Unfortunately, the effectiveness of such prediction sets is frequently impaired by distribution shifts in…

Machine Learning · Computer Science 2025-08-14 Kevin Kasa , Zhiyu Zhang , Heng Yang , Graham W. Taylor

Statistical machine learning methods often face the challenge of limited data available from the population of interest. One remedy is to leverage data from auxiliary source populations, which share some conditional distributions or are…

Methodology · Statistics 2024-06-11 Hongxiang Qiu , Eric Tchetgen Tchetgen , Edgar Dobriban

Unsupervised Domain Adaptation (UDA) aims to learn a predictor model for an unlabeled domain by transferring knowledge from a separate labeled source domain. However, most of these conventional UDA approaches make the strong assumption of…

Machine Learning · Computer Science 2021-04-06 Sk Miraj Ahmed , Dripta S. Raychaudhuri , Sujoy Paul , Samet Oymak , Amit K. Roy-Chowdhury

Category discovery methods aim to find novel categories in unlabeled visual data. At training time, a set of labeled and unlabeled images are provided, where the labels correspond to the categories present in the images. The labeled data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Bingchen Zhao , Nico Lang , Serge Belongie , Oisin Mac Aodha

Generalization of machine learning models trained on a set of source domains on unseen target domains with different statistics, is a challenging problem. While many approaches have been proposed to solve this problem, they only utilize…

Machine Learning · Computer Science 2021-07-20 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Label-efficient time series representation learning, which aims to learn effective representations with limited labeled data, is crucial for deploying deep learning models in real-world applications. To address the scarcity of labeled time…

Machine Learning · Computer Science 2024-07-25 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

We address the problem of unsupervised domain adaptation when the source domain differs from the target domain because of a shift in the distribution of a latent subgroup. When this subgroup confounds all observed data, neither covariate…

In modern machine learning applications, frequent encounters of covariate shift and label scarcity have posed challenges to robust model training and evaluation. Numerous transfer learning methods have been developed to robustly adapt the…

Methodology · Statistics 2022-11-22 Linshanshan Wang , Xuan Wang , Katherine P. Liao , Tianxi Cai

Test-time domain adaptation aims to adapt the model trained on source domains to unseen target domains using a few unlabeled images. Emerging research has shown that the label and domain information is separately embedded in the weight…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yanan Wu , Zhixiang Chi , Yang Wang , Konstantinos N. Plataniotis , Songhe Feng

In this paper, we investigate a challenging unsupervised domain adaptation setting -- unsupervised model adaptation. We aim to explore how to rely only on unlabeled target data to improve performance of an existing source prediction model…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Rui Li , Qianfen Jiao , Wenming Cao , Hau-San Wong , Si Wu