English
Related papers

Related papers: Efficient and Provable Algorithms for Covariate Sh…

200 papers

Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs…

Machine Learning · Computer Science 2022-10-12 Manyi Zhang , Yuxin Ren , Zihao Wang , Chun Yuan

Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be…

Machine Learning · Computer Science 2021-10-19 Yunye Gong , Xiao Lin , Yi Yao , Thomas G. Dietterich , Ajay Divakaran , Melinda Gervasio

When training data are distributed across{ time or space,} covariate shift across fragments of training data biases cross-validation, compromising model selection and assessment. We present \textit{Fragmentation-Induced covariate-shift…

Machine Learning · Computer Science 2024-11-12 Behraj Khan , Behroz Mirza , Nouman Durrani , Tahir Syed

Quantification learning deals with the task of estimating the target label distribution under label shift. In this paper, we first present a unifying framework, distribution feature matching (DFM), that recovers as particular instances…

Machine Learning · Statistics 2023-07-04 Bastien Dussap , Gilles Blanchard , Badr-Eddine Chérief-Abdellatif

Class distribution plays an important role in learning deep classifiers. When the proportion of each class in the test set differs from the training set, the performance of classification nets usually degrades. Such a label distribution…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Wenao Ma , Cheng Chen , Shuang Zheng , Jing Qin , Huimao Zhang , Qi Dou

When training data are fragmented across batches or federated-learned across different geographic locations, trained models manifest performance degradation. That degradation partly owes to covariate shift induced by data having been…

Machine Learning · Computer Science 2025-10-07 Behraj Khan , Tahir Qasim Syed

In the covariate shift learning scenario, the training and test covariate distributions differ, so that a predictor's average loss over the training and test distributions also differ. In this work, we explore the potential of extreme…

Machine Learning · Computer Science 2018-03-13 Fulton Wang , Cynthia Rudin

In studies ranging from clinical medicine to policy research, complete data are usually available from a population $\mathscr{P}$, but the quantity of interest is often sought for a related but different population $\mathscr{Q}$ which only…

Methodology · Statistics 2023-07-11 Seong-ho Lee , Yanyuan Ma , Jiwei Zhao

Probabilistic classification of unassociated Fermi-LAT sources using machine learning methods has an implicit assumption that the distributions of associated and unassociated sources are the same as a function of source parameters, which is…

High Energy Astrophysical Phenomena · Physics 2024-01-04 Dmitry V. Malyshev

Many machine learning methods assume that the training and test data follow the same distribution. However, in the real world, this assumption is very often violated. In particular, the phenomenon that the marginal distribution of the data…

Machine Learning · Computer Science 2023-04-20 Masanari Kimura , Hideitsu Hino

We present machine learning estimators for causal and predictive parameters under covariate shift, where covariate distributions differ between training and target populations. One such parameter is the average effect of a policy that…

Methodology · Statistics 2025-09-23 Victor Chernozhukov , Michael Newey , Whitney K Newey , Rahul Singh , Vasilis Syrgkanis

Machine learning systems may encounter unexpected problems when the data distribution changes in the deployment environment. A major reason is that certain combinations of domains and labels are not observed during training but appear in…

Machine Learning · Computer Science 2022-08-04 Yivan Zhang , Jindong Wang , Xing Xie , Masashi Sugiyama

A typical assumption in supervised machine learning is that the train (source) and test (target) datasets follow completely the same distribution. This assumption is, however, often violated in uncertain real-world applications, which…

Machine Learning · Computer Science 2021-08-17 Masahiro Nomura , Yuta Saito

Test-time adaptation (TTA) aims to adapt a pre-trained model to the target domain in a batch-by-batch manner during inference. While label distributions often exhibit imbalances in real-world scenarios, most previous TTA approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sunghyun Park , Seunghan Yang , Jaegul Choo , Sungrack Yun

We study a setting where the goal is to learn a target function f(x) with respect to a target distribution D(x), but training is done on i.i.d. samples from a different training distribution D'(x), labeled by the true target f(x). Such a…

Machine Learning · Computer Science 2026-02-13 Marko Medvedev , Idan Attias , Elisabetta Cornacchia , Theodor Misiakiewicz , Gal Vardi , Nathan Srebro

In this paper we formally analyse the use of sparse filtering algorithms to perform covariate shift adaptation. We provide a theoretical analysis of sparse filtering by evaluating the conditions required to perform covariate shift…

Machine Learning · Computer Science 2017-09-12 Fabio Massimo Zennaro , Ke Chen

Under covariate shift, training (source) data and testing (target) data differ in input space distribution, but share the same conditional label distribution. This poses a challenging machine learning task. Robust Bias-Aware (RBA)…

Machine Learning · Computer Science 2018-01-01 Anqi Liu , Rizal Fathony , Brian D. Ziebart

We consider a covariate shift problem where one has access to several different training datasets for the same learning problem and a small validation set which possibly differs from all the individual training distributions. This covariate…

Machine Learning · Statistics 2020-07-16 Matthew Faw , Rajat Sen , Karthikeyan Shanmugam , Constantine Caramanis , Sanjay Shakkottai

Randomized experiments are the gold standard for estimating the average treatment effect (ATE). While covariate adjustment can reduce the asymptotic variances of the unbiased Horvitz-Thompson estimators for the ATE, it suffers from…

Methodology · Statistics 2025-08-22 Xin Lu , Lei Shi , Hanzhong Liu , Peng Ding

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee