English
Related papers

Related papers: Factorizable joint shift revisited

200 papers

Factorizable joint shift (FJS) was recently proposed as a type of dataset shift for which the complete characteristics can be estimated from feature data observations on the test dataset by a method called Joint Importance Aligning. For the…

Machine Learning · Statistics 2022-09-19 Dirk Tasche

Existing domain adaptation (DA) usually assumes the domain shift comes from either the covariates or the labels. However, in real-world applications, samples selected from different domains could have biases in both the covariates and the…

Machine Learning · Computer Science 2022-04-12 Hao He , Yuzhe Yang , Hao Wang

Sparse joint shift (SJS) was recently proposed as a tractable model for general dataset shift which may cause changes to the marginal distributions of features and labels as well as the posterior probabilities and the class-conditional…

Machine Learning · Statistics 2024-06-25 Dirk Tasche

Deployed machine learning (ML) models often encounter new user data that differs from their training data. Therefore, estimating how well a given model might perform on the new data is an important step toward reliable ML applications. This…

Machine Learning · Statistics 2022-09-20 Lingjiao Chen , Matei Zaharia , James Zou

We study the problem of class distribution estimation under dataset shift. On the training dataset, both features and class labels are observed while on the test dataset only the features can be observed. The task then is the estimation of…

Machine Learning · Computer Science 2023-11-30 Dirk Tasche

Covariate shift, a widely used assumption in tackling {\it distributional shift} (when training and test distributions differ), focuses on scenarios where the distribution of the labels conditioned on the feature vector is the same, but the…

Machine Learning · Computer Science 2025-02-24 Deeksha Adil , Jarosław Błasiok

In this paper, a unified approach is presented to transfer learning that addresses several source and target domain label-space and annotation assumptions with a single model. It is particularly effective in handling a challenging case,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Xiaobin Chang , Yongxin Yang , Tao Xiang , Timothy M. Hospedales

In many practical applications of machine learning, a discrepancy often arises between a source distribution from which labeled training examples are drawn and a target distribution for which only unlabeled data is observed. Traditionally,…

Machine Learning · Statistics 2025-03-05 Paweł Teisseyre , Jan Mielniczuk

Distributed and federated learning are important tools for high-dimensional classification of large datasets. To reduce computational costs and overcome the curse of dimensionality, feature screening plays a pivotal role in eliminating…

Machine Learning · Statistics 2025-06-03 Qi Qin , Erbo Li , Xingxiang Li , Yifan Sun , Wu Wang , Chen Xu

Machine learning typically relies on the assumption that training and testing distributions are identical and that data is centrally stored for training and testing. However, in real-world scenarios, distributions may differ significantly…

Machine Learning · Computer Science 2025-08-22 Ying Li , Xingwei Wang , Rongfei Zeng , Praveen Kumar Donta , Ilir Murturi , Min Huang , Schahram Dustdar

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

Adversarial learning has demonstrated good performance in the unsupervised domain adaptation setting, by learning domain-invariant representations. However, recent work has shown limitations of this approach when label distributions differ…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Han Zhao , Yu-Xiang Wang , Geoff Gordon

An open scientific challenge is how to classify events with reliable measures of uncertainty, when we have a mechanistic model of the data-generating process but the distribution over both labels and latent nuisance parameters is different…

Machine Learning · Statistics 2024-07-02 Luca Masserano , Alex Shen , Michele Doro , Tommaso Dorigo , Rafael Izbicki , Ann B. Lee

Federated Learning (FL) enables collaborative model training across decentralized clients without sharing raw data, yet faces significant challenges in real-world settings where client data distributions evolve dynamically over time. This…

Machine Learning · Computer Science 2025-09-26 Rahul Atul Bhope , K. R. Jayaram , Praveen Venkateswaran , Nalini Venkatasubramanian

Most current domain adaptation methods address either covariate shift or label shift, but are not applicable where they occur simultaneously and are confounded with each other. Domain adaptation approaches which do account for such…

Machine Learning · Statistics 2024-11-12 Calvin McCarter

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated learning (FL) is a popular distributed learning framework that can reduce privacy risks by not explicitly sharing private data. In this work, we explicitly uncover external covariate shift problem in FL, which is caused by the…

Machine Learning · Computer Science 2023-10-31 Zhixu Du , Jingwei Sun , Ang Li , Pin-Yu Chen , Jianyi Zhang , Hai "Helen" Li , Yiran Chen

Obtaining rigorous statistical guarantees for generalization under distribution shift remains an open and active research area. We study a setting we call combinatorial distribution shift, where (a) under the test- and…

Machine Learning · Computer Science 2023-08-01 Max Simchowitz , Abhishek Gupta , Kaiqing Zhang

Quantification learning deals with the task of estimating the target label distribution under label shift. In this paper, we first present a unifying framework, distribution feature matching (DFM), that recovers as particular instances…

Machine Learning · Statistics 2023-07-04 Bastien Dussap , Gilles Blanchard , Badr-Eddine Chérief-Abdellatif

Many existing approaches to generalizing statistical inference amidst distribution shift operate under the covariate shift assumption, which posits that the conditional distribution of unobserved variables given observable ones is invariant…

Applications · Statistics 2024-12-13 Ying Jin , Naoki Egami , Dominik Rothenhäusler
‹ Prev 1 2 3 10 Next ›