English
Related papers

Related papers: Mitigating covariate shift in non-colocated data w…

200 papers

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in…

Methodology · Statistics 2024-10-29 Masahiro Kato , Kota Matsui , Ryo Inokuchi

We propose a simple, statistically principled, and theoretically justified method to improve supervised learning when the training set is not representative, a situation known as covariate shift. We build upon a well-established methodology…

Machine Learning · Statistics 2025-03-12 Maximilian Autenrieth , David A. van Dyk , Roberto Trotta , David C. Stenning

Billions of people use chopsticks, a simple yet versatile tool, for fine manipulation of everyday objects. The small, curved, and slippery tips of chopsticks pose a challenge for picking up small objects, making them a suitably complex test…

Robotics · Computer Science 2020-11-16 Liyiming Ke , Jingqiang Wang , Tapomayukh Bhattacharjee , Byron Boots , Siddhartha Srinivasa

We study nonparametric regression under covariate shift with structured data, where a small amount of labeled target data is supplemented by a large labeled source dataset. In many real-world settings, the covariates in the target domain…

Statistics Theory · Mathematics 2025-07-02 Yuyao Wang , Nabarun Deb , Debarghya Mukherjee

Covariate shift occurs when the distribution of input features differs between the training and testing phases. In covariate shift, estimating an unknown function's moment is a classical problem that remains under-explored, despite its…

Machine Learning · Statistics 2025-07-01 Zhen Zhang , Xin Liu , Shaoli Wang , Jiaye Teng

We consider a covariate shift problem where one has access to several different training datasets for the same learning problem and a small validation set which possibly differs from all the individual training distributions. This covariate…

Machine Learning · Statistics 2020-07-16 Matthew Faw , Rajat Sen , Karthikeyan Shanmugam , Constantine Caramanis , Sanjay Shakkottai

Predictive models are typically trained on historical data to predict future outcomes. While it is commonly assumed that training on more historical data would improve model performance and robustness, data distribution shifts over time may…

Computers and Society · Computer Science 2025-09-05 Chengyuan Yao , Yunxuan Tang , Christopher Brooks , Rene F. Kizilcec , Renzhe Yu

We present machine learning estimators for causal and predictive parameters under covariate shift, where covariate distributions differ between training and target populations. One such parameter is the average effect of a policy that…

Methodology · Statistics 2025-09-23 Victor Chernozhukov , Michael Newey , Whitney K Newey , Rahul Singh , Vasilis Syrgkanis

Foundation models like CLIP and SAM have advanced computer vision and medical imaging via low-shot transfer learning, aiding CADD with limited data. However, their deployment faces two key challenges. \textit{distribution shift} where…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Behraj Khan , Tahir Qasim Syed , Nouman M. Durrani , Bilal Naseem , Shabir Ahmad , Rizwan Qureshi

Federated learning is a distributed machine learning approach which enables a shared server model to learn by aggregating the locally-computed parameter updates with the training data from spatially-distributed client silos. Though…

Machine Learning · Computer Science 2022-05-20 Mike He Zhu , Léna Néhale Ezzine , Dianbo Liu , Yoshua Bengio

Eliminating the covariate shift cross domains is one of the common methods to deal with the issue of domain shift in visual unsupervised domain adaptation. However, current alignment methods, especially the prototype based or sample-level…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yin Zhao , Minquan Wang , Longjun Cai

Training Deep Neural Networks is complicated by the fact that the distribution of each layer's inputs changes during training, as the parameters of the previous layers change. This slows down the training by requiring lower learning rates…

Machine Learning · Computer Science 2015-03-03 Sergey Ioffe , Christian Szegedy

A central challenge in training classification models in the real-world federated system is learning with non-IID data. To cope with this, most of the existing works involve enforcing regularization in local optimization or improving the…

Machine Learning · Computer Science 2021-10-29 Mi Luo , Fei Chen , Dapeng Hu , Yifan Zhang , Jian Liang , Jiashi Feng

Federated learning aims to learn a global model collaboratively while the training data belongs to different clients and is not allowed to be exchanged. However, the statistical heterogeneity challenge on non-IID data, such as class…

Machine Learning · Computer Science 2023-04-12 Yunheng Shen , Haoxiang Wang , Hairong Lv

Symbolic Regression remains an NP-Hard problem, with extensive research focusing on AI models for this task. Transformer models have shown promise in Symbolic Regression, but performance suffers with smaller datasets. We propose applying…

Machine Learning · Computer Science 2025-07-01 Kaustubh Kislay , Shlok Singh , Soham Joshi , Rohan Dutta , Jay Shim , George Flint , Kevin Zhu

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

Shifts in data distribution can substantially harm the performance of clinical AI models and lead to misdiagnosis. Hence, various methods have been developed to detect the presence of such shifts at deployment time. However, the root causes…

Artificial Intelligence · Computer Science 2025-06-23 Mélanie Roschewitz , Raghav Mehta , Charles Jones , Ben Glocker

Federated learning (FL) is a distributed learning paradigm that maximizes the potential of data-driven models for edge devices without sharing their raw data. However, devices often have non-independent and identically distributed (non-IID)…

Machine Learning · Computer Science 2023-08-31 Zijian Li , Zehong Lin , Jiawei Shao , Yuyi Mao , Jun Zhang