English
Related papers

Related papers: Distance Matters For Improving Performance Estimat…

200 papers

In the field of Machine Learning (ML) and data-driven applications, one of the significant challenge is the change in data distribution between the training and deployment stages, commonly known as distribution shift. This paper outlines…

Machine Learning · Computer Science 2025-07-30 Lakpa Tamang , Mohamed Reda Bouadjenek , Richard Dazeley , Sunil Aryal

In traditional Machine Learning, the algorithms predictions are based on the assumption that the data follows the same distribution in both the training and the test datasets. However, in real world data this condition does not hold and,…

Machine Learning · Computer Science 2024-02-05 Laura Fdez-Díaz , Sara González Tomillo , Elena Montañés , José Ramón Quevedo

We show that in the context of classification the property of source and target distributions to be related by covariate shift may be lost if the information content captured in the covariates is reduced, for instance by dropping components…

Machine Learning · Statistics 2022-08-16 Dirk Tasche

We propose a novel family of test statistics to detect the presence of changepoints in a sequence of dependent, possibly multivariate, functional-valued observations. Our approach allows to test for a very general class of changepoints,…

Methodology · Statistics 2023-10-10 B. Cooper Boniece , Lajos Horváth , Lorenzo Trapani

Identifying covariate shift is crucial for making machine learning systems robust in the real world and for detecting training data biases that are not reflected in test data. However, detecting covariate shift is challenging, especially…

Machine Learning · Computer Science 2021-08-20 Matthew L. Olson , Thuy-Vy Nguyen , Gaurav Dixit , Neale Ratzlaff , Weng-Keen Wong , Minsuk Kahng

Despite the growing promise of artificial intelligence (AI) in supporting decision-making across domains, fostering appropriate human reliance on AI remains a critical challenge. In this paper, we investigate the utility of exploring…

Human-Computer Interaction · Computer Science 2025-05-26 Min Hun Lee , Martyn Zhe Yu Tok

The problem of distributed dynamic state estimation in wireless sensor networks is studied. Two important properties of local estimates, namely, the consistency and confidence, are emphasized. On one hand, the consistency, which means that…

Information Theory · Computer Science 2016-11-15 Shaocheng Wang , Wei Ren

Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in…

Methodology · Statistics 2024-10-29 Masahiro Kato , Kota Matsui , Ryo Inokuchi

In computational histopathology algorithms now outperform humans on a range of tasks, but to date none are employed for automated diagnoses in the clinic. Before algorithms can be involved in such high-stakes decisions they need to "know…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Lea Goetz

Domain shifts are ubiquitous in machine learning, and can substantially degrade a model's performance when deployed to real-world data. To address this, distribution alignment methods aim to learn feature representations which are invariant…

Machine Learning · Computer Science 2024-10-08 Andrea Napoli , Paul White

Transferring learned patterns from pretrained neural language models has been shown to significantly improve effectiveness across a variety of language-based tasks, meanwhile further tuning on intermediate tasks has been demonstrated to…

Computation and Language · Computer Science 2023-03-01 Alexander Pugantsov , Richard McCreadie

We present machine learning estimators for causal and predictive parameters under covariate shift, where covariate distributions differ between training and target populations. One such parameter is the average effect of a policy that…

Methodology · Statistics 2025-09-23 Victor Chernozhukov , Michael Newey , Whitney K Newey , Rahul Singh , Vasilis Syrgkanis

Covariate shift occurs when the distribution of input features differs between the training and testing phases. In covariate shift, estimating an unknown function's moment is a classical problem that remains under-explored, despite its…

Machine Learning · Statistics 2025-07-01 Zhen Zhang , Xin Liu , Shaoli Wang , Jiaye Teng

In supervised learning, the estimation of prediction error on unlabeled test data is an important task. Existing methods are usually built on the assumption that the training and test data are sampled from the same distribution, which is…

Methodology · Statistics 2022-09-30 Hui Xu , Robert Tibshirani

Supervised deep learning models require significant amount of labeled data to achieve an acceptable performance on a specific task. However, when tested on unseen data, the models may not perform well. Therefore, the models need to be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Akshit Achara , Ram Krishna Pandey

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

Machine Learning · Statistics 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas

We consider a covariate shift problem where one has access to several different training datasets for the same learning problem and a small validation set which possibly differs from all the individual training distributions. This covariate…

Machine Learning · Statistics 2020-07-16 Matthew Faw , Rajat Sen , Karthikeyan Shanmugam , Constantine Caramanis , Sanjay Shakkottai

Dataset shift is common in credit scoring scenarios, and the inconsistency between the distribution of training data and the data that actually needs to be predicted is likely to cause poor model performance. However, most of the current…

Machine Learning · Computer Science 2021-12-21 Hongyi Qian , Baohui Wang , Ping Ma , Lei Peng , Songfeng Gao , You Song

We explore fairness from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sensitive attributes. We…

Machine Learning · Computer Science 2025-12-22 Ruifan Huang , Haixia Liu