English
Related papers

Related papers: Mitigating covariate shift in non-colocated data w…

200 papers

Covariate shift may impact the operational safety performance of neural networks. A re-evaluation of the safety performance, however, requires collecting new operational data and creating corresponding ground truth labels, which often is…

Machine Learning · Computer Science 2023-07-25 Chih-Hong Cheng , Harald Ruess , Konstantinos Theodorou

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Deep learning usually relies on training large-scale data samples to achieve better performance. However, over-fitting based on training data always remains a problem. Scholars have proposed various strategies, such as feature dropping and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Songhao Jiang , Yan Chu , Tianxing Ma , Tianning Zang

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

Machine Learning · Computer Science 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

Despite ongoing theoretical research on cross-validation (CV), many theoretical questions remain widely open. This motivates our investigation into how properties of algorithm-distribution pairs can affect the choice for the number of folds…

Statistics Theory · Mathematics 2026-01-09 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger

Few-shot segmentation performance declines substantially when facing images from a domain different than the training domain, effectively limiting real-world use cases. To alleviate this, recently cross-domain few-shot segmentation (CD-FSS)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jonas Herzog

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Neural networks are among the most powerful nonlinear models used to address supervised learning problems. Similar to most machine learning algorithms, neural networks produce point predictions and do not provide any prediction interval…

Machine Learning · Statistics 2020-07-01 Saeed Khaki , Dan Nettleton

Training sample re-weighting is an effective approach for tackling data biases such as imbalanced and corrupted labels. Recent methods develop learning-based algorithms to learn sample re-weighting strategies jointly with model training…

Machine Learning · Computer Science 2021-09-08 Zizhao Zhang , Tomas Pfister

We are concerned with the vulnerability of computer vision models to distributional shifts. We formulate a combinatorial optimization problem that allows evaluating the regions in the image space where a given model is more vulnerable, in…

Machine Learning · Computer Science 2019-08-21 Riccardo Volpi , Vittorio Murino

We consider the problem of learning high-dimensional, nonparametric and structured (e.g. Gaussian) distributions in distributed networks, where each node in the network observes an independent sample from the underlying distribution and can…

Information Theory · Computer Science 2019-06-04 Leighton Pate Barnes , Yanjun Han , Ayfer Ozgur

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in…

Machine Learning · Statistics 2019-03-01 Adarsh Subbaswamy , Peter Schulam , Suchi Saria

Confounder selection, namely choosing a set of covariates to control for confounding between a treatment and an outcome, is arguably the most important step in the design of an observational study. Previous methods, such as Pearl's…

Methodology · Statistics 2026-03-24 F. Richard Guo , Qingyuan Zhao

This paper presents a reduced-order approach for four-dimensional variational data assimilation, based on a prior EO F analysis of a model trajectory. This method implies two main advantages: a natural model-based definition of a mul…

Federated Learning (FL) enables collaborative model training across multiple clients while preserving data privacy. Traditional FL methods often use a global model to fit all clients, assuming that clients' data are independent and…

Machine Learning · Computer Science 2025-12-01 Dario Fenoglio , Mohan Li , Pietro Barbiero , Nicholas D. Lane , Marc Langheinrich , Martin Gjoreski

Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target…

Machine Learning · Computer Science 2023-11-28 Junyoung Park , Jin Kim , Hyeongjun Kwon , Ilhoon Yoon , Kwanghoon Sohn

Accurate and interpretable bearing fault classification is critical for ensuring the reliability of rotating machinery, particularly under variable operating conditions where domain shifts can significantly degrade model performance. This…

Machine Learning · Computer Science 2025-08-12 Tasfiq E. Alam , Md Manjurul Ahsan , Shivakumar Raman

This paper focuses on the estimation of distributional treatment effects in randomized experiments that use covariate-adaptive randomization (CAR). These include designs such as Efron's biased-coin design and stratified block randomization,…

Econometrics · Economics 2025-06-09 Undral Byambadalai , Tomu Hirata , Tatsushi Oka , Shota Yasui

The high communication cost of sending model updates from the clients to the server is a significant bottleneck for scalable federated learning (FL). Among existing approaches, state-of-the-art bitrate-accuracy tradeoffs have been achieved…

Machine Learning · Computer Science 2024-04-23 Berivan Isik , Francesco Pase , Deniz Gunduz , Sanmi Koyejo , Tsachy Weissman , Michele Zorzi