English
Related papers

Related papers: Cross-Domain Uncertainty Quantification for Select…

200 papers

While most ML models expect independent and identically distributed data, this assumption is often violated in real-world scenarios due to distribution shifts, resulting in the degradation of machine learning model performance. Until now,…

Machine Learning · Computer Science 2024-11-19 Kai Helli , David Schnurr , Noah Hollmann , Samuel Müller , Frank Hutter

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach learns a conditional generative model separately for each…

Machine Learning · Statistics 2026-02-03 Yikun Zhang , Steven Wilkins-Reeves , Wesley Lee , Aude Hofleitner

Transfer learning has achieved promising results by leveraging knowledge from the source domain to annotate the target domain which has few or none labels. Existing methods often seek to minimize the distribution divergence between domains,…

Machine Learning · Computer Science 2018-07-03 Jindong Wang , Yiqiang Chen , Shuji Hao , Wenjie Feng , Zhiqi Shen

Accurately credit default prediction faces challenges due to imbalanced data and low correlation between features and labels. Existing default prediction studies on the basis of gradient boosting decision trees (GBDT), deep learning…

Computational Engineering, Finance, and Science · Computer Science 2023-12-06 Yandan Tan , Hongbin Zhu , JieWu , Hongfeng Chai

When a source-trained model $Q$ is replaced by a model $\tilde{Q}$ trained on shifted data, its performance on the source domain can change unpredictably. To address this, we study the two-model risk change, $\Delta R := R_P(\tilde{Q}) -…

Machine Learning · Computer Science 2026-02-12 Hosein Anjidani , S. Yahya S. R. Tehrani , Mohammad Mahdi Mojahedian , Mohammad Hossein Yassaee

The advent of large-scale self-supervised learning (SSL) has produced a vast zoo of medical foundation models. However, selecting optimal medical foundation models for specific segmentation tasks remains a computational bottleneck. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiaqi Tang , Shaoyang Zhang , Xiaoqi Wang , Jiaying Zhou , Yang Liu , Qingchao Chen

Generalizing treatment effects from a randomized trial to a target population requires the assumption that potential outcome distributions are invariant across populations after conditioning on observed covariates. This assumption fails…

Methodology · Statistics 2026-04-16 Amir Asiaee , Samhita Pal , Cole Beck , Jared D. Huling

Recent years have experienced increasing utilization of complex machine learning models across multiple sources of data to inform more generalizable decision-making. However, distribution shifts across data sources and privacy concerns…

Methodology · Statistics 2024-05-16 Yi Liu , Alexander W. Levis , Sharon-Lise Normand , Larry Han

Reachability analysis of neural networks, which seeks to compute or bound the set of outputs attainable over a given input domain, is central to certifying safety and robustness in learning-enabled physical systems. Since exact reachable…

Machine Learning · Computer Science 2026-05-12 Taha Entesari , Mahyar Fazlyab

We revisit the classical problem of universal prediction of stochastic sequences with a finite time horizon $T$ known to the learner. The question we investigate is whether it is possible to derive vanishing regret bounds that hold with…

Machine Learning · Computer Science 2026-02-19 Matthias Frey , Jonathan H. Manton , Jingge Zhu

We address the overlooked unbiasedness in existing long-tailed classification methods: we find that their overall improvement is mostly attributed to the biased preference of tail over head, as the test distribution is assumed to be…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Beier Zhu , Yulei Niu , Xian-Sheng Hua , Hanwang Zhang

The correlated probabilistic model introduced and analytically discussed in Hanel et al (2009) is based on a self-dual transformation of the index $q$ which characterizes a current generalization of Boltzmann-Gibbs statistical mechanics,…

Statistical Mechanics · Physics 2022-11-23 Dario Javier Zamora , Constantino Tsallis

We consider the problem of conformal prediction under covariate shift. Given labeled data from a source domain and unlabeled data from a covariate shifted target domain, we seek to construct prediction sets with valid marginal coverage in…

Machine Learning · Statistics 2025-07-02 Sunay Joshi , Shayan Kiyani , George Pappas , Edgar Dobriban , Hamed Hassani

Predictive models are often required to produce reliable predictions under statistical conditions that are not matched to the training data. A common type of training-testing mismatch is covariate shift, where the conditional distribution…

Machine Learning · Computer Science 2025-01-22 Matteo Zecchin , Fredrik Hellström , Sangwoo Park , Shlomo Shamai , Osvaldo Simeone

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

Machine Learning · Computer Science 2024-06-14 Jiawei Huang , Niao He

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

Machine Learning · Computer Science 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

We study the gap-dependent bounds of two important algorithms for on-policy Q-learning for finite-horizon episodic tabular Markov Decision Processes (MDPs): UCB-Advantage (Zhang et al. 2020) and Q-EarlySettled-Advantage (Li et al. 2021).…

Machine Learning · Statistics 2025-03-11 Zhong Zheng , Haochen Zhang , Lingzhou Xue

Traditional statistical and machine learning methods typically assume that the training and test data follow the same distribution. However, this assumption is frequently violated in real-world applications, where the training data in the…

Methodology · Statistics 2025-07-08 Hanxuan Ye , Hongzhe Li

We study the problem of conditional predictive inference on multiple outcomes missing at random (MAR) -- or equivalently, under covariate shift. While the weighted conformal prediction offers a tool for inference under covariate shift with…

Methodology · Statistics 2025-08-01 Yonghoon Lee , Edgar Dobriban , Eric Tchetgen Tchetgen

We prove risk bounds for binary classification in high-dimensional settings when the sample size is allowed to be smaller than the dimensionality of the training set observations. In particular, we prove upper bounds for both 'compressive…

Statistics Theory · Mathematics 2017-09-29 Ata Kaban , Robert J. Durrant