English
Related papers

Related papers: Optimal Aggregation of Prediction Intervals under …

200 papers

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

Machine Learning · Statistics 2025-04-29 Steve Hanneke , Samory Kpotufe

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Conformal Prediction is a machine learning methodology that produces valid prediction regions under mild conditions. In this paper, we explore the application of making predictions over multiple data sources of different sizes without…

Machine Learning · Statistics 2018-06-15 Ola Spjuth , Lars Carlsson , Niharika Gauraha

Constructing prediction sets with coverage guarantees for unobserved outcomes is a core problem in modern statistics. Methods for predictive inference have been developed for a wide range of settings, but usually only consider test data…

Methodology · Statistics 2025-07-11 Yonghoon Lee , Eric Tchetgen Tchetgen , Edgar Dobriban

We consider unsupervised domain adaptation (UDA) for classification problems in the presence of missing data in the unlabelled target domain. More precisely, motivated by practical applications, we analyze situations where distribution…

Machine Learning · Computer Science 2021-09-21 Matthieu Kirchmeyer , Patrick Gallinari , Alain Rakotomamonjy , Amin Mantrach

Most predictive models assume that training and test data are generated from a stationary process. However, this assumption does not hold true in practice. In this paper, we consider the scenario of a gradual concept drift due to the…

Machine Learning · Computer Science 2020-02-12 Subhro Das , Prasanth Lade , Soundar Srinivasan

Universal domain adaptation (UniDA) aims to transfer the knowledge from a labeled source domain to an unlabeled target domain without any assumptions of the label sets, which requires distinguishing the unknown samples from the known ones…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Yifan Wang , Lin Zhang , Ran Song , Paul L. Rosin , Yibin Li , Wei Zhang

Predicting outcomes in external domains is challenging due to hidden confounders that potentially influence both predictors and outcomes. Well-established methods frequently rely on stringent assumptions, explicit knowledge about the…

Methodology · Statistics 2025-10-14 Carlos García Meixide , David Ríos Insua

In domain adaptation, when there is a large distance between the source and target domains, the prediction performance will degrade. Gradual domain adaptation is one of the solutions to such an issue, assuming that we have access to…

Machine Learning · Statistics 2022-11-11 Shogo Sagawa , Hideitsu Hino

Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributions of the source and…

Machine Learning · Computer Science 2022-03-08 Yi-Ming Zhai , You-Wei Luo

It is increasingly common to encounter time-varying random fields on networks (metabolic networks, sensor arrays, distributed computing, etc.). This paper considers the problem of optimal, nonlinear prediction of these fields, showing from…

Probability · Mathematics 2022-02-17 Cosma Rohilla Shalizi

Current unsupervised domain adaptation methods can address many types of distribution shift, but they assume data from the source domain is freely available. As the use of pre-trained models becomes more prevalent, it is reasonable to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roshni Sahoo , Divya Shanmugam , John Guttag

In this paper, we introduce a novel unsupervised domain adaptation technique for the task of 3D keypoint prediction from a single depth scan or image. Our key idea is to utilize the fact that predictions from different views of the same or…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Xingyi Zhou , Arjun Karpur , Chuang Gan , Linjie Luo , Qixing Huang

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

One of the key challenges of learning an online recommendation model is the temporal domain shift, which causes the mismatch between the training and testing data distribution and hence domain generalization error. To overcome, we propose…

Temporal domain generalization is a promising yet extremely challenging area where the goal is to learn models under temporally changing data distributions and generalize to unseen data distributions following the trends of the change. The…

Machine Learning · Computer Science 2023-02-13 Guangji Bai , Chen Ling , Liang Zhao

Existing domain adaptation methods aim to reduce the distributional difference between the source and target domains and respect their specific discriminative information, by establishing the Maximum Mean Discrepancy (MMD) and the…

Machine Learning · Computer Science 2020-07-03 Wei Wang , Haojie Li , Zhengming Ding , Zhihui Wang

The aim of this paper is to propose a suitable method for constructing prediction intervals for the output of neural network models. To do this, we adapt the extremely randomized trees method originally developed for random forests to…

Machine Learning · Statistics 2021-05-14 Tullio Mancini , Hector Calvo-Pardo , Jose Olmo

When learning a mapping from an input space to an output space, the assumption that the sample distribution of the training data is the same as that of the test data is often violated. Unsupervised domain shift methods adapt the learned…

Machine Learning · Computer Science 2017-03-07 Tomer Galanti , Lior Wolf

We consider the problem of constructing distribution-free prediction sets with finite-sample conditional guarantees. Prior work has shown that it is impossible to provide exact conditional coverage universally in finite samples. Thus, most…

Methodology · Statistics 2024-09-18 Isaac Gibbs , John J. Cherian , Emmanuel J. Candès