English
Related papers

Related papers: Adapting to Shifting Correlations with Unlabeled D…

200 papers

Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn't generally hold true in a natural setting. Usually, the…

Machine Learning · Computer Science 2021-12-14 Kumud Lakara , Akshat Bhandari , Pratinav Seth , Ujjwal Verma

Safe deployment of graph neural networks (GNNs) under distribution shift requires models to provide accurate confidence indicators (CI). However, while it is well-known in computer vision that CI quality diminishes under distribution shift,…

Machine Learning · Computer Science 2023-09-21 Puja Trivedi , Mark Heimann , Rushil Anirudh , Danai Koutra , Jayaraman J. Thiagarajan

Accurately knowing uncertainties in appearance-based gaze tracking is critical for ensuring reliable downstream applications. Due to the lack of individual uncertainty labels, current uncertainty-aware approaches adopt probabilistic models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven…

Machine Learning · Computer Science 2026-02-10 Ruth Crasto , Esther Rolf

Generalized Canonical Correlation Analysis (GCCA) is an important tool that finds numerous applications in data mining, machine learning, and artificial intelligence. It aims at finding `common' random variables that are strongly correlated…

Machine Learning · Computer Science 2021-05-19 Mikael Sørensen , Charilaos I. Kanatsoulis , Nicholas D. Sidiropoulos

We study the task of unsupervised domain adaptation, where no labeled data from the target domain is provided during training time. To deal with the potential discrepancy between the source and target distributions, both in features and…

Machine Learning · Computer Science 2017-10-03 Cuong D. Tran , Ognjen Rudovic , Vladimir Pavlovic

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

A primary challenge facing modern scientific research is the limited availability of gold-standard data which can be costly, labor-intensive, or invasive to obtain. With the rapid development of machine learning (ML), scientists can now…

Methodology · Statistics 2024-09-17 Jiacheng Miao , Xinran Miao , Yixuan Wu , Jiwei Zhao , Qiongshi Lu

Many algorithms and applications involve repeatedly solving variations of the same inference problem; for example we may want to introduce new evidence to the model or perform updates to conditional dependencies. The goal of adaptive…

Data Structures and Algorithms · Computer Science 2012-06-18 Umut A. Acar , Alexander T. Ihler , Ramgopal Mettu , Ozgur Sumer

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

Minimizing expected loss measured by a proper scoring rule, such as Brier score or log-loss (cross-entropy), is a common objective while training a probabilistic classifier. If the data have experienced dataset shift where the class…

Machine Learning · Computer Science 2021-11-05 Theodore James Thibault Heiser , Mari-Liis Allikivi , Meelis Kull

Unsupervised Graph Domain Adaptation (UGDA) has emerged as a practical solution to transfer knowledge from a label-rich source graph to a completely unlabelled target graph. However, most methods require a labelled source graph to provide…

Machine Learning · Computer Science 2024-03-05 Zhen Zhang , Meihan Liu , Anhui Wang , Hongyang Chen , Zhao Li , Jiajun Bu , Bingsheng He

Varying domains and biased datasets can lead to differences between the training and the target distributions, known as covariate shift. Current approaches for alleviating this often rely on estimating the ratio of training and target…

Machine Learning · Statistics 2020-10-27 Bijan Mazaheri , Siddharth Jain , Jehoshua Bruck

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

Machine Learning · Computer Science 2024-12-17 Giorgio Morales , John Sheppard

For a long time, anomaly localization has been widely used in industries. Previous studies focused on approximating the distribution of normal features without adaptation to a target dataset. However, since anomaly localization should…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Sungwook Lee , Seunghyun Lee , Byung Cheol Song

Covariance tapering is a popular approach for reducing the computational cost of spatial prediction and parameter estimation for Gaussian process models. However, tapering can have poor performance when the process is sampled at spatially…

Computation · Statistics 2016-02-22 David Bolin , Jonas Wallin

We consider the problem of unsupervised domain adaptation (UDA) between a source and a target domain under conditional and label shift a.k.a Generalized Target Shift (GeTarS). Unlike simpler UDA settings, few works have addressed this…

Machine Learning · Computer Science 2022-03-21 Matthieu Kirchmeyer , Alain Rakotomamonjy , Emmanuel de Bezenac , Patrick Gallinari

Modeling non-stationary data is a challenging problem in the field of continual learning, and data distribution shifts may result in negative consequences on the performance of a machine learning model. Classic learning tools are often…

Machine Learning · Computer Science 2024-10-23 Sebastián Basterrech , Line Clemmensen , Gerardo Rubino

Real-world image recognition systems often face corrupted input images, which cause distribution shifts and degrade the performance of models. These systems often use a single prediction model in a central server and process images sent…

Machine Learning · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi , Atsutoshi Kumagai

Machine learning algorithms typically assume that training and test examples are drawn from the same distribution. However, distribution shift is a common problem in real-world applications and can cause models to perform dramatically worse…

Machine Learning · Computer Science 2022-06-22 Huaxiu Yao , Yu Wang , Sai Li , Linjun Zhang , Weixin Liang , James Zou , Chelsea Finn