English
Related papers

Related papers: Label Shift Estimation With Incremental Prior Upda…

200 papers

Label shift refers to the phenomenon where the prior class probability p(y) changes between the training and test distributions, while the conditional probability p(x|y) stays fixed. Label shift arises in settings like medical diagnosis,…

Machine Learning · Computer Science 2020-06-30 Amr Alexandari , Anshul Kundaje , Avanti Shrikumar

Class distribution plays an important role in learning deep classifiers. When the proportion of each class in the test set differs from the training set, the performance of classification nets usually degrades. Such a label distribution…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Wenao Ma , Cheng Chen , Shuang Zheng , Jing Qin , Huimao Zhang , Qi Dou

Under label shift, the label distribution p(y) might change but the class-conditional distributions p(x|y) do not. There are two dominant approaches for estimating the label marginal. BBSE, a moment-matching approach based on confusion…

Machine Learning · Computer Science 2020-10-20 Saurabh Garg , Yifan Wu , Sivaraman Balakrishnan , Zachary C. Lipton

The label shift problem refers to the supervised learning setting where the train and test label distributions do not match. Existing work addressing label shift usually assumes access to an \emph{unlabelled} test sample. This sample may be…

Machine Learning · Computer Science 2021-08-18 Jingzhao Zhang , Aditya Menon , Andreas Veit , Srinadh Bhojanapalli , Sanjiv Kumar , Suvrit Sra

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

Faced with distribution shift between training and test set, we wish to detect and quantify the shift, and to correct our classifiers without test set labels. Motivated by medical diagnosis, where diseases (targets) cause symptoms…

Machine Learning · Computer Science 2018-07-27 Zachary C. Lipton , Yu-Xiang Wang , Alex Smola

Prediction sets capture uncertainty by predicting sets of labels rather than individual labels, enabling downstream decisions to conservatively account for all plausible outcomes. Conformal inference algorithms construct prediction sets…

Machine Learning · Statistics 2023-10-20 Wenwen Si , Sangdon Park , Insup Lee , Edgar Dobriban , Osbert Bastani

In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities and the classifier…

Machine Learning · Computer Science 2023-12-15 Teodora Popordanoska , Gorjan Radevski , Tinne Tuytelaars , Matthew B. Blaschko

A common assumption in semi-supervised learning is that the labeled, unlabeled, and test data are drawn from the same distribution. However, this assumption is not satisfied in many applications. In many scenarios, the data is collected…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Mahed Abroshan , Mohammad Mahdi Khalili , Laura Toni , Miguel R. D. Rodrigues

We conduct an extensive study on the state of calibration under real-world dataset shift for image classification. Our work provides important insights on the choice of post-hoc and in-training calibration techniques, and yields practical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Mélanie Roschewitz , Raghav Mehta , Fabio de Sousa Ribeiro , Ben Glocker

Label shift, a prevalent challenge in supervised learning, arises when the class prior distribution of test data differs from that of training data, leading to significant degradation in classifier performance. To accurately estimate the…

Machine Learning · Computer Science 2025-12-01 Jiawei Hu , Javier A. Barria

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

This paper addresses the prevalent issue of label shift in an online setting with missing labels, where data distributions change over time and obtaining timely labels is challenging. While existing methods primarily focus on adjusting or…

Machine Learning · Computer Science 2024-11-01 Ruihan Wu , Siddhartha Datta , Yi Su , Dheeraj Baby , Yu-Xiang Wang , Kilian Q. Weinberger

We study the domain adaptation problem with label shift in this work. Under the label shift context, the marginal distribution of the label varies across the training and testing datasets, while the conditional distribution of features…

Machine Learning · Statistics 2023-05-31 Qinglong Tian , Xin Zhang , Jiwei Zhao

In many real-world applications, researchers aim to deploy models trained in a source domain to a target domain, where obtaining labeled data is often expensive, time-consuming, or even infeasible. While most existing literature assumes…

Methodology · Statistics 2025-08-26 Seong-ho Lee , Yanyuan Ma , Jiwei Zhao

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

We study the open-set label shift problem, where the test data may include a novel class absent from training. This setting is challenging because both the class proportions and the distribution of the novel class are not identifiable…

Methodology · Statistics 2025-09-19 Siyan Liu , Yukun Liu , Qinglong Tian , Pengfei Li , Jing Qin

As a prominent challenge in addressing real-world issues within a dynamic environment, label shift, which refers to the learning setting where the source (training) and target (testing) label distributions do not match, has recently…

Machine Learning · Computer Science 2024-11-06 Ruidong Fan , Xiao Ouyang , Hong Tao , Yuhua Qian , Chenping Hou

Changes in the data distribution at test time can have deleterious effects on the performance of predictive models $p(y|x)$. We consider situations where there are additional meta-data labels (such as group labels), denoted by $z$, that can…

Machine Learning · Statistics 2023-11-30 Qingyao Sun , Kevin Murphy , Sayna Ebrahimi , Alexander D'Amour

We propose an evaluation framework for class probability estimates (CPEs) in the presence of label uncertainty, which is commonly observed as diagnosis disagreement between experts in the medical domain. We also formalize evaluation metrics…

Machine Learning · Statistics 2021-03-23 Takahiro Mimori , Keiko Sasada , Hirotaka Matsui , Issei Sato
‹ Prev 1 2 3 10 Next ›