中文
相关论文

相关论文: Bayesian-based Online Label Shift Estimation with …

200 篇论文

The standard supervised learning paradigm works effectively when training data shares the same distribution as the upcoming testing samples. However, this stationary assumption is often violated in real-world applications, especially when…

机器学习 · 计算机科学 2023-01-18 Yong Bai , Yu-Jie Zhang , Peng Zhao , Masashi Sugiyama , Zhi-Hua Zhou

An assumption often made in supervised learning is that the training and testing sets have the same label distribution. However, in real-life scenarios, this assumption rarely holds. For example, medical diagnosis result distributions…

机器学习 · 计算机科学 2026-04-03 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

This paper focuses on supervised and unsupervised online label shift, where the class marginals $Q(y)$ varies but the class-conditionals $Q(x|y)$ remain invariant. In the unsupervised setting, our goal is to adapt a learner, trained on some…

This paper addresses the prevalent issue of label shift in an online setting with missing labels, where data distributions change over time and obtaining timely labels is challenging. While existing methods primarily focus on adjusting or…

机器学习 · 计算机科学 2024-11-01 Ruihan Wu , Siddhartha Datta , Yi Su , Dheeraj Baby , Yu-Xiang Wang , Kilian Q. Weinberger

Label shift refers to the phenomenon where the prior class probability p(y) changes between the training and test distributions, while the conditional probability p(x|y) stays fixed. Label shift arises in settings like medical diagnosis,…

机器学习 · 计算机科学 2020-06-30 Amr Alexandari , Anshul Kundaje , Avanti Shrikumar

In this paper, a high-speed online neural network classifier based on extreme learning machines for multi-label classification is proposed. In multi-label classification, each of the input data sample belongs to one or more than one of the…

机器学习 · 计算机科学 2016-09-06 Rajasekar Venkatesan , Meng Joo Er , Mihika Dave , Mahardhika Pratama , Shiqian Wu

TabPFN has recently gained attention as a foundation model for tabular datasets, achieving strong performance by leveraging in-context learning on synthetic data. However, we find that TabPFN is vulnerable to label shift, often overfitting…

机器学习 · 计算机科学 2026-05-26 Seunghan Lee

Under label shift, the label distribution p(y) might change but the class-conditional distributions p(x|y) do not. There are two dominant approaches for estimating the label marginal. BBSE, a moment-matching approach based on confusion…

机器学习 · 计算机科学 2020-10-20 Saurabh Garg , Yifan Wu , Sivaraman Balakrishnan , Zachary C. Lipton

The label shift problem refers to the supervised learning setting where the train and test label distributions do not match. Existing work addressing label shift usually assumes access to an \emph{unlabelled} test sample. This sample may be…

机器学习 · 计算机科学 2021-08-18 Jingzhao Zhang , Aditya Menon , Andreas Veit , Srinadh Bhojanapalli , Sanjiv Kumar , Suvrit Sra

In this paper we study Bayesian supervised learning models proposed by L\^e in \cite{Le2025}. We show the existence of Bayesian inversions on universal Bayesian supervised learning models $(\mathcal{P}(\mathcal{Y})^{\mathcal{X}}, \mu,…

统计理论 · 数学 2026-05-22 Hông Vân Lê

Important tasks like record linkage and extreme classification demonstrate extreme class imbalance, with 1 minority instance to every 1 million or more majority instances. Obtaining a sufficient sample of all classes, even just to achieve…

机器学习 · 计算机科学 2021-06-03 Neil G. Marchant , Benjamin I. P. Rubinstein

Machine learning models often encounter distribution shifts when deployed in the real world. In this paper, we focus on adaptation to label distribution shift in the online setting, where the test-time label distribution is continually…

机器学习 · 计算机科学 2022-01-06 Ruihan Wu , Chuan Guo , Yi Su , Kilian Q. Weinberger

Machine Learning often involves various imprecise labels, leading to diverse weakly supervised settings. While recent methods aim for universal handling, they usually suffer from complex manual pre-work, ignore the relationships between…

机器学习 · 计算机科学 2026-03-03 Ziquan Wang , Haobo Wang , Ke Chen , Lei Feng , Gang Chen

Semi-supervised learning by self-training heavily relies on pseudo-label selection (PLS). The selection often depends on the initial model fit on labeled data. Early overfitting might thus be propagated to the final model by selecting…

机器学习 · 统计学 2023-06-27 Julian Rodemann , Jann Goschenhofer , Emilio Dorigatti , Thomas Nagler , Thomas Augustin

In real world machine learning applications, testing data may contain some meaningful new categories that have not been seen in labeled training data. To simultaneously recognize new data categories and assign most appropriate category…

机器学习 · 计算机科学 2019-10-11 Changying Du , Fuzhen Zhuang , Jia He , Qing He , Guoping Long

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

机器学习 · 统计学 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

统计理论 · 数学 2024-05-29 Henry W J Reeve

The state-of-the-art online learning models generally conduct a single online gradient descent when a new sample arrives and thus suffer from suboptimal model weights. To this end, we introduce an online broad learning system framework with…

机器学习 · 计算机科学 2025-12-09 Chunyu Lei , Guang-Ze Chen , C. L. Philip Chen , Tong Zhang

We address the problem of active learning under label shift: when the class proportions of source and target domains differ. We introduce a "medial distribution" to incorporate a tradeoff between importance weighting and class-balanced…

机器学习 · 计算机科学 2021-03-01 Eric Zhao , Anqi Liu , Animashree Anandkumar , Yisong Yue

With the success of pre-trained visual-language (VL) models such as CLIP in visual representation tasks, transferring pre-trained models to downstream tasks has become a crucial paradigm. Recently, the prompt tuning paradigm, which draws…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Jingsheng Gao , Jiacheng Ruan , Suncheng Xiang , Zefang Yu , Ke Ji , Mingye Xie , Ting Liu , Yuzhuo Fu
‹ 上一页 1 2 3 10 下一页 ›