English
Related papers

Related papers: Adapting to Online Label Shift with Provable Guara…

200 papers

We study online active learning for classifying streaming instances within the framework of statistical learning theory. At each time, the learner either queries the label of the current instance or predicts the label based on past seen…

Machine Learning · Computer Science 2020-11-17 Boshuang Huang , Sudeep Salgia , Qing Zhao

Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right…

Machine Learning · Computer Science 2023-08-24 Xudong Wang , Long Lian , Stella X. Yu

We show that label noise exists in adversarial training. Such label noise is due to the mismatch between the true label distribution of adversarial examples and the label inherited from clean examples - the true label distribution is…

Machine Learning · Computer Science 2023-10-17 Chengyu Dong , Liyuan Liu , Jingbo Shang

Real-world reinforcement learning often faces environment drift, but most existing methods rely on static entropy coefficients/target entropy, causing over-exploration during stable periods and under-exploration after drift, and leaving…

Machine Learning · Computer Science 2026-05-19 Tongxi Wang , Zhuoyang Xia , Xinran Chen , Shan Liu

Log anomaly detection (LAD) is essential to ensure safe and stable operation of software systems. Although current LAD methods exhibit significant potential in addressing challenges posed by unstable log events and temporal sequence…

Software Engineering · Computer Science 2024-10-23 Jiyu Tian , Mingchu Li , Zumin Wang , Liming Chen , Jing Qin , Runfa Zhang

We study the problem of learning a latent variable model from a stream of data. Latent variable models are popular in practice because they can explain observed data in terms of unobserved concepts. These models have been traditionally…

Machine Learning · Computer Science 2018-04-27 Tong Yu , Branislav Kveton , Zheng Wen , Hung Bui , Ole J. Mengshoel

In machine learning, one must acquire labels to help supervise a model that will be able to generalize to unseen data. However, the labeling process can be tedious, long, costly, and error-prone. It is often the case that most of our data…

Machine Learning · Computer Science 2020-09-29 Bruno Klaus de Aquino Afonso , Lilian Berton

Real-world data inevitably contains noisy labels, which induce the poor generalization of deep neural networks. It is known that the network typically begins to rapidly memorize false-labeled samples after a certain point of training. Thus,…

Machine Learning · Computer Science 2021-06-08 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Covariate shift, a widely used assumption in tackling {\it distributional shift} (when training and test distributions differ), focuses on scenarios where the distribution of the labels conditioned on the feature vector is the same, but the…

Machine Learning · Computer Science 2025-02-24 Deeksha Adil , Jarosław Błasiok

Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs…

Machine Learning · Computer Science 2022-10-12 Manyi Zhang , Yuxin Ren , Zihao Wang , Chun Yuan

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

Machine Learning · Computer Science 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

Despite the emergence of principled methods for domain adaptation under label shift, their sensitivity to shifts in class conditional distributions is precariously under explored. Meanwhile, popular deep domain adaptation heuristics tend to…

Machine Learning · Computer Science 2023-06-06 Saurabh Garg , Nick Erickson , James Sharpnack , Alex Smola , Sivaraman Balakrishnan , Zachary C. Lipton

An unsupervised online streaming model is considered where samples arrive in an online fashion over $T$ slots. There are $M$ classifiers, whose confusion matrices are unknown a priori. In each slot, at most one sample can be labeled by any…

Machine Learning · Computer Science 2021-12-06 R. Vaze , Santanu Rathod

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. Recently, there are robust learning methods aiming at this…

Machine Learning · Computer Science 2021-05-12 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li , Yishi Lin

Event-based semantic segmentation has gained popularity due to its capability to deal with scenarios under high-speed motion and extreme lighting conditions, which cannot be addressed by conventional RGB cameras. Since it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Linglin Jing , Yiming Ding , Yunpeng Gao , Zhigang Wang , Xu Yan , Dong Wang , Gerald Schaefer , Hui Fang , Bin Zhao , Xuelong Li

In this paper we revisit the risk bounds of the lasso estimator in the context of transductive and semi-supervised learning. In other terms, the setting under consideration is that of regression with random design under partial labeling.…

Statistics Theory · Mathematics 2016-11-09 Pierre C. Bellec , Arnak S. Dalalyan , Edwin Grappin , Quentin Paris

One of the more challenging real-world problems in computational intelligence is to learn from non-stationary streaming data, also known as concept drift. Perhaps even a more challenging version of this scenario is when -- following a small…

Machine Learning · Computer Science 2020-12-01 Muhammad Umer , Robi Polikar

In this work, we revisit the semi-supervised learning (SSL) problem from a new perspective of explicitly reducing empirical distribution mismatch between labeled and unlabeled samples. Benefited from this new perspective, we first propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Feiyu Wang , Qin Wang , Wen Li , Dong Xu , Luc Van Gool

Unsupervised domain adaptation aiming to learn a specific task for one domain using another domain data has emerged to address the labeling issue in supervised learning, especially because it is difficult to obtain massive amounts of…

Machine Learning · Computer Science 2019-03-13 Jaeyoon Yoo , Changhwa Park , Yongjun Hong , Sungroh Yoon

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim