English
Related papers

Related papers: Robust Label Shift Quantification

200 papers

Quantification, variously called "supervised prevalence estimation" or "learning to quantify", is the supervised learning task of generating predictors of the relative frequencies (a.k.a. "prevalence values") of the classes of interest in…

Machine Learning · Computer Science 2022-11-16 Alejandro Moreo , Manuel Francisco , Fabrizio Sebastiani

We discuss recently developed methods that quantify the stability and generalizability of statistical findings under distributional changes. In many practical problems, the data is not drawn i.i.d. from the target population. For example,…

Methodology · Statistics 2023-10-05 Dominik Rothenhäusler , Peter Bühlmann

A natural way of estimating heteroscedastic label noise in regression is to model the observed (potentially noisy) target as a sample from a normal distribution, whose parameters can be learned by minimizing the negative log-likelihood.…

Machine Learning · Computer Science 2023-08-15 Erik Englesson , Amir Mehrpanah , Hossein Azizpour

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

Deep-learning-based NLP models are found to be vulnerable to word substitution perturbations. Before they are widely adopted, the fundamental issues of robustness need to be addressed. Along this line, we propose a formal framework to…

Computation and Language · Computer Science 2022-01-12 Yuting Yang , Pei Huang , FeiFei Ma , Juan Cao , Meishan Zhang , Jian Zhang , Jintao Li

In some industrial applications such as fraud detection, the performance of common supervision techniques may be affected by the poor quality of the available labels : in actual operational use-cases, these labels may be weak in quantity,…

Machine Learning · Computer Science 2021-06-22 Hugo Le Baher , Vincent Lemaire , Romain Trinquart

In this paper we provide a novel approach to the analysis of kinetic models for label switching, which are used for particle systems that can randomly switch between gradient flows in different energy landscapes. Besides problems in biology…

Analysis of PDEs · Mathematics 2022-12-09 Martin Burger , Alex Rossi

We investigate probabilistic decoupling of labels supplied for training, from the underlying classes for prediction. Decoupling enables an inference scheme general enough to implement many classification problems, including supervised,…

Machine Learning · Computer Science 2019-05-30 Jeppe Nørregaard , Lars Kai Hansen

We consider the parameter estimation problem of a probabilistic generative model prescribed using a natural exponential family of distributions. For this problem, the typical maximum likelihood estimator usually overfits under limited…

Machine Learning · Statistics 2020-10-13 Viet Anh Nguyen , Xuhui Zhang , Jose Blanchet , Angelos Georghiou

We study the problem of learning generalized linear models under adversarial corruptions. We analyze a classical heuristic called the iterative trimmed maximum likelihood estimator which is known to be effective against label corruptions in…

Machine Learning · Computer Science 2022-10-25 Pranjal Awasthi , Abhimanyu Das , Weihao Kong , Rajat Sen

Robustness to natural distribution shifts has seen remarkable progress thanks to recent pre-training strategies combined with better fine-tuning methods. However, such fine-tuning assumes access to large amounts of labelled data, and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Aaditya Singh , Kartik Sarangmath , Prithvijit Chattopadhyay , Judy Hoffman

We study distributional robustness in the context of Extreme Value Theory (EVT). We provide a data-driven method for estimating extreme quantiles in a manner that is robust against incorrect model assumptions underlying the application of…

Statistics Theory · Mathematics 2020-06-09 Jose Blanchet , Fei He , Karthyek R. A. Murthy

Label embedding is a framework for multiclass classification problems where each label is represented by a distinct vector of some fixed dimension, and training involves matching model output to the vector representing the correct label.…

Machine Learning · Computer Science 2025-09-01 Jianxin Zhang , Clayton Scott

Datasets may contain observations with multiple labels. If the labels are not mutually exclusive, and if the labels vary greatly in frequency, obtaining a sample that includes sufficient observations with scarcer labels to make inferences…

Machine Learning · Computer Science 2026-05-27 Simon Chung , Colby J. Vorland , Donna L. Maney , Andrew W. Brown

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

Machine Learning · Computer Science 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

Identifying and handling label errors can significantly enhance the accuracy of supervised machine learning models. Recent approaches for identifying label errors demonstrate that a low self-confidence of models with respect to a certain…

Machine Learning · Computer Science 2024-05-17 Johannes Jakubik , Michael Vössing , Manil Maskey , Christopher Wölfle , Gerhard Satzger

We consider a distributed source coding system in which several observations are communicated to the decoder using limited transmission rate. The observations must be separately coded. We introduce a robust distributed coding scheme which…

Information Theory · Computer Science 2007-07-13 Jun Chen , Toby Berger

In a binary classification problem where the goal is to fit an accurate predictor, the presence of corrupted labels in the training data set may create an additional challenge. However, in settings where likelihood maximization is poorly…

Statistics Theory · Mathematics 2021-06-18 Yonghoon Lee , Rina Foygel Barber

Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating…

Machine Learning · Computer Science 2016-06-21 Amirhossein Akbarnejad , Mahdieh Soleymani Baghshah

Robust estimators of location and dispersion are often used in the elliptical model to obtain an uncontaminated and highly representative subsample by trimming the data outside an ellipsoid based in the associated Mahalanobis distance. Here…

Statistics Theory · Mathematics 2016-08-14 Juan A. Cuesta-Albertos , Carlos Matrán , Agustín Mayo-Iscar