English
Related papers

Related papers: A Unified View of Label Shift Estimation

200 papers

Label Proportion Learning (LLP) addresses the classification problem where multiple instances are grouped into bags and each bag contains information about the proportion of each class. However, in practical applications, obtaining precise…

Machine Learning · Computer Science 2025-07-15 Jiahe Qin , Junpeng Li , Changchun Hua , Yana Yang

Maximum Likelihood Estimation (MLE) is the bread and butter of system inference for stochastic systems. In some generality, MLE will converge to the correct model in the infinite data limit. In the context of physical approaches to system…

Machine Learning · Statistics 2020-03-11 Junghyo Jo , Danh-Tai Hoang , Vipul Periwal

Recently, self-supervised metric learning has raised attention for the potential to learn a generic distance function. It overcomes the limitations of conventional supervised one, e.g., scalability and label biases. Despite progress in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jiantao Wu , Shentong Mo , Sara Atito , Josef Kittler , Zhenhua Feng , Muhammad Awais

In the past years, deep learning has seen an increase in usage in the domain of histopathological applications. However, while these approaches have shown great potential, in high-risk environments deep learning models need to be able to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-17 Hendrik A. Mehrtens , Alexander Kurz , Tabea-Clara Bucher , Titus J. Brinker

Noisy multi-label learning has garnered increasing attention due to the challenges posed by collecting large-scale accurate labels, making noisy labels a more practical alternative. Motivated by noisy multi-class learning, the introduction…

Machine Learning · Computer Science 2023-09-25 Shikun Li , Xiaobo Xia , Hansong Zhang , Shiming Ge , Tongliang Liu

List-wise learning to rank methods are considered to be the state-of-the-art. One of the major problems with these methods is that the ambiguous nature of relevance labels in learning to rank data is ignored. Ambiguity of relevance labels…

Information Retrieval · Computer Science 2017-07-26 Rolf Jagerman , Julia Kiseleva , Maarten de Rijke

Semi-Supervised Learning (SSL) has been an effective way to leverage abundant unlabeled data with extremely scarce labeled data. However, most SSL methods are commonly based on instance-wise consistency between different data…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Li Shen , Jun Yu , Bo Han , Tongliang Liu

Classifiers and other statistics-based machine learning (ML) techniques generalize, or learn, based on various statistical properties of the training data. The assumption underlying statistical ML resulting in theoretical or empirical…

Machine Learning · Computer Science 2021-11-11 Samuel Ackerman , Orna Raz , Marcel Zalmanovici , Aviad Zlotnick

The study of model bias and variance with respect to decision boundaries is critically important in supervised classification. There is generally a tradeoff between the two, as fine-tuning of the decision boundary of a classification model…

Machine Learning · Computer Science 2020-02-25 Matthew Almeida , Wei Ding , Scott Crouter , Ping Chen

Statistically consistent methods based on the noise transition matrix ($T$) offer a theoretically grounded solution to Learning with Noisy Labels (LNL), with guarantees of convergence to the optimal clean-data classifier. In practice,…

Machine Learning · Computer Science 2026-03-16 Chen Feng , Zhuo Zhi , Zhao Huang , Jiawei Ge , Ling Xiao , Nicu Sebe , Georgios Tzimiropoulos , Ioannis Patras

In a broad range of classification and decision making problems, one is given the advice or predictions of several classifiers, of unknown reliability, over multiple questions or queries. This scenario is different from the standard…

Machine Learning · Statistics 2014-02-07 Fabio Parisi , Francesco Strino , Boaz Nadler , Yuval Kluger

State-of-the-art pre-trained language models (PLMs) outperform other models when applied to the majority of language processing tasks. However, PLMs have been found to degrade in performance under distribution shift, a phenomenon that…

Computation and Language · Computer Science 2022-12-06 Ayush Singh , John E. Ortega

Multilabel classification is a relatively recent subfield of machine learning. Unlike to the classical approach, where instances are labeled with only one category, in multilabel classification, an arbitrary number of categories is chosen…

Artificial Intelligence · Computer Science 2013-03-01 Alfonso E. Romero , Luis M. de Campos

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

We introduce the problem of domain adaptation under Open Set Label Shift (OSLS) where the label distribution can change arbitrarily and a new class may arrive during deployment, but the class-conditional distributions p(x|y) are…

Machine Learning · Computer Science 2022-10-18 Saurabh Garg , Sivaraman Balakrishnan , Zachary C. Lipton

Classification imbalance arises when one class is much rarer than the other. We frame this setting as transfer learning under label (prior) shift between an imbalanced source distribution induced by the observed data and a balanced target…

Machine Learning · Statistics 2026-01-16 Eric Xia , Jason M. Klusowski

Label switching is a phenomenon arising in mixture model posterior inference that prevents one from meaningfully assessing posterior statistics using standard Monte Carlo procedures. This issue arises due to invariance of the posterior…

Machine Learning · Computer Science 2019-11-12 Pierre Monteiller , Sebastian Claici , Edward Chien , Farzaneh Mirzazadeh , Justin Solomon , Mikhail Yurochkin

Pairwise similarities and dissimilarities between data points might be easier to obtain than fully labeled data in real-world classification problems, e.g., in privacy-aware situations. To handle such pairwise information, an empirical risk…

Machine Learning · Computer Science 2019-04-29 Takuya Shimada , Han Bao , Issei Sato , Masashi Sugiyama

In selective classification (SC), a classifier abstains from making predictions that are likely to be wrong to avoid excessive errors. To deploy imperfect classifiers -- either due to intrinsic statistical noise of data or for robustness…

Machine Learning · Computer Science 2024-11-28 Hengyue Liang , Le Peng , Ju Sun

Multi-source domain adaptation (MSDA) addresses the challenge of learning a label prediction function for an unlabeled target domain by leveraging both the labeled data from multiple source domains and the unlabeled data from the target…

Machine Learning · Computer Science 2025-04-03 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi