English
Related papers

Related papers: Classification of sparse binary vectors

200 papers

In this paper we develop a principled, probabilistic, unified approach to non-standard classification tasks, such as semi-supervised, positive-unlabelled, multi-positive-unlabelled and noisy-label learning. We train a classifier on the…

Machine Learning · Computer Science 2020-06-17 Jeppe Nørregaard , Lars Kai Hansen

In the Naive Bayes classification model the class conditional densities are estimated as the products of their marginal densities along the cardinal basis directions. We study the problem of obtaining an alternative basis for this…

Machine Learning · Statistics 2025-08-19 David P. Hofmeyr , Francois Kamper , Michail C. Melonas

Multi-label learning often requires identifying all relevant labels for training instances, but collecting full label annotations is costly and labor-intensive. In many datasets, only a single positive label is annotated per training…

Machine Learning · Computer Science 2025-09-16 Misgina Tsighe Hagos , Claes Lundström

We consider sequential decision making problems for binary classification scenario in which the learner takes an active role in repeatedly selecting samples from the action pool and receives the binary label of the selected alternatives.…

Machine Learning · Statistics 2015-10-09 Yingfei Wang , Chu Wang , Warren Powell

The objective in extreme multi-label learning is to train a classifier that can automatically tag a novel data point with the most relevant subset of labels from an extremely large label set. Embedding based approaches make training and…

Machine Learning · Computer Science 2015-07-13 Kush Bhatia , Himanshu Jain , Purushottam Kar , Prateek Jain , Manik Varma

Label shift refers to the phenomenon where the prior class probability p(y) changes between the training and test distributions, while the conditional probability p(x|y) stays fixed. Label shift arises in settings like medical diagnosis,…

Machine Learning · Computer Science 2020-06-30 Amr Alexandari , Anshul Kundaje , Avanti Shrikumar

Most positive and unlabeled data is subject to selection biases. The labeled examples can, for example, be selected from the positive set because they are easier to obtain or more obviously positive. This paper investigates how learning can…

Machine Learning · Computer Science 2019-07-01 Jessa Bekker , Pieter Robberechts , Jesse Davis

Predicting all applicable labels for a given image is known as multi-label classification. Compared to the standard multi-class case (where each image has only one label), it is considerably more challenging to annotate training data for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Elijah Cole , Oisin Mac Aodha , Titouan Lorieul , Pietro Perona , Dan Morris , Nebojsa Jojic

This paper addresses binary classification in scenarios where obtaining explicit instance level labels is impractical, by exploiting multiple weak labels defined on instance pairs. The existing SconfConfDiff classification framework relies…

Machine Learning · Computer Science 2026-03-23 Tomoya Tate , Kosuke Sugiyama , Masato Uchida

We develop a worst-case analysis of aggregation of classifier ensembles for binary classification. The task of predicting to minimize error is formulated as a game played over a given set of unlabeled data (a transductive setting), where…

Machine Learning · Computer Science 2015-06-22 Akshay Balsubramani , Yoav Freund

Positive-unlabeled learning (PU learning) is known as a special case of semi-supervised binary classification where only a fraction of positive examples are labeled. The challenge is then to find the correct classifier despite this lack of…

Statistics Theory · Mathematics 2022-01-19 Olivier Coudray , Christine Keribin , Pascal Massart , Patrick Pamphile

We propose a novel sample selection method for image classification in the presence of noisy labels. Existing methods typically consider small-loss samples as correctly labeled. However, some correctly labeled samples are inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Weiran Pan , Wei Wei , Feida Zhu , Yong Deng

It is well known that in a supervised classification setting when the number of features is smaller than the number of observations, Fisher's linear discriminant rule is asymptotically Bayes. However, there are numerous modern applications…

Machine Learning · Statistics 2014-09-17 Irina Gaynanova , James G. Booth , Martin T. Wells

Multiclass classification problems such as image annotation can involve a large number of classes. In this context, confusion between classes can occur, and single label classification may be misleading. We provide in the present paper a…

Statistics Theory · Mathematics 2017-12-19 Christophe Denis , Mohamed Hebiri

Supervised learning needs a huge amount of labeled data, which can be a big bottleneck under the situation where there is a privacy concern or labeling cost is high. To overcome this problem, we propose a new weakly-supervised learning…

Machine Learning · Computer Science 2018-08-16 Han Bao , Gang Niu , Masashi Sugiyama

Popular debiased estimation methods for causal inference -- such as augmented inverse propensity weighting and targeted maximum likelihood estimation -- enjoy desirable asymptotic properties like statistical efficiency and double robustness…

Machine Learning · Statistics 2025-09-16 Tiffany Tianhui Cai , Yuri Fonseca , Kaiwen Hou , Hongseok Namkoong

The expense of acquiring labels in large-scale statistical machine learning makes partially and weakly-labeled data attractive, though it is not always apparent how to leverage such data for model fitting or validation. We present a…

Machine Learning · Statistics 2022-02-10 Maxime Cauchois , Suyash Gupta , Alnur Ali , John Duchi

Quantification, variously called "supervised prevalence estimation" or "learning to quantify", is the supervised learning task of generating predictors of the relative frequencies (a.k.a. "prevalence values") of the classes of interest in…

Machine Learning · Computer Science 2022-11-16 Alejandro Moreo , Manuel Francisco , Fabrizio Sebastiani

In this paper, we study the classification problem in which we have access to easily obtainable surrogate for true labels, namely complementary labels, which specify classes that observations do \textbf{not} belong to. Let $Y$ and $\bar{Y}$…

Machine Learning · Statistics 2018-08-09 Xiyu Yu , Tongliang Liu , Mingming Gong , Dacheng Tao

We investigate probabilistic decoupling of labels supplied for training, from the underlying classes for prediction. Decoupling enables an inference scheme general enough to implement many classification problems, including supervised,…

Machine Learning · Computer Science 2019-05-30 Jeppe Nørregaard , Lars Kai Hansen