English
Related papers

Related papers: Multi-Class Classification from Single-Class Data …

200 papers

The difficulty of multi-class classification generally increases with the number of classes. Using data from a subset of the classes, can we predict how well a classifier will scale with an increased number of classes? Under the assumptions…

Machine Learning · Statistics 2017-12-29 Charles Zheng , Rakesh Achanta , Yuval Benjamini

In many domains, collecting sufficient labeled training data for supervised machine learning requires easily accessible but noisy sources, such as crowdsourcing services or tagged Web data. Noisy labels occur frequently in data sets…

Machine Learning · Computer Science 2018-11-16 Matthew Klawonn , Eric Heim , James Hendler

Contemporary machine learning applications often involve classification tasks with many classes. Despite their extensive use, a precise understanding of the statistical properties and behavior of classification algorithms is still missing,…

Machine Learning · Computer Science 2020-11-17 Christos Thrampoulidis , Samet Oymak , Mahdi Soltanolkotabi

We study the problem of multi-class classification under system-level constraints expressible as linear functionals over randomized classifiers. We propose a post-processing approach that adjusts a given base classifier to satisfy general…

Optimization and Control · Mathematics 2025-12-17 Evgenii Chzhen , Mohamed Hebiri , Gayane Taturyan

In this paper, a novel pattern classification approach is proposed by regularizing the classifier learning to maximize mutual information between the classification response and the true class label. We argue that, with the learned…

Machine Learning · Computer Science 2014-09-30 Jim Jing-Yan Wang , Yi Wang , Shiguang Zhao , Xin Gao

When dealing with multi-class classification problems, it is common practice to build a model consisting of a series of binary classifiers using a learning paradigm which dictates how the classifiers are built and combined to discriminate…

Machine Learning · Computer Science 2021-01-06 Daniel Cauchi , Adrian Muscat

Empirical risk minimization (ERM), with proper loss function and regularization, is the common practice of supervised classification. In this paper, we study training arbitrary (from linear to deep) binary classifier from only unlabeled (U)…

Machine Learning · Statistics 2019-03-13 Nan Lu , Gang Niu , Aditya Krishna Menon , Masashi Sugiyama

We investigate the problem of multiclass classification with rejection, where a classifier can choose not to make a prediction to avoid critical misclassification. First, we consider an approach based on simultaneous training of a…

Machine Learning · Statistics 2019-10-31 Chenri Ni , Nontawat Charoenphakdee , Junya Honda , Masashi Sugiyama

Complex classifiers may exhibit "embarassing" failures in cases where humans can easily provide a justified classification. Avoiding such failures is obviously of key importance. In this work, we focus on one such setting, where a label is…

Machine Learning · Computer Science 2019-06-14 Deborah Cohen , Amit Daniely , Amir Globerson , Gal Elidan

We study the problem of learning classifiers that perform well across (known or unknown) groups of data. After observing that common worst-group-accuracy datasets suffer from substantial imbalances, we set out to compare state-of-the-art…

Machine Learning · Computer Science 2022-02-21 Badr Youbi Idrissi , Martin Arjovsky , Mohammad Pezeshki , David Lopez-Paz

Many of the best statistical classification algorithms are binary classifiers that can only distinguish between one of two classes. The number of possible ways of generalizing binary classification to multi-class increases exponentially…

Machine Learning · Statistics 2021-01-26 Peter Mills

We propose a method for combining probabilistic outputs of classifiers to make a single consensus class prediction when no further information about the individual classifiers is available, beyond that they have been trained for the same…

Machine Learning · Computer Science 2020-09-02 Jordan F. Masakuna , Simukai W. Utete , Steve Kroon

We present a simple unified framework for multi-class cost-sensitive boosting. The minimum-risk class is estimated directly, rather than via an approximation of the posterior distribution. Our method jointly optimizes binary weak learners…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ron Appel , Xavier Burgos-Artizzu , Pietro Perona

We study the sample complexity of multiclass prediction in several learning settings. For the PAC setting our analysis reveals a surprising phenomenon: In sharp contrast to binary classification, we show that there exist multiclass…

Machine Learning · Computer Science 2016-04-19 Amit Daniely , Sivan Sabato , Shai Ben-David , Shai Shalev-Shwartz

Unsupervised models can provide supplementary soft constraints to help classify new target data under the assumption that similar objects in the target set are more likely to share the same class label. Such models can also help detect…

Machine Learning · Computer Science 2015-03-13 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Badrul Sarwar , Jean-David Ruvini

Few-shot classification refers to learning a classifier for new classes given only a few examples. While a plethora of models have emerged to tackle it, we find the procedure and datasets that are used to assess their progress lacking. To…

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A…

Machine Learning · Statistics 2017-11-15 Takashi Ishida , Gang Niu , Weihua Hu , Masashi Sugiyama

Classification models are very sensitive to data uncertainty, and finding robust classifiers that are less sensitive to data uncertainty has raised great interest in the machine learning literature. This paper aims to construct robust…

Machine Learning · Statistics 2022-03-01 Vali Asimit , Ioannis Kyriakou , Simone Santoni , Salvatore Scognamiglio , Rui Zhu

For many interesting tasks, such as medical diagnosis and web page classification, a learner only has access to some positively labeled examples and many unlabeled examples. Learning from this type of data requires making assumptions about…

Machine Learning · Computer Science 2018-08-28 Jessa Bekker , Jesse Davis

Annotating data for sensitive labels (e.g., disease, smoking) poses a potential threats to individual privacy in many real-world scenarios. To cope with this problem, we propose a novel setting to protect privacy of each instance, namely…

Machine Learning · Computer Science 2024-12-04 Zhongnian Li , Meng Wei , Peng Ying , Tongfeng Sun , Xinzheng Xu