English
Related papers

Related papers: On Classification-Calibration of Gamma-Phi Losses

200 papers

We consider high-dimensional multiclass classification by sparse multinomial logistic regression. Unlike binary classification, in the multiclass setup one can think about an entire spectrum of possible notions of sparsity associated with…

Statistics Theory · Mathematics 2023-01-18 Tomer Levy , Felix Abramovich

We study a generalization of boosting to the multiclass setting. We introduce a weak learning condition for multiclass classification that captures the original notion of weak learnability as being "slightly better than random guessing". We…

Machine Learning · Computer Science 2023-07-04 Nataly Brukhim , Amit Daniely , Yishay Mansour , Shay Moran

This paper discusses the problem of weakly supervised classification, in which instances are given weak labels that are produced by some label-corruption process. The goal is to derive conditions under which loss functions for weak-label…

Machine Learning · Statistics 2021-06-14 Shuhei M. Yoshida , Takashi Takenouchi , Masashi Sugiyama

The goal of binary classification is to estimate a discriminant function $\gamma$ from observations of covariate vectors and corresponding binary labels. We consider an elaboration of this problem in which the covariates are not available…

Statistics Theory · Mathematics 2009-09-29 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

Detecting fraudulent auto-insurance claims remains a challenging classification problem, largely due to the extreme imbalance between legitimate and fraudulent cases. Standard learning algorithms tend to overfit to the majority class,…

Machine Learning · Computer Science 2026-01-26 Francis Boabang , Samuel Asante Gyamerah

Classification algorithms in machine learning often assume a flat label space. However, most real world data have dependencies between the labels, which can often be captured by using a hierarchy. Utilizing this relation can help develop a…

Machine Learning · Computer Science 2020-06-09 Palash Goyal , Shalini Ghosh

In this work, we propose a PAC-Bayes bound for the generalization risk of the Gibbs classifier in the multi-class classification framework. The novelty of our work is the critical use of the confusion matrix of a classifier as an error…

Machine Learning · Statistics 2013-10-23 Emilie Morvant , Sokol Koço , Liva Ralaivola

Medical images commonly exhibit multiple abnormalities. Predicting them requires multi-class classifiers whose training and desired reliable performance can be affected by a combination of factors, such as, dataset size, data source,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-16 Sivaramakrishnan Rajaraman , Ghada Zamzmi , Sameer Antani

The class-wise training losses often diverge as a result of the various levels of intra-class and inter-class appearance variation, and we find that the diverging class-wise training losses cause the uncalibrated prediction with its…

Machine Learning · Computer Science 2023-06-21 Seungjin Jung , Seungmo Seo , Yonghyun Jeong , Jongwon Choi

Multi-label Classification (MLC) assigns an instance to one or more non-exclusive classes. A challenge arises when the dataset contains a large proportion of instances with no assigned class, referred to as negative data, which can…

Machine Learning · Computer Science 2025-06-09 Dumindu Tissera , Omar Awadallah , Muhammad Umair Danish , Ayan Sadhu , Katarina Grolinger

The focal loss has demonstrated its effectiveness in many real-world applications such as object detection and image classification, but its theoretical understanding has been limited so far. In this paper, we first prove that the focal…

When minimizing the empirical risk in binary classification, it is a common practice to replace the zero-one loss with a surrogate loss to make the learning objective feasible to optimize. Examples of well-known surrogate losses for binary…

Machine Learning · Statistics 2023-06-07 Nontawat Charoenphakdee , Jongyeong Lee , Masashi Sugiyama

We consider optimization of generalized performance metrics for binary classification by means of surrogate losses. We focus on a class of metrics, which are linear-fractional functions of the false positive and false negative rates…

Machine Learning · Computer Science 2016-10-10 Wojciech Kotłowski , Krzysztof Dembczyński

Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering…

Machine Learning · Computer Science 2024-05-24 Xinyu Guo , Kai Wu , Xiaoyu Zhang , Jing Liu

In multi-label classification, where the evaluation of predictions is less straightforward than in single-label classification, various meaningful, though different, loss functions have been proposed. Ideally, the learning algorithm should…

Machine Learning · Computer Science 2020-06-25 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz , Vu-Linh Nguyen , Eyke Hüllermeier

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A…

Machine Learning · Statistics 2017-11-15 Takashi Ishida , Gang Niu , Weihua Hu , Masashi Sugiyama

Although binary classification is a well-studied problem in computer vision, training reliable classifiers under severe class imbalance remains a challenging problem. Recent work has proposed techniques that mitigate the effects of training…

Machine Learning · Computer Science 2024-06-06 Kelsey Lieberman , Shuai Yuan , Swarna Kamlam Ravindran , Carlo Tomasi

We consider the problem of rank loss minimization in the setting of multilabel classification, which is usually tackled by means of convex surrogate losses defined on pairs of labels. Very recently, this approach was put into question by a…

Machine Learning · Computer Science 2012-07-03 Krzysztof Dembczynski , Wojciech Kotlowski , Eyke Huellermeier

Nonparametric estimation using uniform-width binning is a standard approach for evaluating the calibration performance of machine learning models. However, existing theoretical analyses of the bias induced by binning are limited to binary…

Machine Learning · Computer Science 2025-07-14 Masahiro Fujisawa , Futoshi Futami

We use a geometric digraph family called class cover catch digraphs (CCCDs) to tackle the class imbalance problem in statistical classification. CCCDs provide graph theoretic solutions to the class cover problem and have been employed in…

Machine Learning · Statistics 2019-04-10 Artür Manukyan , Elvan Ceyhan