English
Related papers

Related papers: On loss functions and regret bounds for multi-cate…

200 papers

We address the problem of aggregating an ensemble of predictors with known loss bounds in a semi-supervised binary classification setting, to minimize prediction loss incurred on the unlabeled data. We find the minimax optimal predictions…

Machine Learning · Computer Science 2016-11-08 Akshay Balsubramani , Yoav Freund

Estimating the ratio of two probability densities from a finite number of observations is a central machine learning problem. A common approach is to construct estimators using binary classifiers that distinguish observations from the two…

Machine Learning · Computer Science 2025-01-28 Werner Zellinger

In many large-scale classification problems, classes are organized in a known hierarchy, typically represented as a tree expressing the inclusion of classes in superclasses. We introduce a loss for this type of supervised hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nicolas Urbani , Sylvain Rousseau , Yves Grandvalet , Leonardo Tanzi

A new loss function is proposed for neural networks on classification tasks which extends the hinge loss by assigning gradients to its critical points. We will show that for a linear classifier on linearly separable data with fixed step…

Machine Learning · Computer Science 2020-06-26 Justin Lizama

Most classification models can be considered as the process of matching templates. However, when intra-class uncertainty/variability is not considered, especially for datasets containing unbalanced classes, this may lead to classification…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 He Zhu , Shan Yu

We revisit the mathematical foundations of proper scoring rules (PSRs) and Bregman divergences and present their characteristic properties in a unified theoretical framework. In many situations it is preferable not to generate a PSR…

Statistics Theory · Mathematics 2015-09-11 Evgeni Y. Ovcharov

We study online aggregation of the predictions of experts, and first show new second-order regret bounds in the standard setting, which are obtained via a version of the Prod algorithm (and also a version of the polynomially weighted…

Machine Learning · Statistics 2014-02-11 Pierre Gaillard , Gilles Stoltz , Tim Van Erven

Modern applications in sensitive domains such as biometrics and medicine frequently require the use of non-decomposable loss functions such as precision@k, F-measure etc. Compared to point loss functions such as hinge-loss, these offer much…

Machine Learning · Computer Science 2014-10-27 Purushottam Kar , Harikrishna Narasimhan , Prateek Jain

In the last several years, the intimate connection between convex optimization and learning problems, in both statistical and sequential frameworks, has shifted the focus of algorithmic machine learning to examine this interplay. In…

Machine Learning · Computer Science 2014-07-23 Mehrdad Mahdavi

(Partial) ranking loss is a commonly used evaluation measure for multi-label classification, which is usually optimized with convex surrogates for computational efficiency. Prior theoretical work on multi-label ranking mainly focuses on…

Machine Learning · Computer Science 2021-05-12 Guoqiang Wu , Chongxuan Li , Kun Xu , Jun Zhu

Probabilistic classifiers are central for making informed decisions under uncertainty. Based on the maximum expected utility principle, optimal decision rules can be derived using the posterior class probabilities and misclassification…

Machine Learning · Computer Science 2025-03-25 Alexandre Perez-Lebel , Gael Varoquaux , Sanmi Koyejo , Matthieu Doutreligne , Marine Le Morvan

The goal of classification with rejection is to avoid risky misclassification in error-critical applications such as medical diagnosis and product inspection. In this paper, based on the relationship between classification with rejection…

Machine Learning · Statistics 2021-09-30 Nontawat Charoenphakdee , Zhenghang Cui , Yivan Zhang , Masashi Sugiyama

We use surrogate losses to obtain several new regret bounds and new algorithms for contextual bandit learning. Using the ramp loss, we derive new margin-based regret bounds in terms of standard sequential complexity measures of a benchmark…

Machine Learning · Computer Science 2018-11-06 Dylan J. Foster , Akshay Krishnamurthy

We define "decision swap regret" which generalizes both prediction for downstream swap regret and omniprediction, and give algorithms for obtaining it for arbitrary multi-dimensional Lipschitz loss functions in online adversarial settings.…

Machine Learning · Computer Science 2025-02-19 Jiuyao Lu , Aaron Roth , Mirah Shi

To deal with changing environments, a new performance measure -- adaptive regret, defined as the maximum static regret over any interval, was proposed in online learning. Under the setting of online convex optimization, several algorithms…

Machine Learning · Computer Science 2021-05-17 Lijun Zhang , Guanghui Wang , Wei-Wei Tu , Zhi-Hua Zhou

We analyze the problem of sequential probability assignment for binary outcomes with side information and logarithmic loss, where regret---or, redundancy---is measured with respect to a (possibly infinite) class of experts. We provide upper…

Information Theory · Computer Science 2015-01-30 Alexander Rakhlin , Karthik Sridharan

Existing online multi-label classification works cannot well handle the online label thresholding problem and lack the regret analysis for their online algorithms. This paper proposes a novel framework of adaptive label thresholding…

Machine Learning · Computer Science 2022-11-15 Tingting Zhai , Hongcheng Tang , Hao Wang

We investigate the problem of multiclass classification with rejection, where a classifier can choose not to make a prediction to avoid critical misclassification. First, we consider an approach based on simultaneous training of a…

Machine Learning · Statistics 2019-10-31 Chenri Ni , Nontawat Charoenphakdee , Junya Honda , Masashi Sugiyama

The goal of online prediction with expert advice is to find a decision strategy which will perform almost as well as the best expert in a given pool of experts, on any sequence of outcomes. This problem has been widely studied and…

Machine Learning · Computer Science 2018-05-22 Parameswaran Kamalaruban , Robert C. Williamson , Xinhua Zhang

Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with…

Machine Learning · Computer Science 2019-05-28 Alfonso Medela , Artzai Picon