English
Related papers

Related papers: Online Boosting Algorithms for Multi-label Ranking

200 papers

We present online boosting algorithms for multilabel ranking with top-k feedback, where the learner only receives information about the top k items from the ranking it provides. We propose a novel surrogate loss function and unbiased…

Machine Learning · Statistics 2020-10-20 Vinod Raman , Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Label ranking is a prediction task which deals with learning a mapping between an instance and a ranking (i.e., order) of labels from a finite set, representing their relevance to the instance. Boosting is a well-known and reliable ensemble…

Machine Learning · Computer Science 2020-09-24 Lihi Dery , Erez Shmueli

We study online boosting, the task of converting any weak online learner into a strong online learner. Based on a novel and natural definition of weak online learnability, we develop two online boosting algorithms. The first algorithm is an…

Machine Learning · Computer Science 2015-02-10 Alina Beygelzimer , Satyen Kale , Haipeng Luo

Recent work has extended the theoretical analysis of boosting algorithms to multiclass problems and to online settings. However, the multiclass extension is in the batch setting and the online extensions only consider binary classification.…

Machine Learning · Statistics 2018-02-27 Young Hun Jung , Jack Goetz , Ambuj Tewari

Boosting is a fundamental approach in machine learning that enjoys both strong theoretical and practical guarantees. At a high-level, boosting algorithms cleverly aggregate weak learners to generate predictions with arbitrarily high…

Machine Learning · Computer Science 2022-10-19 Vinod Raman , Ambuj Tewari

In multi-label classification, where the evaluation of predictions is less straightforward than in single-label classification, various meaningful, though different, loss functions have been proposed. Ideally, the learning algorithm should…

Machine Learning · Computer Science 2020-06-25 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz , Vu-Linh Nguyen , Eyke Hüllermeier

Multi-label ranking maps instances to a ranked set of predicted labels from multiple possible classes. The ranking approach for multi-label learning problems received attention for its success in multi-label classification, with one of the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Emine Dari , V. Bugra Yesilkaynak , Alican Mertan , Gozde Unal

In multi-label classification, where a single example may be associated with several class labels at the same time, the ability to model dependencies between labels is considered crucial to effectively optimize non-decomposable evaluation…

Machine Learning · Computer Science 2021-06-23 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz , Eyke Hüllermeier

Multilabel ranking is a central task in machine learning. However, the most fundamental question of learnability in a multilabel ranking setting with relevance-score feedback remains unanswered. In this work, we characterize the…

Machine Learning · Computer Science 2023-05-26 Vinod Raman , Unique Subedi , Ambuj Tewari

Boosting combines weak classifiers to form highly accurate predictors. Although the case of binary classification is well understood, in the multiclass setting, the "correct" requirements on the weak classifier, or the notion of the most…

Machine Learning · Statistics 2011-08-16 Indraneel Mukherjee , Robert E. Schapire

Existing online multi-label classification works cannot well handle the online label thresholding problem and lack the regret analysis for their online algorithms. This paper proposes a novel framework of adaptive label thresholding…

Machine Learning · Computer Science 2022-11-15 Tingting Zhai , Hongcheng Tang , Hao Wang

Boosting is known to be sensitive to label noise. We studied two approaches to improve AdaBoost's robustness against labelling errors. One is to employ a label-noise robust classifier as a base learner, while the other is to modify the…

Machine Learning · Computer Science 2013-09-27 Jakramate Bootkrajang , Ata Kaban

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss using a randomized…

Machine Learning · Statistics 2019-02-26 Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Boosting is an extremely successful idea, allowing one to combine multiple low accuracy classifiers into a much more accurate voting classifier. In this work, we present a new and surprisingly simple Boosting algorithm that obtains a…

Machine Learning · Computer Science 2024-09-02 Mikael Møller Høgsgaard , Kasper Green Larsen , Markus Engelund Mathiasen

We study the task of online boosting--combining online weak learners into an online strong learner. While batch boosting has a sound theoretical foundation, online boosting deserves more study from the theoretical perspective. In this…

Machine Learning · Computer Science 2012-07-03 Shang-Tse Chen , Hsuan-Tien Lin , Chi-Jen Lu

We extend the theory of boosting for regression problems to the online learning setting. Generalizing from the batch setting for boosting, the notion of a weak learning algorithm is modeled as an online learning algorithm with linear loss…

Machine Learning · Computer Science 2015-11-03 Alina Beygelzimer , Elad Hazan , Satyen Kale , Haipeng Luo

We study a generalization of boosting to the multiclass setting. We introduce a weak learning condition for multiclass classification that captures the original notion of weak learnability as being "slightly better than random guessing". We…

Machine Learning · Computer Science 2023-07-04 Nataly Brukhim , Amit Daniely , Yishay Mansour , Shay Moran

We present a novel multilabel/ranking algorithm working in partial information settings. The algorithm is based on 2nd-order descent methods, and relies on upper-confidence bounds to trade-off exploration and exploitation. We analyze this…

Machine Learning · Computer Science 2013-01-17 Claudio Gentile , Francesco Orabona

Boosting provides a practical and provably effective framework for constructing accurate learning algorithms from inaccurate rules of thumb. It extends the promise of sample-efficient learning to settings where direct Empirical Risk…

Machine Learning · Computer Science 2025-03-07 Udaya Ghai , Karan Singh

We consider the decision-making framework of online convex optimization with a very large number of experts. This setting is ubiquitous in contextual and reinforcement learning problems, where the size of the policy class renders…

Machine Learning · Computer Science 2021-02-19 Elad Hazan , Karan Singh
‹ Prev 1 2 3 10 Next ›