English
Related papers

Related papers: Iterative Weak Learnability and Multi-Class AdaBoo…

200 papers

We study online boosting, the task of converting any weak online learner into a strong online learner. Based on a novel and natural definition of weak online learnability, we develop two online boosting algorithms. The first algorithm is an…

Machine Learning · Computer Science 2015-02-10 Alina Beygelzimer , Satyen Kale , Haipeng Luo

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss using a randomized…

Machine Learning · Statistics 2019-02-26 Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Boosting is a learning scheme that combines weak prediction rules to produce a strong composite estimator, with the underlying intuition that one can obtain accurate prediction rules by combining "rough" ones. Although boosting is proved to…

Machine Learning · Computer Science 2015-05-07 Shaobo Lin , Yao Wang , Lin Xu

Active learning with strong and weak labelers considers a practical setting where we have access to both costly but accurate strong labelers and inaccurate but cheap predictions provided by weak labelers. We study this problem in the…

Boosting is a general method to convert a weak learner (which generates hypotheses that are just slightly better than random) into a strong learner (which generates hypotheses that are much better than random). Recently, Arunachalam and…

Quantum Physics · Physics 2020-09-18 Adam Izdebski , Ronald de Wolf

In multi-label classification, where the evaluation of predictions is less straightforward than in single-label classification, various meaningful, though different, loss functions have been proposed. Ideally, the learning algorithm should…

Machine Learning · Computer Science 2020-06-25 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz , Vu-Linh Nguyen , Eyke Hüllermeier

Building on the quantum ensemble based classifier algorithm of Schuld and Petruccione [arXiv:1704.02146v1], we devise equivalent classical algorithms which show that this quantum ensemble method does not have advantage over classical…

Based on the use of different exponential bases to define class-dependent error bounds, a new and highly efficient asymmetric boosting scheme, coined as AdaBoostDB (Double-Base), is proposed. Supported by a fully theoretical derivation…

Computer Vision and Pattern Recognition · Computer Science 2015-07-09 Iago Landesa-Vázquez , José Luis Alba-Castro

On e-commerce platforms, predicting if two products are compatible with each other is an important functionality to achieve trustworthy product recommendation and search experience for consumers. However, accurately predicting product…

Machine Learning · Computer Science 2022-06-29 Rongzhi Zhang , Rebecca West , Xiquan Cui , Chao Zhang

Motivated by applications in protein function prediction, we consider a challenging supervised classification setting in which positive labels are scarce and there are no explicit negative labels. The learning algorithm must thus select…

Machine Learning · Computer Science 2019-01-28 Marco Frasca , Nicolò Cesa-Bianchi

Alongside the well-publicized accomplishments of deep neural networks there has emerged an apparent bug in their success on tasks such as object recognition: with deep models trained using vanilla methods, input images can be slightly…

Machine Learning · Computer Science 2021-03-04 Jacob Abernethy , Pranjal Awasthi , Satyen Kale

Class imbalance problem has been a challenging research problem in the fields of machine learning and data mining as most real life datasets are imbalanced. Several existing machine learning algorithms try to maximize the accuracy…

Language models are strong few-shot learners and achieve good overall accuracy in text classification tasks, masking the fact that their results suffer from great class accuracy imbalance. We believe that the pursuit of overall accuracy…

Computation and Language · Computer Science 2025-07-28 Ruixi Lin , Ziqiao Wang , Yang You

We consider the problem of boosting the accuracy of weak learning algorithms in the agnostic learning framework of Haussler (1992) and Kearns et al. (1992). Known algorithms for this problem (Ben-David et al., 2001; Gavinsky, 2002; Kalai et…

Machine Learning · Computer Science 2012-02-22 Vitaly Feldman

Curation of large fully supervised datasets has become one of the major roadblocks for machine learning. Weak supervision provides an alternative to supervised learning by training with cheap, noisy, and possibly correlated labeling…

Machine Learning · Computer Science 2021-06-01 Chidubem Arachie , Bert Huang

This paper studies binary classification in robust one-bit compressed sensing with adversarial errors. It is assumed that the model is overparameterized and that the parameter of interest is effectively sparse. AdaBoost is considered, and,…

Statistics Theory · Mathematics 2021-12-09 Geoffrey Chinot , Felix Kuchelmeister , Matthias Löffler , Sara van de Geer

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

We present a scalable and effective classification model to train multi-class boosting for multi-class classification problems. Shen and Hao introduced a direct formulation of multi- class boosting in the sense that it directly maximizes…

Machine Learning · Computer Science 2013-07-23 Sakrapee Paisitkriangkrai , Chunhua Shen , Anton van den Hengel

The aim of Active Learning is to select the most informative samples from an unlabelled set of data. This is useful in cases where the amount of data is large and labelling is expensive, such as in machine vision or medical imaging. Two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Julien Combes , Alexandre Derville , Jean-François Coeurjolly

Boosting algorithms have been widely used to tackle a plethora of problems. In the last few years, a lot of approaches have been proposed to provide standard AdaBoost with cost-sensitive capabilities, each with a different focus. However,…

Computer Vision and Pattern Recognition · Computer Science 2016-07-25 Iago Landesa-Vázquez , José Luis Alba-Castro