中文
相关论文

相关论文: An Online Boosting Algorithm with Theoretical Just…

200 篇论文

ProBoost, a new boosting algorithm for probabilistic classifiers, is proposed in this work. This algorithm uses the epistemic uncertainty of each training sample to determine the most challenging/uncertain ones; the relevance of these…

We present an oracle-efficient algorithm for boosting the adversarial robustness of barely robust learners. Barely robust learning algorithms learn predictors that are adversarially robust only on a small fraction $\beta \ll 1$ of the data…

机器学习 · 计算机科学 2022-02-15 Avrim Blum , Omar Montasser , Greg Shakhnarovich , Hongyang Zhang

While both cost-sensitive learning and online learning have been studied extensively, the effort in simultaneously dealing with these two issues is limited. Aiming at this challenge task, a novel learning framework is proposed in this…

机器学习 · 计算机科学 2013-10-31 Boyu Wang , Joelle Pineau

We investigate boosted online regression and propose a novel family of regression algorithms with strong theoretical bounds. In addition, we implement several variants of the proposed generic algorithm. We specifically provide theoretical…

统计理论 · 数学 2016-12-07 Dariush Kari , Farhan Khan , Selami Ciftci , Suleyman Serdar Kozat

Boosting is an extremely successful idea, allowing one to combine multiple low accuracy classifiers into a much more accurate voting classifier. In this work, we present a new and surprisingly simple Boosting algorithm that obtains a…

机器学习 · 计算机科学 2024-09-02 Mikael Møller Høgsgaard , Kasper Green Larsen , Markus Engelund Mathiasen

We introduce new online and batch algorithms that are robust to data with missing features, a situation that arises in many practical applications. In the online setup, we allow for the comparison hypothesis to change as a function of the…

机器学习 · 计算机科学 2012-02-19 Afshin Rostamizadeh , Alekh Agarwal , Peter Bartlett

AdaBoost is a classic boosting algorithm for combining multiple inaccurate classifiers produced by a weak learner, to produce a strong learner with arbitrarily high accuracy when given enough training data. Determining the optimal number of…

机器学习 · 计算机科学 2025-08-12 Mikael Møller Høgsgaard , Kasper Green Larsen , Martin Ritzert

We study a generalization of boosting to the multiclass setting. We introduce a weak learning condition for multiclass classification that captures the original notion of weak learnability as being "slightly better than random guessing". We…

机器学习 · 计算机科学 2023-07-04 Nataly Brukhim , Amit Daniely , Yishay Mansour , Shay Moran

We consider the problem of online boosting for regression tasks, when only limited information is available to the learner. We give an efficient regret minimization method that has two implications: an online boosting algorithm with noisy…

机器学习 · 计算机科学 2020-07-24 Nataly Brukhim , Elad Hazan

Boosting is an ensemble learning method that converts a weak learner into a strong learner in the PAC learning framework. Freund and Schapire designed the Godel prize-winning algorithm named AdaBoost that can boost learners, which output…

量子物理 · 物理学 2023-07-31 Debajyoti Bera , Rohan Bhatia , Parmeet Singh Chani , Sagnik Chatterjee

Inverse optimization is a powerful paradigm for learning preferences and restrictions that explain the behavior of a decision maker, based on a set of external signal and the corresponding decision pairs. However, most inverse optimization…

机器学习 · 计算机科学 2018-11-05 Chaosheng Dong , Yiran Chen , Bo Zeng

Boosting is a powerful method that turns weak learners, which perform only slightly better than random guessing, into strong learners with high accuracy. While boosting is well understood in the classic setting, it is less so in the…

机器学习 · 计算机科学 2026-02-04 Arthur da Cunha , Mikael Møller Høgsgaard , Andrea Paudice

Online recommender systems often deal with continuous, potentially fast and unbounded flows of data. Ensemble methods for recommender systems have been used in the past in batch algorithms, however they have never been studied with…

信息检索 · 计算机科学 2018-03-28 João Vinagre , Alípio Mário Jorge , João Gama

Boosting is a popular algorithm in supervised machine learning with wide applications in regression and classification problems. It combines weak learners, such as regression trees, to obtain accurate predictions. However, in the presence…

统计计算 · 统计学 2025-02-06 Zhu Wang

In boosting, we aim to leverage multiple weak learners to produce a strong learner. At the center of this paradigm lies the concept of building the strong learner as a voting classifier, which outputs a weighted majority vote of the weak…

机器学习 · 计算机科学 2024-12-23 Arthur da Cunha , Kasper Green Larsen , Martin Ritzert

The fields of machine learning and mathematical optimization increasingly intertwined. The special topic on supervised learning and convex optimization examines this interplay. The training part of most supervised learning algorithms can…

机器学习 · 计算机科学 2015-07-14 Nan Wang

The theory of boosting provides a computational framework for aggregating approximate weak learning algorithms, which perform marginally better than a random predictor, into an accurate strong learner. In the realizable case, the success of…

机器学习 · 计算机科学 2024-11-01 Udaya Ghai , Karan Singh

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss using a randomized…

机器学习 · 统计学 2019-02-26 Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Online learning is the process of answering a sequence of questions based on the correct answers to the previous questions. It is studied in many research areas such as game theory, information theory and machine learning. There are two…

机器学习 · 计算机科学 2019-03-27 Ankit Sharma , Late C. A. Murthy

The concept of boosting emerged from the field of machine learning. The basic idea is to boost the accuracy of a weak classifying tool by combining various instances into a more accurate prediction. This general concept was later adapted to…

统计方法学 · 统计学 2014-11-19 Andreas Mayr , Harald Binder , Olaf Gefeller , Matthias Schmid