English
Related papers

Related papers: Better Boosting with Bandits for Online Learning

200 papers

Bandit algorithms sequentially accumulate data using adaptive sampling policies, offering flexibility for real-world applications. However, excessive sampling can be costly, motivating the devolopment of early stopping methods and reliable…

Statistics Theory · Mathematics 2025-02-06 Zihan Cui

We address online linear optimization problems when the possible actions of the decision maker are represented by binary vectors. The regret of the decision maker is the difference between her realized loss and the best loss she would have…

Machine Learning · Computer Science 2013-04-02 Jean-Yves Audibert , Sébastien Bubeck , Gábor Lugosi

Traditional online learning models are typically initialized from scratch. By contrast, contemporary real-world applications often have access to historical datasets that can potentially enhanced the online learning processes. We study how…

Machine Learning · Computer Science 2025-12-19 Wang Chi Cheung , Lixing Lyu

Smoothed online combinatorial optimization considers a learner who repeatedly chooses a combinatorial decision to minimize an unknown changing cost function with a penalty on switching decisions in consecutive rounds. We study smoothed…

Machine Learning · Computer Science 2023-01-18 Kai Wang , Zhao Song , Georgios Theocharous , Sridhar Mahadevan

The problem of combining individual forecasters to produce a forecaster with improved performance is considered. The connections between probability elicitation and classification are used to pose the combining forecaster problem as that of…

Methodology · Statistics 2017-07-11 Hamed Masnadi-Shirazi

This paper examines whether widely used online learning algorithms in pricing can independently reach competitive outcomes or instead foster tacit collusion. This issue has drawn considerable attention from competition regulators as…

Computer Science and Game Theory · Computer Science 2025-11-25 Martin Bichler , Julius Durmann , Matthias Oberlechner

Stochastic multi-armed bandits form a class of online learning problems that have important applications in online recommendation systems, adaptive medical treatment, and many others. Even though potential attacks against these learning…

Machine Learning · Computer Science 2019-05-17 Fang Liu , Ness Shroff

Multicalibration gradient boosting has recently emerged as a scalable method that empirically produces approximately multicalibrated predictors and has been deployed at web scale. Despite this empirical success, its convergence properties…

Machine Learning · Computer Science 2026-02-09 Daniel Haimovich , Fridolin Linder , Lorenzo Perini , Niek Tax , Milan Vojnovic

Boosting is an extremely successful idea, allowing one to combine multiple low accuracy classifiers into a much more accurate voting classifier. In this work, we present a new and surprisingly simple Boosting algorithm that obtains a…

Machine Learning · Computer Science 2024-09-02 Mikael Møller Høgsgaard , Kasper Green Larsen , Markus Engelund Mathiasen

Being cautious is crucial for enhancing the trustworthiness of machine learning systems integrated into decision-making pipelines. Although calibrated probabilities help in optimal decision-making, perfect calibration remains unattainable,…

Machine Learning · Computer Science 2024-08-12 Mari-Liis Allikivi , Joonas Järve , Meelis Kull

We study online learning with bandit feedback across multiple tasks, with the goal of improving average performance across tasks if they are similar according to some natural task-similarity measure. As the first to target the adversarial…

Machine Learning · Computer Science 2022-05-30 Maria-Florina Balcan , Keegan Harris , Mikhail Khodak , Zhiwei Steven Wu

Gradient boosting from the field of statistical learning is widely known as a powerful framework for estimation and selection of predictor effects in various regression models by adapting concepts from classification theory. Current…

Methodology · Statistics 2020-11-03 Colin Griesbach , Benjamin Säfken , Elisabeth Waldmann

We extend the theory of boosting for regression problems to the online learning setting. Generalizing from the batch setting for boosting, the notion of a weak learning algorithm is modeled as an online learning algorithm with linear loss…

Machine Learning · Computer Science 2015-11-03 Alina Beygelzimer , Elad Hazan , Satyen Kale , Haipeng Luo

Bandit learning has been an increasingly popular design choice for recommender system. Despite the strong interest in bandit learning from the community, there remains multiple bottlenecks that prevent many bandit learning approaches from…

Information Retrieval · Computer Science 2023-08-01 Hongbo Guo , Ruben Naeff , Alex Nikulkov , Zheqing Zhu

We consider the problem of online combinatorial optimization under semi-bandit feedback, where a learner has to repeatedly pick actions from a combinatorial decision set in order to minimize the total losses associated with its decisions.…

Machine Learning · Computer Science 2015-06-11 Gergely Neu

Label ranking is a prediction task which deals with learning a mapping between an instance and a ranking (i.e., order) of labels from a finite set, representing their relevance to the instance. Boosting is a well-known and reliable ensemble…

Machine Learning · Computer Science 2020-09-24 Lihi Dery , Erez Shmueli

In many online decision processes, the optimizing agent is called to choose between large numbers of alternatives with many inherent similarities; in turn, these similarities imply closely correlated losses that may confound standard…

Machine Learning · Computer Science 2022-06-22 Matthieu Martin , Panayotis Mertikopoulos , Thibaud Rahier , Houssam Zenati

We study online fair division when there are a finite number of item types and the player values for the items are drawn randomly from distributions with unknown means. In this setting, a sequence of indivisible items arrives according to a…

Computer Science and Game Theory · Computer Science 2025-01-14 Benjamin Schiffer , Shirley Zhang

In online algorithm selection (OAS), instances of an algorithmic problem class are presented to an agent one after another, and the agent has to quickly select a presumably best algorithm from a fixed set of candidate algorithms. For…

Machine Learning · Computer Science 2021-09-15 Alexander Tornede , Viktor Bengs , Eyke Hüllermeier

As more data are produced each day, and faster, data stream mining is growing in importance, making clear the need for algorithms able to fast process these data. Data stream mining algorithms are meant to be solutions to extract knowledge…