English
Related papers

Related papers: Revisiting Simple Regret: Fast Rates for Returning…

200 papers

We investigate the problem of cumulative regret minimization for individual sequence prediction with respect to the best expert in a finite family of size K under limited access to information. We assume that in each round, the learner can…

Statistics Theory · Mathematics 2022-10-06 El Mehdi Saad , G. Blanchard

The stochastic multi-armed bandit problem is well understood when the reward distributions are sub-Gaussian. In this paper we examine the bandit problem under the weaker assumption that the distributions have moments of order 1+\epsilon,…

Machine Learning · Statistics 2012-09-11 Sébastien Bubeck , Nicolò Cesa-Bianchi , Gábor Lugosi

Partial monitoring is a general model for sequential learning with limited feedback formalized as a game between two players. In this game, the learner chooses an action and at the same time the opponent chooses an outcome, then the learner…

Machine Learning · Statistics 2015-10-01 Junpei Komiyama , Junya Honda , Hiroshi Nakagawa

In bandit with distribution shifts, one aims to automatically adapt to unknown changes in reward distribution, and restart exploration when necessary. While this problem has been studied for many years, a recent breakthrough of Auer et al.…

Machine Learning · Computer Science 2022-06-17 Joe Suk , Samory Kpotufe

We propose an online algorithm for cumulative regret minimization in a stochastic multi-armed bandit. The algorithm adds $O(t)$ i.i.d. pseudo-rewards to its history in round $t$ and then pulls the arm with the highest average reward in its…

Machine Learning · Computer Science 2019-11-06 Branislav Kveton , Csaba Szepesvari , Mohammad Ghavamzadeh , Craig Boutilier

Motivated by economic applications such as recommender systems, we study the behavior of stochastic bandits algorithms under \emph{strategic behavior} conducted by rational actors, i.e., the arms. Each arm is a \emph{self-interested}…

Machine Learning · Computer Science 2020-11-16 Zhe Feng , David C. Parkes , Haifeng Xu

Most bandit algorithm designs are purely theoretical. Therefore, they have strong regret guarantees, but also are often too conservative in practice. In this work, we pioneer the idea of algorithm design by minimizing the empirical Bayes…

Machine Learning · Computer Science 2020-06-12 Chih-Wei Hsu , Branislav Kveton , Ofer Meshi , Martin Mladenov , Csaba Szepesvari

We consider the adversarial multi-armed bandit problem under delayed feedback. We analyze variants of the Exp3 algorithm that tune their step-size using only information (about the losses and delays) available at the time of the decisions,…

Machine Learning · Computer Science 2020-10-14 András György , Pooria Joulani

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

Machine Learning · Statistics 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

The stochastic multi-armed bandit model is a simple abstraction that has proven useful in many different contexts in statistics and machine learning. Whereas the achievable limit in terms of regret minimization is now well known, our aim is…

Machine Learning · Statistics 2016-11-15 Emilie Kaufmann , Olivier Cappé , Aurélien Garivier

In a fixed-confidence pure exploration problem in stochastic multi-armed bandits, an algorithm iteratively samples arms and should stop as early as possible and return the correct answer to a query about the arms distributions. We are…

Machine Learning · Computer Science 2025-02-04 Adrienne Tuynman , Rémy Degenne

In this paper, we consider the low rank structure of the reward sequence of the pure exploration problems. Firstly, we propose the separated setting in pure exploration problem, where the exploration strategy cannot receive the feedback of…

Machine Learning · Computer Science 2023-06-29 Yaxiong Liu , Atsuyoshi Nakamura , Kohei Hatano , Eiji Takimoto

We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is…

Machine Learning · Computer Science 2022-10-17 Jasmin Brandt , Viktor Bengs , Björn Haddenhorst , Eyke Hüllermeier

In this paper, we investigate the streaming bandits problem, wherein the learner aims to minimize regret by dealing with online arriving arms and sublinear arm memory. We establish the tight worst-case regret lower bound of $\Omega \left(…

Machine Learning · Computer Science 2023-06-14 Shaoang Li , Lan Zhang , Junhao Wang , Xiang-Yang Li

Most bandit algorithms assume that the reward variances or their upper bounds are known, and that they are the same for all arms. This naturally leads to suboptimal performance and higher regret due to variance overestimation. On the other…

Machine Learning · Computer Science 2023-10-13 Aadirupa Saha , Branislav Kveton

We study stochastic multi-armed bandits under simultaneous constraints on space and adaptivity: the learner interacts with the environment in $B$ batches and has only $W$ bits of persistent memory. Prior work shows that each constraint…

Machine Learning · Computer Science 2026-03-31 Ruiyuan Huang , Zicheng Lyu , Xiaoyi Zhu , Zengfeng Huang

We study a new type of K-armed bandit problem where the expected return of one arm may depend on the returns of other arms. We present a new algorithm for this general class of problems and show that under certain circumstances it is…

Machine Learning · Computer Science 2014-11-12 Tor Lattimore , Remi Munos

We consider the infinitely many-armed bandit problem with rotting rewards, where the mean reward of an arm decreases at each pull of the arm according to an arbitrary trend with maximum rotting rate $\varrho=o(1)$. We show that this…

Machine Learning · Computer Science 2023-12-19 Jung-hun Kim , Milan Vojnovic , Se-Young Yun

Stochastic rising rested bandit (SRRB) is a setting where the arms' expected rewards increase as they are pulled. It models scenarios in which the performances of the different options grow as an effect of an underlying learning process…

Machine Learning · Statistics 2025-05-21 Marco Fiandri , Alberto Maria Metelli , Francesco Trovò

This paper presents a comprehensive study on the problem of Best Arm Retention (BAR), which has recently found applications in streaming algorithms for multi-armed bandits. In the BAR problem, the goal is to retain $m$ arms with the best…

Machine Learning · Computer Science 2025-04-17 Houshuang Chen , Yuchen He , Chihao Zhang