English
Related papers

Related papers: Efficient Clustering in Stochastic Bandits

200 papers

Recently multi-armed bandit problem arises in many real-life scenarios where arms must be sampled in batches, due to limited time the agent can wait for the feedback. Such applications include biological experimentation and online…

Machine Learning · Statistics 2023-12-22 Shengyu Cao , Simai He , Ruoqing Jiang , Jin Xu , Hongsong Yuan

Many stochastic optimization algorithms work by estimating the gradient of the cost function on the fly by sampling datapoints uniformly at random from a training set. However, the estimator might have a large variance, which inadvertently…

Machine Learning · Computer Science 2017-08-10 Farnood Salehi , L. Elisa Celis , Patrick Thiran

We give a new algorithm for best arm identification in linearly parameterised bandits in the fixed confidence setting. The algorithm generalises the well-known LUCB algorithm of Kalyanakrishnan et al. (2012) by playing an arm which…

Machine Learning · Computer Science 2019-11-11 Mohammadi Zaki , Avinash Mohan , Aditya Gopalan

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

Machine Learning · Statistics 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier

We consider the stochastic multi-armed bandit problem and the contextual bandit problem with historical observations and pre-clustered arms. The historical observations can contain any number of instances for each arm, and the…

Machine Learning · Computer Science 2019-06-11 Djallel Bouneffouf , Srinivasan Parthasarathy , Horst Samulowitz , Martin Wistub

An automatic machine learning (AutoML) task is to select the best algorithm and its hyper-parameters simultaneously. Previously, the hyper-parameters of all algorithms are joint as a single search space, which is not only huge but also…

Machine Learning · Computer Science 2019-06-03 Yi-Qi Hu , Yang Yu , Jun-Da Liao

We study the problem of stochastic combinatorial pure exploration (CPE), where an agent sequentially pulls a set of single arms (a.k.a. a super arm) and tries to find the best super arm. Among a variety of problem settings of the CPE, we…

Machine Learning · Computer Science 2021-10-26 Yuko Kuroki , Liyuan Xu , Atsushi Miyauchi , Junya Honda , Masashi Sugiyama

This paper explores the application of bandit algorithms in both stochastic and adversarial settings, with a focus on theoretical analysis and practical applications. The study begins by introducing bandit problems, distinguishing between…

Machine Learning · Computer Science 2025-03-14 Samih Karroum , Saad Mazhar

Combinatorial bandits with semi-bandit feedback generalize multi-armed bandits, where the agent chooses sets of arms and observes a noisy reward for each arm contained in the chosen set. The action set satisfies a given structure such as…

Machine Learning · Statistics 2021-01-22 Marc Jourdan , Mojmír Mutný , Johannes Kirschner , Andreas Krause

This paper investigates stochastic and adversarial combinatorial multi-armed bandit problems. In the stochastic setting under semi-bandit feedback, we derive a problem-specific regret lower bound, and discuss its scaling with the dimension…

Machine Learning · Computer Science 2015-11-09 Richard Combes , M. Sadegh Talebi , Alexandre Proutiere , Marc Lelarge

We consider the problem of near-optimal arm identification in the fixed confidence setting of the infinitely armed bandit problem when nothing is known about the arm reservoir distribution. We (1) introduce a PAC-like framework within which…

Machine Learning · Statistics 2018-05-22 Maryam Aziz , Jesse Anderton , Emilie Kaufmann , Javed Aslam

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

Machine Learning · Computer Science 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

We propose a new strategy for best-arm identification with fixed confidence of Gaussian variables with bounded means and unit variance. This strategy, called Exploration-Biased Sampling, is not only asymptotically optimal: it is to the best…

Statistics Theory · Mathematics 2022-03-08 Antoine Barrier , Aurélien Garivier , Tomáš Kocák

We consider a non-stationary formulation of the stochastic multi-armed bandit where the rewards are no longer assumed to be identically distributed. For the best-arm identification task, we introduce a version of Successive Elimination…

Artificial Intelligence · Computer Science 2016-09-09 Robin Allesiardo , Raphaël Féraud , Odalric-Ambrym Maillard

We propose a novel combinatorial stochastic-greedy bandit (SGB) algorithm for combinatorial multi-armed bandit problems when no extra information other than the joint reward of the selected set of $n$ arms at each time step $t\in [T]$ is…

Machine Learning · Computer Science 2023-12-14 Fares Fourati , Christopher John Quinn , Mohamed-Slim Alouini , Vaneet Aggarwal

Multi-task learning in contextual bandits has attracted significant research interest due to its potential to enhance decision-making across multiple related tasks by leveraging shared structures and task-specific heterogeneity. In this…

Machine Learning · Computer Science 2025-11-07 Xia Jiang , Rong J. B. Zhu

The challenge of identifying the best feasible arm within a fixed budget has attracted considerable interest in recent years. However, a notable gap remains in the literature: the exact exponential rate at which the error probability…

Machine Learning · Computer Science 2025-06-04 Jie Bian , Vincent Y. F. Tan

We study best-arm identification with fixed confidence in bandit models with graph smoothness constraint. We provide and analyze an efficient gradient ascent algorithm to compute the sample complexity of this problem as a solution of a…

Machine Learning · Computer Science 2020-05-21 Tomáš Kocák , Aurélien Garivier

Error bound conditions (EBC) are properties that characterize the growth of an objective function when a point is moved away from the optimal set. They have recently received increasing attention in the field of optimization for developing…

Machine Learning · Statistics 2018-05-15 Mingrui Liu , Xiaoxuan Zhang , Lijun Zhang , Rong Jin , Tianbao Yang

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

Machine Learning · Computer Science 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He